Data sources from URLs

Data sources from URLs

Summary

The URL connector allows you to collect data from HTTP(s) and FTP protocols.

To collect data from a file hosted in a URL, you must go to Data sources > From URLs


Configuration

Enter a URL with a clear link from where you want to collect. After completing the required fields, press the Continue button.



We accept the following types of files:
  1. Open format: CSV, TSV.
  2. Text format: TXT
  3. Excel Format: XLSX
  4. OpenOffice Format: SDGs
  5. Georeferenced data: Keyhole Markup Language (KML, KMZ)

To avoid errors in views, files must be encoded as UTF-8.

We recommend checking whether the web server hosting the file supports the If-Modified-Since header, to avoid future consultation if there were no changes, and thus optimize subsequent consultation of the data.

For example, if the data is updated every hour, select "Every hour". If they are daily update data, for example financial indicators, select the "Daily" option.

With the option "Other" you can enter a specific timetable.

If you do not know which option to select, do not select any or select "Under demand".

    • Related Articles

    • Data sources from REST/json web services

      Summary The REST/JSON web services connector offers all the capabilities needed to connect to such sources. This option allows you to collect data from REST/JSON web services or configure writing actions, and then create data views and exhibit them ...

    • What is a data view

      Summary The platform does not require an off-line ETL process to extract data from the origins, but associated with the view, find a set of rules that the data engine interprets for check the source on demand or periodically, extract the data updated ...

    • Databases from Databases

      Summary The Databases connector offers all the capabilities needed to connect to such sources. This option allows you to collect data from different types of databases or configure writing actions, then create data views and exhibit them in your API. ...

    • What are data sources

      Summary Data sources are the starting point for the data flow, from which data views and APIs methods are created. Below you can find data sources characteristics. Some basic concepts When we talk about data sources, we must consider the following: ...

    • Data sources from files

      Summary The Platform provides the possibility of using files as the Origin of data, upload it to the platform and then create data views and expose them in methods of your API. To upload a file, you must go to Data Sources > From File. Configuration ...