View on GitHub

Data Products and Interpolation

Oak Ridges Moraine Groundwater Program

Web Scraping

Web scraping is the process of extracting data from websites through scheduled/automated scripts.

On a nightly basis, data are extracted from a number of open data sources, whether they be:

Notes:

Streamflow discharge and stage are re-scaled to daily mean timesteps when inserted into our database.

Sources:

A number of our partners maintain internal databases. Attempts are continuing to integrate these sources to our workflow without the need for data duplication. This is (hopefully) accomplished by establishing an Application Programming Interface (API) on the partners’ end. Currently, we have:

see also Source References.

APIs

File repositories

HTML Tables