The Oak Ridges Moraine Groundwater Program (ORMGP) maintains an authoritative understanding of:
- the geological layering for the area;
- the groundwater flow system; and
- linkages to the region’s surface waters and climatologies.
The ORMGP has the need to:
- coordinate disparate datasets so that correlation among environmental phenomena can be investigated
- data are sourced primarily from open datasets and are ingested into our database
- by virtue of being in our database, web applications allowing users to analyze the data become available
- this is a system of delivering information needed for water resources and planning.
The following is an index to the data maintained and produced by the ORMGP. All data can be cited by a link below.
- Data Sources
- Web Applications
- Open Data Products
- Numerical Modelling
Our main MSSQL Server database holds all the information to support our decision-making tools. The ORMGP data systems are active, in that they are automatically updated at near real-time. From hourly and daily intervals, a series of web-scraping routines have been written to access open data made available from many sources including international, federal, provincial, municipal and conservation authority agencies. The objective is to centralize hydrogeological and hydrological data for the south-central Ontario (Canada) jurisdiction that currently makes-up the ORMGP. Data sources: more details.
Database groundwater monitoring locations
Monitoring locations with >35 monitoring dates
Elevation, Drainage and Topology
For groundwater elevations, digital elevation data are used to correct depths of measure to metres above sea level (masl). Therefore, vertical accuracy and datum are tied to the digital elevation (terrain) model (DEM) we used as reference. Currently, correction are taken to the 10m 2006 OMNR Digital Elevation Model - Version 2.0.0 - Provincial Tiled Dataset.
Overland flow drainage and their pathways (topology) are defined using the 30m Provincial Digital Elevation Model - South (CGVD2013).
Sub-watershed characterization and flow topology
Meteorological station data
- Data source References: climate and streamflow
- Near-Real-Time Data Acquisition, updated nightly, including:
- Daily data
- Min/max daily temperature
- Atmospheric/Barometric pressure
- Precipitation (rainfall and snowfall)
- Snowmelt (sourced and computed)
- Potential evaporation (computed)
- Hourly data, updated every 6-hours, including:
- Precipitation (distributed, re-analysed, 6hr accumulations)
- Air temperature
- Atmospheric/Barometric pressure
- Relative humidity
- Windspeed and direction
- Potential evaporation flux
- Daily data
Geocortex Data Portal
The ORMGP Geocortex Mapping hub has been divided into various Theme Maps to allow users to quickly hone in on the information they might be seeking. For example, the Documents Theme Map provides access to the program’s library of reports, The Boreholes Theme Map focuses on providing access to borehole specific information, and the Geology Theme Map provides access to all of the ORMGP geologically related mapping. The Theme Maps group specific related data sets or interpreted products (more info here).
Our current web-mapping system relies on Geocortex
R-Shiny-Leaflet mapping with access to our monitoring dataset.
- [R-Shiny apps]
- Automatic hydrograph separation
- Hydrograph disaggregation
Open Data Products
Our metadata repository, Table of Contents.
Static 2D fields, updated frequently
Water Table Mapping
Clip ‘n Ship
- “Clip ‘n Ship” — A bulk spatial data export system, by geographic extent. Includes many of the products listed below.
Spatially interpolated, near real-time data
- Cleansed Climate Data for use in our water budget product which includes the computation of potential evaporation, snowmelt, etc. from available data.
- Spatial and Temporal interpolation of point/scalar data.
- Barometric pressure elevation-corrected and projected to a 2km regional grid.
Distributed time-series data, updated nightly
Numerical modelling are applied in two ways:
- A long-term data assimilation system that uses hydrological analysis tools (i.e., models) and leverages the ORMGP’s database. What amounts to data assimilation system (DAS) utilized modelling technology to provide real-time interpolation of the hydrological system, data we have access to. The computational structure of the DAS is specifically tailored to run as fast as possible, such that thousands of model “projections” made continuously on ORMGP servers. The results from this analysis will likely be offered as monthly ranges in long term seasonal water balance estimates.
- Other tools are intended for predictive use, but are restricted to short-term (less than 30 days) projections. The design of these models is more physically rigorous but will always be dependent on other models (existing groundwater models or the DAS described here) to prescribe the antecedent conditions. While computational time for this model is orders of magnitudes greater than that of the DAS, it continuous to share the philosophy of designed whereby computation efficiency is paramount.
Combined, these two tools will provide all water groundwater resources needs for the ORMGP partners in order to:
- utilize readily available datasets provided daily by government agencies of Canada and the United States without the need for data pre-processing
- capture long-term hydrological water budget estimates with an emphasis on its certainty
- project near-term hydrological response given a known antecedent state
Existing numerical model files, output and sharing
We have established a numerical modelling sharing process to assist consultants in moving forward on various projects by making use of previous interpretations/work. The mission of the ORMGP numerical model custodianship program is to provide numerical models to any consultant undertaking work within our partners’ jurisdiction.
Users (e.g., consultants) are expected to review the shared models’ suitability to their intended application. Considering the age of the models, the expertise who constructed the model, the model’s original intent, etc., it is the responsibility of the user to determine whether there is an approach more suitable than just using the model files as delivered. For instants, some consultants have only selected specific model file components (i.e. hydraulic conductivity distribution or geological layering, thicknesses etc.) to complete their task.
Users are free to update/modify the model in the hopes that the refinements are shared in return and knowledge preserved.
Often, within any geographical area of a new/proposed consulting project, there are several models that could be used to aid the new project. Given the nature of the proposed project (e.g. water supply, contamination investigation, proposed land development, etc.) we could make suggestions the most appropriate model or the consultant is free to select any or all models, where available.
The idea is that model sharing could perhaps reduce duplication of effort, thereby lowering consulting costs by providing previous modelling insights in a transferable digital format. Given that every project is different, the likelihood that a model can be transferred to address the needs of a another study may be quite low.
- Numerical Model Custodianship Program — model archive.
- A Guide for Actively Managing Watershed-Scale Numerical Models in Ontario — model management guidance (2017)
Set of numerical models maintained in the custodianship program
Particle Tracking web-tool
The ORMGP particle tracking tool shows both the forward or backward particle tracking from a site that is being studied. The tool is built upon numerical models which have organized, synthesized and interpreted a wealth of hydrogeological information (e.g., boreholes, geological mapping, previous studies, etc.).
- More info on 3D particle tracking of the groundwater flow system and the methodology used in our web tool.
Regional Water Budget, Long-term and Continuous
- Fine-resolution (2,500 m²) Water Budgeting using a regionally-distributed runoff-recharge model for Long-term (>20 years) continuos 6-hourly hydrological modelling of the ORMGP jurisdiction.
- Lateral water movement: a local inertial approximation of the shallow water equation for lateral movement of water.
- Multiphase flow through porous media: a one-dimensional fully-implicit multi-layer solution to multi-phase flow through porous media used to investigate infiltration, evaporation and runoff generation.
- Geothermal transport modelling.
- Urban water balance, Low Impact Design (LID) modelling, groundwater I&I, etc. using GSFLOWurban.
- Artificial Neural Network Machine Learning hydrograph simulation.
A number of open-source and proprietary data analysis tools have been employed in our overall data management system. In contribution to the open-source community, much of our work has also left open on our Github.
Tools (external links)
- Github pages — the hosting of technical information, like what you see now.
- Beautiful Soup — web scraping
- NumPy, Pandas — data manipulation
- (and many more)
- R and RStudio — a free, open-source “…software environment for statistical computing and graphics.”
- R-Shiny — online, real-time data analytics
- Leaflet for R — web mapping
- ggplot2 — data visualization
- dygraphs for R — dynamic time-series visualization
Databases (external links)
Databases and APIs
- Our main MSSQL Server database
- VertiGIS Studio/Geocortex — Our principle web mapping server used by partners to access our database and products.
- golang server — multi-functional REST API serving a variety of data products and interpolation tools.
- fews server — home for the ORMGP-FEWS data management system.
- ORMGP-cron: a linux server with scheduled web-scraping tasks mostly written in Python.
- ORMGP-FEWS: our operational Delft-FEWS system that scrapes, stores, interpolates and regenerates data served on ORMGP-cron.