Formatted Title
Automated Approach to High Resolution, Real-Time Environmental Data Management
Background/Objectives
There is an increasing demand for teams to remotely monitor sensor data in real time on project sites. Some sites, particularly those with remediation systems, can generate millions of records of data. Managing this volume of data can be challenging due to the scale and frequency.
Approach/Activities
ERM has developed an innovative approach to automate, manage and visualize this high-volume sensor data. Project sites with activities such as pump and treat, soil vapor extraction, thermal, noise/vibration, transducers, etc. often generate high resolution, real-time environmental data. Typically collected with a frequency between 5 to 60 minutes over the course of months or years, millions of data records can easily be generated over time.
ERM has developed this approach by using scripts to help automate the transformation of data, and two software platforms including EQuIS™ and Microsoft PowerBI™. The approach to full data automation begins with a collaborative effort between ERM and a subcontractor(s) who have the ability to automate data pushes from the project site to a common location, where the data are then consumed by EQuIS™. Additional data processing and reporting are built into our automated EQuIS™ data flows, with the final stop for the data being a Power BI™ dashboard, also automatically refreshed on a daily schedule. The dashboard can then be shared with project teams and clients, giving them real-time access to customized data visualization.
Results/Lessons Learned
During the presentation we will go over how this approach to managing and visualizing high resolution, real-time data has enabled project teams to monitor sites remotely and make informed data-driven decisions. We will discuss key trends in the industry including telemetry and automation.