Most users of environmental equipment face serious challenges with data management. Issues run the gamut: Some groups struggle to reliably import data into their visualization system of choice because manufacturers use different file formats that change periodically. Some wrestle with data that gets scattered across multiple devices and PCs over time. For some it can be challenging just to check logged values in the field, because lugging that laptop is a giant hassle and most handhelds don’t display data well. And even with access to a PC, users can be thwarted by the popular Microsoft Excel, which is notorious for altering data as it’s imported for analysis, especially with .CSV files.
That’s why I’m excited to share the latest on In-Situ’s advancements in automated data management! With In-Situ’s new Universal Data File format output by VuSitu, we’ve solved many of these problems.
This new .html format for data recordings and log files can be opened by most almost any browser on both PCs or smartphones for a quick check of incoming data. Microsoft Excel can open these files directly, and the format prevents any inadvertent data alterations, just like a native Excel file. And most importantly, the format is actually XML under the hood, allowing for easy automated parsing and import of scripts into existing databases and storage techniques. (Find out more about this automation in our documentation that includes sample code here: Parsing Guide.
I’ll cover all of this and more at my presentation on data handling at NGWA this Thursday, Dec. 6, 9:30 a.m., in Activity Area A. We’ll look at using Python to parse CSV files, and why that’s both a time saver and a flawed approach. We’ll discuss more advanced topics like parsing XML files and JSON, and why these more complex formats actually save time vs. CSVs. And we’ll discuss and show a simple example of how to connect to and use an API for fully automated data import.
If you’re at the show be sure to stop by. And stay tuned for exciting news about some of these third party integrations, or find out more about integrating your own solution here: HydroVu API