Monitoring and operations optimization across 200,000+ IoT sensors
DataHex data lake re-architecture, managed service
Challenge
A data lake that could not keep up
With over 200,000 IoT sensors streaming metrics from operational plants around the clock into a data lake, the platform could not handle the volume or meet data-science query response times, thousands of data-science workloads created operational risk, new datasets and use cases could not be onboarded, and operating costs were high.
Solution
A new data lake architecture, migrated without disruption
A new data lake architecture, with options benchmarked; migration of existing data with no impact to workloads or production; new access APIs for easy onboarding of use cases; a new security architecture; and new DevOps processes for faster, higher-quality deployment.
What DataHex delivered
- A new data lake architecture With options benchmarked before selection.
- Migration with no disruption Existing data moved with no impact to workloads or production.
- New access APIs Easy onboarding of new datasets and use cases.
- New security architecture and DevOps Faster, higher-quality deployment.
Results
Faster deployment, dramatically lower cost
- A scalable, agile AWS data lake meeting performance needs and onboarding new use cases quickly
- Improved deployment speed and quality
- Dramatically reduced operating cost
- The platform supports more than 15 million operational queries per month and is growing quickly
Talk to us
Ready to build your own data marketplace?
We will walk your team through what a launch looks like, from catalog and licensing to delivery and managed service.