Modern Data Ingestion Framework
An insurance company had dozens of data warehouses they could not query at the same time, causing the effort to compare data to take months.
Illumination Works provided pre-built ingestion patterns to the enterprise data warehouses enabling complex analytics on two or more data sets with speed and flexibility for better decision making.
- Developed flexible and extensible metadata-driven ingestion framework for a Hadoop target
- Ingested structured and semi-structured data into Hadoop, making data available in a single, centralized data warehouse, thereby eliminating data silos
- Provided active online storage capabilities at a low cost (commodity hardware) using Hadoop
- Data ingestion framework
- Hadoop platform