Data Warehouse Optimization

Challenge

Legacy enterprise data warehouse was becoming costly to scale to process and store unstructured data. They were also experiencing poor reporting and analytics response times for big data volumes. Lastly, they were seeing a sizable increase in departmental demands for access to the data warehouse. In response to these factors, they launched a data warehouse modernization program designed to address these requirements through the implementation of big data open source technologies.

Solution

Designed a solution to implement a Hadoop-based big data warehouse. Migrated their Netezza and Oracle-based data warehouses to Postgres. Migrated legacy ETL functions to Hadoop. An Impetus big data team handled all PL/SQL code migration, data migration and testing.

Delivering on the Promise

Offloaded the Netezza data warehouse and 48 Oracle licenses to Hadoop. Resulted in $3.0 million annual recurring savings on legacy upgrades and annual support costs.

Tell me more

Industry:

Telecommunications


Technologies:

Hortonworks (HDP) Hadoop, MapReduce, Hive, Pig, Postgres