We developed the Hadoop Datamart Importer to remove repetitive scripting and debugging tasks, significantly reducing the time and complexity of Hadoop data migration.
Chicago, IL (PRWEB) November 04, 2014
Inquidia Consulting is announcing the development of a new framework to simplify the evaluation of high speed query engines on Hadoop, including Cloudera Impala. The Hadoop Datamart Importer (HDI), developed with the Pentaho Data Integration technology stack, allows developers to rapidly migrate existing relational database content to Hadoop for access with Hive and Cloudera Impala.
“Before HDI, migrating data from relational databases into Hive and Impala required a lot of manual scripting,“ said Chris Deptula, senior architect for the project. “We developed the Hadoop Datamart Importer to remove repetitive scripting and debugging tasks, significantly reducing the time and complexity of Hadoop data migration.
HDI is a framework that was conceived and developed in Inquidia’s Data Lab as a result of performing multiple Hadoop migrations and prototypes over the past year. The framework is currently used by the Inquidia consulting team to help customers understand how SQL on Hadoop can replace existing analytic databases.
“When we’re helping our customers evaluate Big Data architectures, they often want to understand if lower-cost SQL on Hadoop engines can give them the query performance they need for high speed business analytics,” said David Reinke, senior partner. “HDI lets us rapidly migrate data to see the possible performance benefits of Cloudera Impala.”
The framework is available to customers as a part of Inquidia’s consulting services. For more information, read about HDI here, or read more about Inquidia Consulting’s services at http://www.inquidia.com.
About Inquidia Consulting
Inquidia is an innovative professional services firm delivering full spectrum data engineering and analytics services that help our customers inquire, learn and take action with their data. We are passionate about data. Find out more at http://www.inquidia.com.