The Next Generation of HiPER: Entity Resolution in Hadoop

If you read any news about Big Data in 2015, chances are you will come across a reference to Hadoop. For years, the ability to process large data sets has been limited by processing power. Instead of running locally on one server, Hadoop processes data across clusters of less powerful machines.

HiPER version 2.0 is a next-generation entity identity information management tool built specifically to run in a Hadoop environment.Every indication from companies in the Big Data industry is the processing power of running matching systems across clusters is significantly higher than previous methods (and our testing confirms this). HiPER version 2.0, still in the testing phase, is forthcoming in late 2015, early 2016

Although Black Oak is still developing the full release of HiPER version 2.0, future improvements and enhancements are already being planned. The field of Information Quality (IQ), a subfield of information science, is a relatively new field academically. As developments continue to arise in the IQ field, our dedicated HiPER development team will continue to ensure we are using the most up-to-date technologies, design practices, and implementation methodologies available.