key concepts in big data

Three Concepts in “Big Data” Systems You Need to Worry About

blackoak Master Data Management Leave a Comment

By Dr. John R. Talburt For some time, the industry has been moving towards the implementation of new distributed processing technologies and this movement is laying the foundation for the next generation of IT systems. While these new technologies are starting to free us from the tyranny of single-server processing and the rigidity of relational database system architectures, we now …

analyzing information quality

Quality vs Quantity: What Matters Most in Analyzing Enterprise Data?

blackoak Master Data Management Leave a Comment

By Dr. John R. Talburt In academia we say both quality and quantity are equally important to enterprise data. In business we would say, “It depends.” However, the real answer is that this is a false choice like the question of “what happened to the missing dollar?” in the bellboy story. According to the fundamental principles of analyzing information quality, …

Four Use Cases of Big Data Technologies

blackoak Master Data Management

By Dr. John R. Talburt Big data tools are key pieces of marketing technology in all corporate environments today. This has become so as the use cases for big data have changed and grown along with their potential. Now that this paradigm has clearly shifted, it is just as important to understand where it is going and where it came …

The Next Generation of HiPER: Entity Resolution in Hadoop

blackoak Master Data Management

If you read any news about Big Data in 2015, chances are you will come across a reference to Hadoop. For years, the ability to process large data sets has been limited by processing power. Instead of running locally on one server, Hadoop processes data across clusters of less powerful machines. HiPER version 2.0 is a next-generation entity identity information …

Brief History of HiPER

blackoak Master Data Management

Development of Black Oak’s High Performance Entity Resolution system (HiPER) began in 2009 and the first release (version 1.0) was completed in 2011. By 2012, HiPER version 1 was in use, and is still used today. The original release of HiPER runs locally and has advanced matching functions including Boolean and Scoring Rules. The initial inspiration for the product began …