GigaOM Pro

Hadoop distribution provider, MapR and data integration software maker Informatica, have partnered to provide Big Data integration and analysis. Using MapR and Informatica together, organizations will now be able to perform high performance data integration, replication and messaging, the companies said. They claim that jointly they can move many terabytes per hour of transaction, interaction and streaming data into MapR, as well as parse and process a broad range of structured and unstructured data natively in Hadoop, without coding. The reason they can hit this kind of performance is because the MapR distribution of Hadoop does not use the native file system in Hadoop (HDFS), but instead supports the Unix network file system (NFS) protocol, a lockless system that means it can stream massive amounts of data into Hadoop from, in this case, Informatica’s messaging system. MapR has long-touted its version of Hadoop, which it calls “Hadoop equivalent” as preferable to the open-source Apache code for performance. The Informatica partnership appears to be a concrete example of those performance benefits.