SYSTAP Launches MapGraph to Process Graph Data 10,000 Times Faster
Washington, D.C. (PRWEB) March 11, 2015 -- In today’s always-on and always-connected world, the amount of data that people generate every second is huge and is growing at an incredible rate. Graphs are a way to organize this information by linking it together. Not just nodes and links, and beyond Facebook, LinkedIn, and six-degrees of Kevin Bacon, graphs occur in many important domains and markets. A social network of people and their connections, a fraud-detection system, a battlefield filled with soldiers and other resources, or a human body made of many biological systems are all examples of graphs. The potential of graph analytics is well known, but existing platforms have been limited in their ability to process this information at a large scale. The next generation of significant business, medical, and information science advances will made by those who can harness the data and the links between it quickly and cost-effectively, drawing new conclusions and making discoveries at lightning speed.
SYSTAP has a new approach to processing this data, and it’s already showing impressive results. They are delivering graph analytics that process data up to 10,000 times faster using Mapgraph™ technology. In October 2014, at the IEEE Bigdata Conference, SYSTAP demonstrated their technology achieving a rate of 32 Billion Traversed Edges Per Second (GTEPS). This puts their performance at that of a super-computer for a 1/10 of the cost.
“Facebook is currently more than a trillion edges and we believe it takes more than 10 minutes using 200+ racks of servers to traverse their graph over a single iteration. We believe our Mapgraph™ technology could do it in seconds on a cluster of GPUs with similar RAM,” says Brad Bebee, CEO, SYSTAP.
This has the attention of the most cutting-edge thinkers in technology and data science. SYSTAP is one of 12 companies chosen to present at the Early-Stage Challenge at the NVIDIA GPU Conference on March 18, 2015, with a chance to win $100,000.
SYSTAP will also announce the launch of its products related to its Mapgraph ™ technology at the conference. Mapgraph™ Accelerator is a GPU-based plug-in to SYSTAP’s industry leading, open-source graph database platform, Blazegraph™. Mapgraph™ Accelerator marries the speed of GPUs with familiar Java APIs and standardized query languages. It will provide the world’s first and best platform for building graph applications with GPU-acceleration. It will bridge the gap between the Blazegraph™ database platform and the GPU acceleration for graph analytics. Users of the Blazegraph™ platform will be able to leverage GPU-accelerated graph analytics via a Java Native Interface (JNI) and via predicates in SPARQL query. Mapgraph™ HPC is the application of the technology to GPU clusters where it can traverse 100 billion edge graphs in sub-second times.
How does MapGraph process data so quickly? It relies on three approaches working together. First, it uses parallel processing. Instead of six or eighteen computer cores processing data at one time, it uses 32,000 cores within each GPU and multiple GPUs. Second, the data is partitioned. Instead of processing every piece of data every time, the data is chunked out like a graph, so the system knows not to process the same data repeatedly. Finally, MapGraph scales to large clusters of GPUs for huge problems. It optimizes the communications between the GPUs using “overlapping communication” patterns. If the communication was not optimized, communicating across all those cores would consume much of the processing power of the system.
Companies from many fields need faster processing of big, graph data. Until now, it would be prohibitively expensive for most companies to pay for that processing power. Companies might spend over a million dollars on hardware just to get started. MapGraph brings that investment down by an order of magnitude to $100-200k. Now Platform as a Service (PaaS) providers such as Amazon Web Services, SYSTAP is looking at ways people could rent space on a shared system with a product called MapGraph HPC™. Customers will be able to rent space on a shared system for high performance graph analytics. The low cost and ease of use opens new markets. It enables non-traditional applications of HPC techniques and graph analytics.
“We are building software solutions for big graphs that are accessible to a full range of businesses from very large scale HPC clusters to on-demand SaaS customers. We are now accepting requests for beta customers of our Mapgraph™ technology. What is your graph data waiting for?” remarks Bebee.
--
SYSTAP, LLC is a software company focused on Big Graphs with open source and commercial software solutions. Its first product, Blazegraph™, is an ultra high-performance graph database. Its new products, MapGraph Accelerator™ and MapGraph HPC™, use the new disruptive technology of GPUs to accelerate data-parallel graph analytics.
Brad Bebee, Systap, http://www.mapgraph.com, +1 202-642-7961, [email protected]
Share this article