Scientel Gensonix Super DB Reaches Ability To Process Exabytes of Data in Real-Time And Beyond
NOVI, Mich. (PRWEB) April 25, 2018 -- Big data has created many challenges for many organizations. As technology is advancing fast, new varieties of data are being generated at an unbelievable pace. Today, we generate more data in 1 day than we generated between 1946 (start of computing) through year 2000 combined. While no one processes all of this data in a single location, we certainly know that the new types of applications will demand systems that are capable of processing an exorbitant amount of data in real-time.
Scientel (R) understood this phenomenon way before and created its Gensonix(R) NewSQL Super DB for HPC systems and Supercomputers to process these types of Big Data fast. Gensonix is now capable of processing more than an Exabyte of data in real-time, and we examine how.
To be clear here, 1 Exabyte of data (1,000,000,000,000,000,000) is 1 Billion Gigabytes or 1 Million Terabytes of data. No doubt, few systems have the ability to process 1 petabyte of data which is 1000 Terabytes. However reaching a million Terabytes creates many challenges at different levels. First, in order to process this data, we have to have a way of storing and managing this data.
Scientel’s answer to this issue is its Super DB which can scale to very large number of nodes for massively parallel processing. Scientel Gensonix Super DB has already demonstrated super scaling to 16,800 DB nodes on the Ohio State OSC Supercomputer system. It should also be noted that on larger systems, Gensonix can scale to over 100,000 parallel nodes.
Scientel offers 2 methods to process large data sets where the difference is in the number of nodes deployed vs. the DB node size itself. For example, if we are dealing with a data set with a record size of 2KB and each DB node with a distribution of 100 Billion records, a 10,000 node Gensonix super DB system will be able to process this database in real-time which exceeds 2 Exabytes (2KB X 100B X 10,000). Notice that in this example, each DB node is processing 200 TB each. For systems that have ample capacity, this model can be scaled to 100,000 DB nodes, in which case each node is only processing a mere 10B rows or 20TB and the total data set would be reached as 2KB X 10B X 100,000. In this case, the results can be delivered up to 10 times faster. Likewise on systems with smaller hardware capabilities, it is also possible to reduce the number of cores, in which case, the processing time will increase with less nodes having to process more data per node.
It is important to note that processing this amount of data is no light task for any sized system, and even for Gensonix. When considering this level of task, Gensonix can make this claim not mainly because it can address this data which many systems simply fail to do, and which is so fundamental to this process, Gensonix efficient processing is what makes this even possible.
First, Gensonix owes its credit to the ultra-flexible and ultra-procedural, very high level language called NSQL®. NSQL makes it a dream to manage and process this level of complexity and without NSQL, this type of process would be virtually impossible.
Secondly, Gensonix owes its credit to a technique introduced by Scientel called multi-modeling. Multi-modeling is where different types of data stores are utilized in a single DB to store different types of data such as structured and unstructured. Gensonix does not store structured data in document stores or unstructured data in tables. Gensonix can process numeric and analytical data in relational like tables maintaining referential integrity adhering to third normal form. These capabilities allow Gensonix to store all varieties of data in their native form without having to convert from integer to string and vice versa like in other NoSQL DBs. This ensures the highest level of storage efficiency as well as extremely fast processing speeds.
When these capabilities are combined together with massively parallel processing, especially on Supercomputers, the result is a DB with the capability that outperforms many other models that exists today.
About Scientel Information Technology, Inc.
Scientel Information Technology, Inc. is a U.S.-based, international, systems technology company, operational since 1977. Scientel also designs/produces highly optimized high end servers, which can be bundled with its "GENSONIX® ENTERPRISE" DBMS software, as a single-source supplier of complete systems for Big Data environments. Scientel also customizes hardware and software for specific applications resulting in higher performance.
Scientel's specialty is advanced NoSQL DBMS design and applications/systems integration for advanced business processes. This includes applications for Big Data, commercial intranets, Supply Chain management, IT consulting, support, etc., along with “beyond mainframe-level” Large Data Warehouse Appliance hardware/systems.
GENSONIX® allows very user-friendly data manipulation capabilities found in standard, SQL-based, database management systems, but it goes beyond. It is truly an "ALL-in-One SQL" -- an “All Data Management System” in the form of an ultra-flexible, NoSQL DBMS of perfectly general capabilities and application potentials. It can also function in concert with mainline SQL systems to efficiently handle both structured and unstructured data as a large data warehouse repository. However, it can handle heavy database loads by itself with the aid of the GENSONIX® NSQL©™ query/procedural language. GENSONIX® supports both telnet as well as http interfaces. GENSONIX® is capable of handling trillions of rows/transactions for billions of customers, which is a huge advantage in “truly Big Data” structured applications.
Business customers can take advantage of Scientel’s capabilities in advanced Business Intelligence and Data Analytics to grow their business by handling Big Data more cost-effectively and with greater insights to remain competitive. Scientific, government, and similar organizations can use these capabilities to efficiently process Big Data, instead of being swamped by it. And, Scientel’s Enterprise Content Management & Search solutions can vastly simplify storage, access, and management of any kind of digitized data for any size organization.
Norman Kutemperor, Scientel, http://www.scientel.com, 248-433-4700 Ext: 15, [email protected]
Share this article