473,897 Members | 3,321 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Hyperconverged All-in-One Streaming Engine, ushering in new age for distributed database

26 New Member
Ⅰ. Advantage of AntDB: hyper-convergence + streaming processing engine
In the overall architecture, a new "hyper-convergence" concept was proposed, which integrated multiple engines and capabilities to meet the increasingly complex mixed load scenarios and business needs of mixed data type for enterprises.
At the mean time, to support users’ increasingly demanding requirements, through the cloud-native "stream processing engine", stream computing and database are integrated and innovated from the kernel level, meeting the needs of real-time business analysis, real-time reporting and other types of asynchronous transaction scenarios such as Internet+.

Figure 1: Hyper-convergence architecture of AntDB
In our point of view, HTAP, lake/warehouse integration and stream/batch integration are only transitional products on the evolution of database. The future database will put “data” at its core and integrate with various business data to meet IT systems and industrial data in China.

Ⅱ. Integration of five application requirements
Traditional transaction and analysis, streaming processing, time-series and memory computing

The current application demands of users for data mainly lie in five aspects: traditional transaction, analysis, big data mining, high-performance memory computing and real-time streaming data processing. These five aspects are carried separately by different technology stacks. HTAP is attempting to integrate transactions and analyses while AntDB aims to bring the five types of data services under a unified technical framework, making one product a "one-stop service" for users.

Figure 2: Integration of five data application requirements
The hyper-convergence framework of database proposed by AntDB V7.2 can make full use of the architectural advantages of distributed database engines and further expand on the concept of HTAP to encapsulate multiple engines such as time-series storage, stream processing execution and vectorized analysis in a unified architecture. Supporting multiple business models in the same database cluster greatly reduces the complexity of supporting diverse data requirements for business systems and brings convenience to application developers as well as DBAs and architects.
Ⅲ. Born to change
AntDB’s new-generation streaming processing engine
If the hyper-convergence framework is the basic architecture of database and does not solve a specific type of scenario problem, then AntDB-S streaming data engine of AntDB V7.2 completely overturns the design and development model of real-time computing applications.

The problems of difficult development and high cost of streaming business affect the rapid promotion and implementation of streaming computing in actual production. For developers, whether it is Apache Storm, Spark Streaming, or Flink and other mainstream stream processing framework design, all focus on the "processing " itself. Since they do not have database capabilities, they require complex data extraction when they need to interact with other data for correlation and temporary storage,and manual processing operations is required inside the stream processing engine via Java/Scala program code.

After more than ten years of practical experience in core business scenarios of operators, AntDB found that some business scenarios cannot be realized by traditional technology and need real-time processing capabilities such as streaming computing to support.

Therefore, AntDB has done a lot of innovative explorations and researches from scratch to integrate stream computing into the database kernel. Users can freely define the structure of data and real-time processing logic through standard SQL under the framework of one database engine; meanwhile, data can flow freely between stream objects and table objects inside the database; users can conduct performance optimization, data processing, cluster monitoring and business logic customization of data by establishing indexes, stream-table association, triggers, materialized views, etc. at any time.

Figure3: AntDB’s streaming processing scenario
Under AntDB's all-in-one streaming engine mechanism, developers can get rid of the complexity of real-time business development and do not need to use Java/Scala code to define data processing logic; and for operation and maintenance personnel, they can achieve the goal of "one product to meet multiple data processing types", which greatly reduces the complexity of the overall technical framework, and the security stability and development efficiency of the system are improved.
Ⅳ. Forged for the future
Stepping into the new age of evolutional distributed database
AntDB database is a product born in a special scenario, which has experienced 15 years of polishing in the core scenario of operators, and in the process of continuous iteration and upgrading of China's communication technology and Internet technology, it has been cultivating its skills in the core transaction scenario of ultra-high frequency and high density in the communication industry, and solving the demand problems that international brand databases can hardly cope with.

As a representative of domestic database, AntDB is also shouldering the mission of information technology innovation, from behind the scenes to the front stage, through its inherent security, stability and foresight to future application scenarios and cutting-edge technologies, we can see that domestic database will march to a very promising new era and blaze a database development trail of its own.
May 24 '23 #1
0 9176

Sign in to post your reply or Sign up for a free account.

Similar topics

by: channa_s | last post by:
Hi, I would be very grateful if anyone could help me with the following. I want to create a SIMPLE distributed database. It is as follows: There is a institution which has branches all over the country offering
by: J Goldman | last post by:
I'm looking for documentation pointers to learn what I need to put together a distributed database system. I've read through "Oracle 9i Database Administrator's Guide: Distributed Database Concepts" and Oracle Database Concepts: Introduction to the Oracle Server: Distributed Databases Overview", but I don't see how to do what I want. I would like to set up a distributed database system with location transparency and a shared schema...
by: Evan Smith | last post by:
Years ago I worked on a system which I believe was one of the first instances of EEE being used in an OLTP environment. It was fraught with lots of gotchas, but overall was made to work. This was in the version 5 days. I have only used EEE for DSS since that time. Now that EEE has been replaced by ESE in version 8, I am wondering how many advances have been made for its use as an OLTP database. I browsed the IBM sites with their sales...
by: thunder | last post by:
Hey! Suggest me. What are needed to creat a distributed database library. Protocol,design,and implementation,etc... I am a master thesis student.
by: sakinam | last post by:
i want to create a distributed database for a property selling agent. i need some feedback on how to go about it n which is d best database platform to use. d firm has three branches in different cities nation wide. need feedback urgently tc
by: nicky123 | last post by:
A distributed database is a specialization of distributed computing. A distributed database allows certain data specific operations to be distributed to one or more different machines. This means that the decision to perform an operation occurs on one machine and then one or more other machines end up performing the operation. Distributed database operations include searching, updating, and deleting data. Distributed computing operations can be...
by: lucoin | last post by:
I have a project to build a distributed database for an organization which run to branches located in Sydney and Melbourne. Sydney office is considered as the head office and Sydney branch office as well. now I have some tables in Sydney head office like CUSTOMER,ORDERS,ORDERLINE,SALESPERSON,PRODUCT, AND SUPPLIER. so how can I fragment to the branches. PS: I am a beginner to oracle, I am not sure if I ask the right question. In learning...
by: antdb | last post by:
On December 28, the special session for databases of “Full-Stack Empowerment Through Digital Intelligence" - AsiaInfo 2022 Series Product Launch Event was held online. It is worth noting that AsiaInfo has released the AntDB V7.2 database with "hyper converged integrated streaming engine", and has shared how the database has been applied in communication, transportation and other industries. Nowadays various industries are undergoing the...
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.