473,569 Members | 2,526 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Need to make some design decision based on Kafka and Cassandra

1 New Member
In our use case we want to show some charts, metrices and grid based on Kafka topics data.( All Topics are already loaded with Json data from different systems )
We are planning to use Kafka connect and will sync topics data to Cassandra database.
Based on some trigger like any new data in Kafka topic will re-load UI and read same data from Cassandra (Via Dot Net core APIs) and display it on UI.
So is it good idea to use Kafka connect and sync data to Cassandra and query on Cassandra to load UI data Realtime.

Note : Reading data directly from Kafka topics and display on UI using Dot net Kafka consumer is very slow as in our use case we need to query different topics.

Kindly provide suggestions on same.
Dec 1 '20 #1
0 3220

Sign in to post your reply or Sign up for a free account.

Similar topics

7
2351
by: Jack Addington | last post by:
I've got a fairly simple application implementation that over time is going to get a lot bigger. I'm really trying to implement it in a way that will facilitate the growth. I am first writing a WinForms interface and then need to port that to a web app. I am kinda stuck on a design issue and need some suggestions / direction. Basically I...
2
1935
by: David | last post by:
SUMMARY: If you don't want to read all of this, what I'm looking for more or less is ideas on how to implement websites using ASP.NET that have a templated look and feel and many pages that make use of a template design. Hi- I'm new to ASP.NET and have been working for about 2 weeks on learning ASP.NET but it all still seems very murky...
1
945
by: tubby | last post by:
I’m developing an application that will send a lot of data (up to one gigabyte) from a user to a company file server. One of the requirements of the solution is that the user doesn’t have to choose what file to send, all he has to do is press a button to start the upload. One solution is to create client- and server applications that use...
2
1294
by: inquiringMind | last post by:
My academic background is a Master's In Chemistry, and course work in - Undergraduate level classes of Intro C++, Java, Data Structure, Web development using HTML, JavaScript, Perl, JSP Servlets, Software Engineering and - SWEN classes (include a course in UML, a course in Testing, Vaeification, and Validation), Data Base Management...
4
1519
by: Michael A. Covington | last post by:
I'm developing an application that will handle files in groups of 4, namely 3 video files plus a script saying how to put them together. These are all files that I will deliver with the app, so I have complete control over the format and the naming of the files. I will be using DirectShow to read and process the video files. One obvious...
5
1822
by: __PPS__ | last post by:
Hello all, I was working on someone else's code to implement some classes. The task seemed to be simple and I was confident that I won't spent alot of time on that task... But! I've already spent more time to integrade old working code with new design than it would take me to write it all from scratch! so... after having tons of headaches...
6
1575
by: Smithers | last post by:
In consideration of a "Utilities" class that contains methods intended to be used amongst multiple projects... Is there any general consensus on whether such a class should be static? I have traditionally and somewhat thoughtlessly created these sorts of classes as static... but now that I'm refactoring a number of apps written over the...
2
2073
by: thiyaghuck | last post by:
Hi, I need to design a html dashboard in table exactly same as the attached image. Can someone help me. Regards, Thiyaghu CK
0
1523
by: finked1973 | last post by:
Hi All, Does anyone know if it is possible to check the cell colour at runtime and make a decision on it ? I have a DGV that if the time in each cell is past a specific time it will paint the cell a particular color. This ticks through once a minute. It works perfect. The problem lies when I have a cell that is over a certain time I...
3
993
by: lwc0724 | last post by:
I need to pull data based on anything >Date()-2 3:00pm How would I do this to input into a query?
0
7700
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main...
0
7614
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language...
0
7924
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. ...
0
7974
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the...
0
6284
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then...
1
5513
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes...
0
5219
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert...
0
3653
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in...
0
3642
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.