473,789 Members | 2,781 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

How to handle multiple data sources in .NET

Hi,
my existing web application(vb, asp) takes data from
diff sources and populates a sql server which is in turn
used as the data source for the application.

this population of data happens by a nightly process(once
in a day) .

now the requirement is that we need the real data all of
the times . now if i use merging of Data Sets into single
data set. how the Application should handle such big chunk
of data(say in GBs) . what is the optimal solution for
this in .NET ?

ur response will be highly appreciated
Jul 19 '05 #1
1 1866
No, the Solution requires that the SQL Server should be
eliminated and the Application should directly fetch data
from diff sources,keep it in temp store (Data Set) process
it and then display . but how can we justify this approach
as the data is large, what abt memory? Is there any way
out here ? plz suggest.
thanx & regards,
Dinesh.

-----Original Message-----
If the Solution still rquires to consolidate the data in
the SQL Server from where you are reading then You need
to change the Job which is running every night to an
approch where it updates immidiately from other data
sources.
Regards
Rupang
-----Original Message-----
Hi,
my existing web application(vb, asp) takes data from
diff sources and populates a sql server which is in turn
used as the data source for the application.

this population of data happens by a nightly process

(once
in a day) .

now the requirement is that we need the real data all of
the times . now if i use merging of Data Sets into

single
data set. how the Application should handle such big

chunk
of data(say in GBs) . what is the optimal solution for
this in .NET ?

ur response will be highly appreciated
.

.

Jul 19 '05 #2

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

0
1519
by: Shailesh Ratadia | last post by:
The answer to this will largely depend on your source(s). Are these all databases? One approach would be to build a webservice layer which has specific methods to get data from each source and then you can simply make webserive calls from your application. Not sure if this helps but Good luck :-) -Shailesh Ratadia
3
4009
by: Kaveri | last post by:
Currently we use a data adapter and a dataset for fetching data from multiple data source. Once we populate the data from each data source we merge all datasets into a single dataset. Hence if there are 50 data retrieved from 50 different sources, we will have to have 50 adapters and datasets. We need to know if there are any better approach to this solution ?
0
1569
by: Fernando Nasser | last post by:
Multiple database services and multiple versions on Red Hat Linux systems The way it works is that we require a specific service script for each database service (that is listening on each port). Each of these services has a init script in /etc/init.d and a corresponding configuration file in /etc/sysconfig. We use the 'chkconfig' utility to decide if each of those services will be activated on boot or not (it manipulates links under...
3
3859
by: Steve | last post by:
I have a people table of about 25 fields. The table is initially created each year from 5 different sources. The records from each source are appended to the people table. Any person may be in one or multiple sources. For those in multiple sources, the data for a person may not be complete in any source. For example, a person is in three sources; source#2 has the SSN and source#3 has the membership#. For those people who are in multiple...
3
16834
by: lee_mcknight | last post by:
I am using Crystal Enterprise V9. I have a report that needs to have multiple datasets as the datasource(s) on a single subreport (some common lookup data I need to join to is stored in a seperate dataset). The report is working fine with a single dataset as a datasource, but I cannot seem to find any examples of multiple datasets as a datasource. Is this possible? ReportDocument.SetDatasource() seems to only take a single dataset,...
12
3752
by: Aaron Smith | last post by:
What is the best way to handle data in a multiple user environment? We have forms that will allow users to add edit and delete data from a table on SQL server. The data could be edited on multiple machines at the same time. How do you keep the dataset constantly updated with changes made to the data? I'm playing with just calling the fill method, but it seems pretty unstable at times. Especially when deleting records, they don't seem to...
2
302
by: Dinesh | last post by:
Hi, my existing web application(vb,asp) takes data from diff sources and populates a sql server which is in turn used as the data source for the application. this population of data happens by a nightly process(once in a day) . now the requirement is that we need the real data all of the times . now if i use merging of Data Sets into single
6
4649
by: crealesmith | last post by:
Firstly, I have no problem with mail merging to Word, VB code for that works perfectly. On one mail merge I need to merge 15 fields of data that are from 3 seperate records. The 3 records are all in the same table. If I use a control source that is selecting the 3 records, all of the data is shown but spread over 3 pages in the mail merge, but needs to be listed together in one paragraph. Is there anyway of looping through the 3...
3
7101
by: psycho | last post by:
I am working on an N-tier application using following components: 1. Data Access Layer using DLINQ which consists of Data Context class and Table Mapping classes. 2. Business Logic Layer. 3. Presentation Layer (normal ASP.NET pages) The problem is that I have to handle database transactions which can span multiple tables. So where should I place the transaction code. I think I should do it in BLL. But how do I control the transaction at...
0
9666
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
10408
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
0
9983
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
1
7529
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
6769
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
0
5417
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
0
5551
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
1
4092
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
2
3700
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.