Hello
I am developing a system for user tracking. In this I am tracking all the
visitors that came to my website. i developed this using a HTTPModule and
storing the data in a SQL Server database. Everything worked fine till my
website gets good traffic.
When website is getting good traffic, this method is slowing down the entire
application. So I am planning to use flat files instead of SQL Server
database. My doubts are
1 - What is a flat file and how can I connect to it from my ASP.NET
application
2 - If multiple users are browsing website at same time, how can I save
data's to file, because that may be in use.
3 - Is XML files are normal flat files ?
Please help me on this issue.
Sincerly
Navaneeth
9  1886 
On 30 , 10:06, Navaneeth.K.N
<Navaneeth....@ discussions.mic rosoft.comwrote :
Hello
I am developing a system for user tracking. In this I am tracking all the
visitors that came to my website. i developed this using a HTTPModule and
storing the data in a SQL Server database. Everything worked fine till my
website gets good traffic.
When website is getting good traffic, this method is slowing down the entire
application. So I am planning to use flat files instead of SQL Server
database. My doubts are
1 - What is a flat file and how can I connect to it from my ASP.NET
application
2 - If multiple users are browsing website at same time, how can I save
data's to file, because that may be in use.
3 - Is XML files are normal flat files ?
Please help me on this issue.
Sincerly
Navaneeth
I have a doubt whether saving data to a file on the hard drive is
faster then saving data in the database. Not to mention the speed of
processing these data.
Regards,
Mykola http://marss.co.ua
I suggest you stick with a database. Flat files will almost certainly not
give you additional speed or scalability.
Perhaps you could use some sort of a queue to save up log records and only
write to the database every so often.
--
I hope this helps,
Steve C. Orr,
MCSD, MVP, CSM, ASPInsider http://SteveOrr.net
"Navaneeth. K.N" <Na***********@ discussions.mic rosoft.comwrote in message
news:B9******** *************** ***********@mic rosoft.com...
Hello
I am developing a system for user tracking. In this I am tracking all the
visitors that came to my website. i developed this using a HTTPModule and
storing the data in a SQL Server database. Everything worked fine till my
website gets good traffic.
When website is getting good traffic, this method is slowing down the
entire
application. So I am planning to use flat files instead of SQL Server
database. My doubts are
1 - What is a flat file and how can I connect to it from my ASP.NET
application
2 - If multiple users are browsing website at same time, how can I save
data's to file, because that may be in use.
3 - Is XML files are normal flat files ?
Please help me on this issue.
Sincerly
Navaneeth
Yes, the OP could look into MSMQ, however what levels of traffic are we
talking here? If it isn't extremely heavy I can't understand why SQL would
be causing a bottleneck. I'd look into what is causing the delay before
looking for an alternative solution.
"Steve C. Orr [MCSD, MVP, CSM, ASP Insider]" <St***@Orr.netw rote in
message news:B7******** *************** ***********@mic rosoft.com...
>I suggest you stick with a database. Flat files will almost certainly not
give you additional speed or scalability.
Perhaps you could use some sort of a queue to save up log records and only
write to the database every so often.
--
I hope this helps,
Steve C. Orr,
MCSD, MVP, CSM, ASPInsider
http://SteveOrr.net
"Navaneeth. K.N" <Na***********@ discussions.mic rosoft.comwrote in message
news:B9******** *************** ***********@mic rosoft.com...
>Hello
I am developing a system for user tracking. In this I am tracking all the
visitors that came to my website. i developed this using a HTTPModule and
storing the data in a SQL Server database. Everything worked fine till my
website gets good traffic.
When website is getting good traffic, this method is slowing down the
entire
application. So I am planning to use flat files instead of SQL Server
database. My doubts are
1 - What is a flat file and how can I connect to it from my ASP.NET
application
2 - If multiple users are browsing website at same time, how can I save
data's to file, because that may be in use.
3 - Is XML files are normal flat files ?
Please help me on this issue.
Sincerly
Navaneeth
"Aidy" <ai**@xxnoemail xx.comwrote in message
news:8t******** *************** *******@bt.com. ..
If it isn't extremely heavy I can't understand why SQL would be causing a
bottleneck.
Could be any number of reasons: poor design, no primary key / index,
inefficient use of ADO.NET, not closing connections etc...
--
Mark Rae
ASP.NET MVP http://www.markrae.net
Could be any number of reasons: poor design, no primary key / index,
inefficient use of ADO.NET, not closing connections etc...
That's what I meant, I don't see that it can be SQL Server's fault but
something to do with the design/coding.
BTW, why would not having an index *harm* insert performance? :p
A flat file likely won't help you - ultimately your database does nothing
more than write data to a file. XML is not he right approach either.
You need to either change your approach to tracking data, using perhaps a
hidden iframe in you pages that impacts a second web server instead of your
primary - or look to scale out for load by adding web servers to create a
farm.
Ultimately, a fix is a design decision as your problem could be in the
module rather than he fact that your talking to a database, you could try to
spawn your write activities off to asynchronous threads and see if it
reduces your problems or simply load your data into the application object
and every 1000 requests or so write it to the DB.
Regards
John Timney (MVP) http://www.johntimney.com http://www.johntimney.com/blog
"Navaneeth. K.N" <Na***********@ discussions.mic rosoft.comwrote in message
news:B9******** *************** ***********@mic rosoft.com...
Hello
I am developing a system for user tracking. In this I am tracking all the
visitors that came to my website. i developed this using a HTTPModule and
storing the data in a SQL Server database. Everything worked fine till my
website gets good traffic.
When website is getting good traffic, this method is slowing down the
entire
application. So I am planning to use flat files instead of SQL Server
database. My doubts are
1 - What is a flat file and how can I connect to it from my ASP.NET
application
2 - If multiple users are browsing website at same time, how can I save
data's to file, because that may be in use.
3 - Is XML files are normal flat files ?
Please help me on this issue.
Sincerly
Navaneeth
"Aidy" <ai**@xxnoemail xx.comwrote in message
news:lN******** *************@b t.com...
BTW, why would not having an index *harm* insert performance? :p
:-)
--
Mark Rae
ASP.NET MVP http://www.markrae.net
Hello,
Using Application variables looks like a good solution to me. But what will
be the performance issues where Application variable grows ? And I think I
will loose unsaved data if any server crash happened
Performance clearly depends on how much data you stick in the app object
before you archive it off. You'll need to load test whatever your doing.
You always run the risk of losing data in any application crash before its
written to disk/database. What you need to work out is how many records are
you prepared to lose and make sure your write events minimise the impact.
So if you can only lose 10 records then dont wait until 100 to write to the
database.
Regards
John Timney (MVP) http://www.johntimney.com http://www.johntimney.com/blog
"Navaneeth. K.N" <Na*********@di scussions.micro soft.comwrote in message
news:C2******** *************** ***********@mic rosoft.com...
Hello,
Using Application variables looks like a good solution to me. But what
will
be the performance issues where Application variable grows ? And I think I
will loose unsaved data if any server crash happened
This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics | |
by: hakhan |
last post by:
Hello all,
How can I convert unstructured flat files into structured XML? Are
there any scientific articles and tools that handles this subject?
Bye,
hakhan
|
by: Pierre Maricq |
last post by:
Hi,
I am using Win2000 and Access2000.
I need to build build a macro or write a VBA in Access that would screen all
files contained in a directory on my C drive (files are structrured DAT
files ) and update an Access table with the following
information:
(1) Filename (variable lenght)
(2) Modified File Date/Time
|
by: eddieb7 |
last post by:
Hi,
I am new to visual Studio 2005 C++ and am looking for some directions
on where best to start.
I come from a mainly Delphi background and looking to switch to VS 2005
C++ or C#.
I am looking to write a test utility that would read several Flat Files
and allow me to produce
|
by: new |
last post by:
I have data for each week in a single table. I need to export this data to
a separate flat file for each week.
Any ideas?
DB2 SQL Query export to flat files as a function of data on each record
|
by: anuanusha29 |
last post by:
Hi,
I am kinda new to programming and am in the process of implementing an application which is expected to parse/read data from flat files and display errors to the user about missing/invalid data. It would be required that the application opens the file in any editor(ultra edit) and take the user to that point of the file, which needs correction.
My approach towards getting started with this is
1. come up with an XSD depending on the...
| | |
by: dave32079 |
last post by:
I am moving data from Oracle to MS SQL 2000.
I have been given the Oracle table structures and about 130 CVS files to populate these structures, 1 file per table. I have converted the table structures to a MS SQL format and successfully created the tables but I am having problems creating the DTS package.
I have set the package with Global Variables that allow me to specify which file to send to the given tables (see batch call below). ...
|
by: Stylus Studio |
last post by:
Dear Comp.Text.XML Community,
Attend a webinar event on how to modernize your EDI infrastructure and
exploit XML technologies.
Topic: Exploiting EDI and Flat Files in an XML World
Date & Time: November 1, 2007 at 12 PM EST
Registration Information: http://www.xmlconverters.com/webinars/
What you will learn:
|
by: stephen |
last post by:
I had to use use ssis 2005 in a short project recently & had little
time to work it out. I was importing a whole bunch of flat files into
SQL Server tables with many derived columns and transformations in
between.
It seems to automatically map columns from the flat file to columns in
the sql table where the names of the columns are equal. But can it
also do it automatically on position, so flat file column 1 goes to
sql table colum 1,...
|
by: Tim |
last post by:
Hi Folks,
I'm used to a UNLOAD command that allows me to dump to a named flat
file the results of any SELECT statement. Hence one can build a single
SQL file which contains multiple SQL statements each of which
'unloads' to its own unique file.
unload to 'file1.txt' select * from ......
unload to 'file2.txt' select * from ......
and so on....
|
by: Hystou |
last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it.
First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
|
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth.
The Art of Business Website Design
Your website is...
| | |
by: Hystou |
last post by:
Overview:
Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
|
by: tracyyun |
last post by:
Dear forum friends,
With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
|
by: isladogs |
last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM).
In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules.
He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms.
Adolph will...
|
by: conductexam |
last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one.
At the time of converting from word file to html my equations which are in the word document file was convert into image.
Globals.ThisAddIn.Application.ActiveDocument.Select();...
|
by: TSSRALBI |
last post by:
Hello
I'm a network technician in training and I need your help.
I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs.
The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols.
I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
|
by: adsilva |
last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
| | |
by: muto222 |
last post by:
How can i add a mobile payment intergratation into php mysql website.
| |
