i have a very large data stream, on the order of 1.5 million records an
hour (32 bytes per/record), which i would like to try and record to
disk. it doesn't need to be iserted into a db, so flat files or
binaries will probably be the end result. what would be the most
efficient way of acheiving this with c++? the data is arriving via the
internet on a broadband connection 3mbps and the hardware is an
unraided uata-133 with a 1.4ghz athlon and 512mb of ram. if any more
information is needed to base your input on, please let me know. any
help would be greatly appreciated.
many thanks,
lorn
4  1742 
Lorn wrote: i have a very large data stream, on the order of 1.5 million records an
hour (32 bytes per/record), which i would like to try and record to
disk. it doesn't need to be iserted into a db, so flat files or
binaries will probably be the end result. what would be the most
efficient way of acheiving this with c++? the data is arriving via the
internet on a broadband connection 3mbps and the hardware is an
unraided uata-133 with a 1.4ghz athlon and 512mb of ram. if any more
information is needed to base your input on, please let me know. any
help would be greatly appreciated.
many thanks,
lorn
1500000*32 bytes ~= 45.7 MB/hour. This is a slow stream even for
slowest PC that you can find :). I think you can use any method to
store this to disk. I guess it would be efficient enough to buffer the
data and append it to the disk file only once in a while.
ok, thanks for your reply.
assuming a much more aggresive stream. 500-1000MB/hr., is a write
buffer still the most efficient method?
thanks
Lorn wrote: ok, thanks for your reply.
assuming a much more aggresive stream. 500-1000MB/hr., is a write
buffer still the most efficient method?
thanks
Bigger the buffer, the less you would write to disk. But, on power
failure you could loose that buffer. So it's up to you to come with a
number that seems feet to your needs.
Also, you could chose to use a big buffer and flush it to disk ever X
seconds / minutes or when it's full. Maybe this would be efficient for
all the possibilities.
Lorn schreef: ok, thanks for your reply.
assuming a much more aggresive stream. 500-1000MB/hr., is a write
buffer still the most efficient method?
Still no technical challenge, still no C++ subject
(what efficiency? power?battery? CPU? IO bytes/sec?) This thread has been closed and replies have been disabled. Please start a new discussion. Similar topics | |
by: Sugapablo |
last post by:
I had an idea for something that I can't find any evidence if it exists,
or if it can be done. I assume it can be done.
What I'd like to be able to do, is to allow people who come to my website,
click a button on the page to begin submitting an audio stream to the
server.
Basically, once the "record" button was hit by the client, an audio stream
would be generated by the client's microphone and would be sent over port
80 (just like...
|
by: Chris Lasher |
last post by:
Hello,
I have a rather large (100+ MB) FASTA file from which I need to
access records in a random order. The FASTA format is a standard format
for storing molecular biological sequences. Each record contains a
header line for describing the sequence that begins with a '>'
(right-angle bracket) followed by lines that contain the actual
sequence data. Three example FASTA records are below:
>CW127_A01...
|
by: Jussi Rasku |
last post by:
Hello,
I'm working on a small web-script that would allow me to remotely setup
recordings to my tv-tuner (on my linux box). The idea is simple, but I'm
unsure how to accomplish it.
The idea: Using PHP generated www-page user could set mencoder to start
recording at some specified time. The command is put to the crontab
using linux "at" command.
|
by: Dovelet |
last post by:
Hi all,
I would like to write DOS program to change the MS Windows Sound
Recording source. When I run it with the parameter, it will change the
recording source as follow:
C:\> abc.exe microphone <- the Sound recording source change to
Microphone
C:\> abc.exe line <- the sound recording source change to Line-IN
|
by: ACaunter |
last post by:
Hi all,
Have been getting no luck lately, but there must be a way i can recording
audio from the website and save it..
It's no problem on applications (VB.Net), and I know other have done it
before on the Websites - ASP.Net (I think by writing it in C++ or vb6 or
something - and then embeded the object or something... ).
Can anyone explain to me how i can do this, or provide some code if possible??
thanks all
| | |
by: Sakharam Phapale |
last post by:
Hi All,
I am developing an application like sound recorder.
While recording if there is a silence for more than given time (say 5
seconds),
Recording should be paused.
|
by: azdavid |
last post by:
hi
how i am cause the client(client-size) to recording himself and afterward
sending the file(stream) to the server.
how i am doning that in ASP NET??
Thank you
|
by: jer |
last post by:
I've noticed you've helped a lot of people that were trying to do sound
recording through VB.net. I'm searched all over the internet, and I'm
still having problems write sound to a wav file.
My code originate from a VB 6 application, and I'm trying to use vb
2005. I was having a lot of issues until I saw your post that cleaned
up a lot of the structures and DLL calls in this:
...
|
by: fevos |
last post by:
Hi
i want to record voice and send it throw Bluetooth stream , the problem is the recorder accepts only I.O Stream
And write at the 'stream' without using (stream.write),
''using openNETCF
Dim Stream1 As Stream
Stream1 = File.OpenWrite("\My Documents\" & txtFileName.Text & ".wav")
m_Recorder = New OpenNETCF.Media.WaveAudio.Recorder
m_Recorder.RecordFor(Stream1, 5400,OpenNETCF.Media.WaveAudio.SoundFormats.Stereo16bit11kHz) ''...
|
by: marktang |
last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look !
Part I. Meaning of...
|
by: Hystou |
last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it.
First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
| | |
by: Oralloy |
last post by:
Hello folks,
I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>".
The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed.
This is as boiled down as I can make it.
Here is my compilation command:
g++-12 -std=c++20 -Wnarrowing bit_field.cpp
Here is the code in...
|
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth.
The Art of Business Website Design
Your website is...
|
by: agi2029 |
last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own....
Now, this would greatly impact the work of software developers. The idea...
|
by: isladogs |
last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM).
In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules.
He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms.
Adolph will...
|
by: conductexam |
last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one.
At the time of converting from word file to html my equations which are in the word document file was convert into image.
Globals.ThisAddIn.Application.ActiveDocument.Select();...
|
by: adsilva |
last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
| | |
by: muto222 |
last post by:
How can i add a mobile payment intergratation into php mysql website.
| |
