473,327 Members | 1,919 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,327 software developers and data experts.

Transferring a lot of data

I'm using a Remoting to manage small set of data, now the customer wants to
transfer big binary files (up to 10 Gb) between 2 computers.

It's better to use socket or other technology or I can continue using Remoting
without problems with great quantity of data to pass through boundaries.

TIA

--
Inviato da X-Privat.Org - Registrazione gratuita http://www.x-privat.org/join.php
Jun 26 '06 #1
2 1619
Tommaso,

Sockets would probably be better here, since you woul dhave to load 10Gb
of bytes to pass across the remoting boundary, and something tells me you
will have a hard time doing that.

Another option you could use is to have the client send you a Stream
instance back. Since a Stream is derived from MarshalByRefObject, a
reference is passed back, not a serialized instance. The client can pass a
FileStream to you, and then you can call Read, reading chunks from the
stream until it is empty.

This would involve the server issuing a call to the client to perform
the read, and then the client marshaling the byte array back to the server.
It might have a little more overhead, but might be worth what you save in
implementation.

Hope this helps.
--
- Nicholas Paldino [.NET/C# MVP]
- mv*@spam.guard.caspershouse.com

"Tommaso Caldarola" <il********@lcimitero.it> wrote in message
news:44**********@x-privat.org...
I'm using a Remoting to manage small set of data, now the customer wants
to transfer big binary files (up to 10 Gb) between 2 computers.

It's better to use socket or other technology or I can continue using
Remoting without problems with great quantity of data to pass through
boundaries.

TIA

--
Inviato da X-Privat.Org - Registrazione gratuita
http://www.x-privat.org/join.php

Jun 26 '06 #2
It can be done with Remoting, but is a bit difficult to make efficient. The
receiver side will cache all data in RAM, so you can't do very large files
in 1 chunk. So you need to transfer in blocks. That is ok, but then you
also need to make sure your not sending an empty buffer in the request each
time, otherwise you will be transferring 20GB instead of 10GB. There is
ways around that, but me thinks sockets would be better. If you need
security, then also use something like NegotiatedStream in .Net 2.0. You
still want to do it in something like <=500KB blocks so that you can
restart, etc.

--
William Stacey [MVP]

"Tommaso Caldarola" <il********@lcimitero.it> wrote in message
news:44**********@x-privat.org...
| I'm using a Remoting to manage small set of data, now the customer wants
to
| transfer big binary files (up to 10 Gb) between 2 computers.
|
| It's better to use socket or other technology or I can continue using
Remoting
| without problems with great quantity of data to pass through boundaries.
|
| TIA
|
| --
|
|
| Inviato da X-Privat.Org - Registrazione gratuita
http://www.x-privat.org/join.php
Jun 26 '06 #3

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

3
by: phong.lee | last post by:
Hello all, i'm new at this. I need some assistant in transferring data from excel to access. I created a macro that basically gather all the necessary data that i need to bring into access. I...
1
by: Michael Fitzpatrick | last post by:
Transferring arrays from C DLL's to VB.Net I have a DLL written in C. This DLL reads a text file and creates a several very large arrays, 500,000 points and even larger. I would like the get the...
2
by: Rani | last post by:
hi guys I don't know if this is the right place for it but I created 2 pages in page one there is a text box in which the user enters his name, in page 2 there is a the same text box. I would...
15
by: http://www.visual-basic-data-mining.net/forum | last post by:
Does anyone have any idea how to transferring data from TextBox1 in form1 to textBox2 in form2..... That means after i fill in any data in textBox1 and click Next button... It will bring me to...
1
by: Asaf | last post by:
Hi, I am developing a windows forms client application that will send a large XML data to a web server using Web Services. I saw this article http://www.codeproject.com/soap/MTOMWebServices.asp...
2
by: Dino | last post by:
dear all, i got this script form a customer. in general, it recieves data which is send via http to a server and generates a .xml file from this data. because i'm not familar with .asp, i'm...
5
by: meetalps | last post by:
Hi All, Can you please help me with a step by step procedure to transfer files from my PC to DB2-AIX and vice versa. I am new to both. Example transferring a sql file to run from PC to DB2 on AIX....
0
by: Aqib | last post by:
I am working with Client Server Desktop Application which used to run on intranet. I am facing problem of slow speed due to large data (up to 1 GB). I am using Synchronies communication method (as...
3
by: angusfreefa | last post by:
Dear All, I am facing a problem of transferring data between 2 tables within the same database. I set up 2 tables. The first table is the permanent table (oos_table) for saving records. the...
0
by: DolphinDB | last post by:
Tired of spending countless mintues downsampling your data? Look no further! In this article, you’ll learn how to efficiently downsample 6.48 billion high-frequency records to 61 million...
0
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
0
by: jfyes | last post by:
As a hardware engineer, after seeing that CEIWEI recently released a new tool for Modbus RTU Over TCP/UDP filtering and monitoring, I actively went to its official website to take a look. It turned...
0
by: ArrayDB | last post by:
The error message I've encountered is; ERROR:root:Error generating model response: exception: access violation writing 0x0000000000005140, which seems to be indicative of an access violation...
1
by: PapaRatzi | last post by:
Hello, I am teaching myself MS Access forms design and Visual Basic. I've created a table to capture a list of Top 30 singles and forms to capture new entries. The final step is a form (unbound)...
1
by: Defcon1945 | last post by:
I'm trying to learn Python using Pycharm but import shutil doesn't work
1
by: Shællîpôpï 09 | last post by:
If u are using a keypad phone, how do u turn on JavaScript, to access features like WhatsApp, Facebook, Instagram....
0
by: Faith0G | last post by:
I am starting a new it consulting business and it's been a while since I setup a new website. Is wordpress still the best web based software for hosting a 5 page website? The webpages will be...
0
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 3 Apr 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome former...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.