473,663 Members | 2,738 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Fastest method to copy a file across network?

I work with databases and some of my backup files are 30-100 gigs in
size. I currently use the FastCopy utility to copy files from one
server to another. (This is needed when I need to transfer a DB to a
different server). FastCopy says its 30 to 50% faster than Windows
file copy. I read somewhere that the windows kernel defaults to
4mb/sec throughput for copying.

Is this true? Is there a faster way or some utility to copy files?
I'm aware of RoboCopy but the documentation didn't mention anything
about faster performance. All my servers are windows 2000 NTFS.
Thanks

Jul 23 '05 #1
3 3891
On 13 Dec 2004 12:16:50 -0800, louis n wrote:
I work with databases and some of my backup files are 30-100 gigs in
size. I currently use the FastCopy utility to copy files from one
server to another. (This is needed when I need to transfer a DB to a
different server). FastCopy says its 30 to 50% faster than Windows
file copy. I read somewhere that the windows kernel defaults to
4mb/sec throughput for copying.

Is this true? Is there a faster way or some utility to copy files?
I'm aware of RoboCopy but the documentation didn't mention anything
about faster performance. All my servers are windows 2000 NTFS.
Thanks


Very often in my experience, ftp or http is significantly faster than any
high-latency network filesystem protocol like Windows.
Jul 23 '05 #2
I'd suggest looking at your network and not SQL as a starting point.
You may have the servers on seperate hubs with a shared 10mbps
connection when a dedicated 100mbps connection (possibly also the same
hub) would make a difference. It depends on the setup you have. It may
be a simple swap in your comms room for you. After these basic checks,
I'd then look to utilities to speed this up. At the end of the day,
it's the same bandwidth and same size of data so I can't see them being
vastly better unless using less intensive protocols (FTP may be quicker
for example).

louis n wrote:
I work with databases and some of my backup files are 30-100 gigs in
size. I currently use the FastCopy utility to copy files from one
server to another. (This is needed when I need to transfer a DB to a
different server). FastCopy says its 30 to 50% faster than Windows
file copy. I read somewhere that the windows kernel defaults to
4mb/sec throughput for copying.

Is this true? Is there a faster way or some utility to copy files?
I'm aware of RoboCopy but the documentation didn't mention anything
about faster performance. All my servers are windows 2000 NTFS.
Thanks


Jul 23 '05 #3
Hi Ross,

I set up a FTP site at the destination server and sent a 40gig file.
It completed within 2 hours, and is dramatically faster than what I
experienced before. Thanks for the tip. I don't know why I didn't
think of it before. Maybe I was brainwashed by windows ;)

Jul 23 '05 #4

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

4
4938
by: Joker | last post by:
How to copy a jpg file on from local computer to remote server on the basis of PHP code?
1
1565
by: Burt | last post by:
My company needs to move a 30 Gig SQL Server across the country as soon as possble on July 1. Turns out moving the full db across the network takes a few hours. I'd like to move a full copy of db a week ahead of time, and then just move either a differential backup(s) or transaction log with with the week's new data on July 1. Can anyone suggest the best strategy for doing this? Currently we're doing a differential backup each hour on...
60
49063
by: Julie | last post by:
What is the *fastest* way in .NET to search large on-disk text files (100+ MB) for a given string. The files are unindexed and unsorted, and for the purposes of my immediate requirements, can't be indexed/sorted. I don't want to load the entire file into physical memory, memory-mapped files are ok (and preferred). Speed/performance is a requirement -- the target is to locate the string in 10 seconds or less for a 100 MB file. The...
3
15985
by: Divya | last post by:
Hello, I am trying to copy a file from one domain to another. I have the username and password of the destination domain. I tried a few approaches - 1. Using the Impersonator Class - http://www.codeproject.com/useritems/ZetaImpersonator.asp 2. Using WebRequest object to write the file to the destination domain - http://www.dotnet247.com/247reference/msgs/42/211482.aspx
4
2639
by: Brian Hanson | last post by:
Hi, I have a problem that is sporadic and am thinking it may come down to a timing issue. I have an asp.net (vb) app that used the system.io.file.copy method to copy a .pdf file from a network drive to the local server drive. From there I use that .pdf file to create another .pdf file using a tool from ActivePDF. The problem I have is that one out of 8 or 10 times I get an error: Access to the path "c:\ActivePDF\watever.pdf" is...
3
16997
by: =?Utf-8?B?U2Vhbk1hYw==?= | last post by:
How do I programmatically copy files across a network (from a local workstation to another local workstation on the network) using visual basic 2005? In other words, when in explorer and you enter a unc path to a network workstation, you are prompted with a dialog box asking for the user name and password that has access rights to that computer. After validating, you can access the files on the remote pc just like you can on your own pc,...
1
3882
by: =?Utf-8?B?UVNJRGV2ZWxvcGVy?= | last post by:
Using .NET 2.0 is it more efficient to copy files to a single folder versus spreading them across multiple folders. For instance if we have 100,000 files to be copied, Do we copy all of them to a single folder called 'All Files' Do we spread them out and copy them to multiple folders like Folder 000 - Copy files from 0 to 1000 Folder 001 - Copy files from 1000 to 2000 Folder 002 - Copy files from 2000 to 2999
3
2779
by: Mohamed Yousef | last post by:
Thanks all , but there is still something i forget to state -sorry - all communication will be via Http with a server so data is received via Http so local network solutions won't work the problem really starts after receiving data in storing them without much of a CPU/Memory usage and with a good speed @James Mills : didn't understand fully what you mean and how it will improve writting effciency
7
11049
by: mirandacascade | last post by:
The questions are toward the bottom of this post. Situation is this: 1) Access 97 2) Multi-user appplication 3) SQL Server 2000 4) Sporadically (i.e. less than 1% of the time) encounter the following error: 3218 Couldn't update; currently locked
0
8858
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
0
8771
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...
0
8634
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
0
7371
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing, and deployment—without human intervention. Imagine an AI that can take a project description, break it down, write the code, debug it, and then launch it, all on its own.... Now, this would greatly impact the work of software developers. The idea...
1
6186
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
5657
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
1
2763
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
2
2000
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.
2
1757
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.