473,790 Members | 2,629 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Efficient file movement - Faster than drag-and-drop Explorer movem

We just installed a new SAN from Sun and need to migrate several terrabytes
over to it from our Windows servers. We've found that drag-and-drop copying
files using Explorer is going to be very slow and I haven't found any
software designed specifically for the purpose of fast file movement. I
could whip up a simple .Net app to traverse a directory tree, moving each
file to the new drives one-by-one, but would this be any faster than native
Windows GUI file movement? Is there any method that I could use that would
be faster? Thanks for any suggestions, everyone.

Josh Usovsky
Nov 22 '05 #1
2 1550
If not already doing the copy directly on the server (not on a workstation)
could likely be quicker.
I's likely that the bottleneck is just the network speed. Using .NET or the
command line prompt shouldn't make a great difference.

Just try to have the quicker possible path between the source server and the
SAN target... Copying terrabytes takes time...
Patrice

--

"Skwerl" <ju******@anoth erretarded.com> a écrit dans le message de
news:25******** *************** ***********@mic rosoft.com...
We just installed a new SAN from Sun and need to migrate several terrabytes over to it from our Windows servers. We've found that drag-and-drop copying files using Explorer is going to be very slow and I haven't found any
software designed specifically for the purpose of fast file movement. I
could whip up a simple .Net app to traverse a directory tree, moving each
file to the new drives one-by-one, but would this be any faster than native Windows GUI file movement? Is there any method that I could use that would be faster? Thanks for any suggestions, everyone.

Josh Usovsky

Nov 22 '05 #2
You could download a 30 use full blown trial of peersync high volume server.
I think it is www.peersoftware.com. I use the licensed version to copy data
between limited bandwidth and intermittent connections. It works fantastic.
Can set up bandwidth and cpu throttling and many threads. It can be as easy
as clicking start to configuring many aspects. During some testing, the
program copied 22% faster then using drag and drop over a T1.

HTH,
Brian Hammer

"Skwerl" <ju******@anoth erretarded.com> wrote in message
news:25******** *************** ***********@mic rosoft.com...
We just installed a new SAN from Sun and need to migrate several
terrabytes
over to it from our Windows servers. We've found that drag-and-drop
copying
files using Explorer is going to be very slow and I haven't found any
software designed specifically for the purpose of fast file movement. I
could whip up a simple .Net app to traverse a directory tree, moving each
file to the new drives one-by-one, but would this be any faster than
native
Windows GUI file movement? Is there any method that I could use that
would
be faster? Thanks for any suggestions, everyone.

Josh Usovsky

Nov 22 '05 #3

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

21
2448
by: Chris S. | last post by:
I have a number of strings, containing wildcards (e.g. 'abc#e#' where # is anything), which I want to match with a test string (e.g 'abcdef'). What would be the best way for me to store my strings so lookup is as fast as possible?
12
12267
by: Ola Natvig | last post by:
Hi all Does anyone know of a fast way to calculate checksums for a large file. I need a way to generate ETag keys for a webserver, the ETag of large files are not realy nececary, but it would be nice if I could do it. I'm using the python hash function on the dynamic generated strings (like in page content) but on things like images I use the shutil's copyfileobject function and the hash of a fileobject's hash are it's handlers memmory...
7
1836
by: Arpan | last post by:
Microsoft, in one of its "Help & Support" pages on ADO, says that a System DSN is three times faster than a File DSN. I find that a bit odd for the simple reason that won't it be faster for a script to access a file to get info about the database source than access the same info from the registry which will be the case if a System DSN is used instead of a File DSN? I very well know that ultimately a DSN-less connection is the best! I...
8
3825
by: laniik | last post by:
Hi. I am trying to read in a large number of floats from an ASCII file. I am currently using i/o streams as such: vector <float> values; float val; ifstream in(fn); in>>height; in>>width;
5
3868
by: Amar Prakash Tripaithi | last post by:
Hi, Is there exists some function for controlling the cursor movement in C++. With control of cursor movement I mean, is there exists any function that let me to relocate the cursor as per coordinate values given by the user. Amar Prakash Tripathi
15
3659
by: Gan Quan | last post by:
I'm writing a c++ program that has many (100+) threads read/write files simultaneously. It works well if not considering the efficiency. The file i/o seems to be the bottleneck. This is my code to read from and write to files: #include <fstream> #include <sstream> #include <string>
2
2942
by: BurtonBach | last post by:
I have a form with two subforms. Is there a way to control how the Tab key moves between fields? Especially those movement from field to field between subforms for data entry?
0
1394
by: silpa | last post by:
Hi, I am doing a sample VS 2008 project. I have added a dbml file.On the designer,I have dragged a table "emp" from a database "Employee" which is in my server(for example Server1). It created an app.config with connection string as <connectionStrings> <add name="LinQ2008.Properties.Settings.EmployeeConnectionString" connectionString="Data Source=Server1;Initial Catalog=Employee;User...
74
4864
by: copx | last post by:
In "Learning Standard C++ as a New Language" Bjarne Stroustrup claims that properly written C++ outperforms C code. I will just copy his first example here, which is supposed to demonstrate how C++ abstractions do not only make code easier to understand but also make it more efficient: === The simplest specific example I can think of is a program to find the mean and median of a sequence of double precision floating-point numbers read...
11
1931
by: joe | last post by:
Has anyone have any ideas for a possibly more efficient approach to conditionally executing code based on bits being set (to zero)? example attempt: If the particular bit is set to 0, do something (in this case increment a particular output) void foo(int input,int* output) { if( !(input & 1) ) {
0
9666
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look ! Part I. Meaning of...
0
10413
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
0
10200
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth. The Art of Business Website Design Your website is...
1
10145
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows Update option using the Control Panel or Settings app; it automatically checks for updates and installs any it finds, whether you like it or not. For most users, this new feature is actually very convenient. If you want to control the update process,...
1
7530
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
6769
by: conductexam | last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one. At the time of converting from word file to html my equations which are in the word document file was convert into image. Globals.ThisAddIn.Application.ActiveDocument.Select();...
1
4094
by: 6302768590 | last post by:
Hai team i want code for transfer the data from one system to another through IP address by using C# our system has to for every 5mins then we have to update the data what the data is updated we have to send another system
2
3707
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.
3
2909
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.