473,326 Members | 2,095 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,326 software developers and data experts.

Hitting a file limit while transferring data

23
Hi,

I have a situation I am trying to transfer data from hard drive to USB hard drive and am having an issue that relates to the amount of files per directory. System doesn't seem to like any more than (roughly) 23000 files in a single directory.

To explain a bit more, I have a non-networked PC - Windows XP SP2 - that runs software which is constantly writing small files - which it's supposed to do - and due to this constant writing, the hard drive is filling up frequently. At this point, I'll usually use an external hard drive to transfer data to a networked PC which I can then transfer data to a server for later analysis.

The problem I have now is that when transferring from PC to USB hard drive, if a folder contains more than (roughly) 23000 files, it then gives an error and I have to create a second folder with a similar name and transfer the remaining files from the folder, assuming it doesn't have anymore than 23000 remaining. Sometimes folders are reaching 70000 which means I have to do this more than once. It also means I spend A LOT of time, and can't just set it up in the morning to transfer then leave it running during my working day. Not a great use of my time!

Restrictions I have are, can't afford expensive software for copying data and not allowed the PC networked. So really I think I'm looking for some sort of work around that allows more than 23000 files per directory when transferring, perhaps a command line solution which works where GUI drag and drop doesn't.

Any help is appreciated.
Nov 8 '11 #1
0 1307

Sign in to post your reply or Sign up for a free account.

Similar topics

1
by: r_burgess | last post by:
I am looking for some guidance on transferring data between two pages in my ASP.net Web app (intranet). I have a form that will have a button and a text box on it (among other controls of course)...
3
by: phong.lee | last post by:
Hello all, i'm new at this. I need some assistant in transferring data from excel to access. I created a macro that basically gather all the necessary data that i need to bring into access. I...
15
by: http://www.visual-basic-data-mining.net/forum | last post by:
Does anyone have any idea how to transferring data from TextBox1 in form1 to textBox2 in form2..... That means after i fill in any data in textBox1 and click Next button... It will bring me to...
5
by: Chad A. Beckner | last post by:
Hi, I am developing an application and need to make it so the application data is stored in some manner. I am thinking of an XML file as the data source. I would like to setup 2 way data...
22
by: David Warner | last post by:
Greetings! I am working on a C app that needs to read print files generated by lp that contain HP LaserJet PCL codes. If the PCL contains binary data to define a bit map to be printed on the...
13
by: princei2007 | last post by:
hi, iam just a beginner with php and curl.i search a lot but not able to find out the find out the problem i am gating. I am first sending data to a php a file then using CURL on the php file iam...
2
hsriat
by: hsriat | last post by:
I have a page working on Ajax. The problem is, after doing many changes using Ajax (like uploading, changing name, adding to favorites etc), the status bar starts behaving unexpectedly. Even when...
0
by: Desmodromic | last post by:
I have two linux servers running DB2 v8.2 with SQL replication. I recently started a full refresh of a single subscription set via the Replication Center GUI. This was successful, but seemed to...
3
by: angusfreefa | last post by:
Dear All, I am facing a problem of transferring data between 2 tables within the same database. I set up 2 tables. The first table is the permanent table (oos_table) for saving records. the...
35
computerfox
by: computerfox | last post by:
I'm writing a work order system using PHP and MySQL and I'm stuck on two things-transferring data and updating the data. Here is my code: i'm using checklogin.php to do most of everything so...
0
by: ryjfgjl | last post by:
ExcelToDatabase: batch import excel into database automatically...
0
by: Vimpel783 | last post by:
Hello! Guys, I found this code on the Internet, but I need to modify it a little. It works well, the problem is this: Data is sent from only one cell, in this case B5, but it is necessary that data...
0
by: jfyes | last post by:
As a hardware engineer, after seeing that CEIWEI recently released a new tool for Modbus RTU Over TCP/UDP filtering and monitoring, I actively went to its official website to take a look. It turned...
0
by: ArrayDB | last post by:
The error message I've encountered is; ERROR:root:Error generating model response: exception: access violation writing 0x0000000000005140, which seems to be indicative of an access violation...
1
by: PapaRatzi | last post by:
Hello, I am teaching myself MS Access forms design and Visual Basic. I've created a table to capture a list of Top 30 singles and forms to capture new entries. The final step is a form (unbound)...
1
by: CloudSolutions | last post by:
Introduction: For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...
1
by: Defcon1945 | last post by:
I'm trying to learn Python using Pycharm but import shutil doesn't work
0
by: af34tf | last post by:
Hi Guys, I have a domain whose name is BytesLimited.com, and I want to sell it. Does anyone know about platforms that allow me to list my domain in auction for free. Thank you
0
by: Faith0G | last post by:
I am starting a new it consulting business and it's been a while since I setup a new website. Is wordpress still the best web based software for hosting a 5 page website? The webpages will be...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.