Writing into a file in chunks

[perl123]

Hi there,

I need to reduce the time while writing into a file as i have more than 300K records to write -currently it takes more than 4 hrs as we write one record after record now.

We have a module that creates file using perl
This is what we currently do
1. read all the rows of a table and write them in a hash variable (key = primary key and value, the entire row)
This is done after validating every field and concatenating it and storing it as a value for the key)
2. We write each and every key value pair into a file and finally create the file

So, is there a way to keep writing every 1000 records at one shot so that I/O is reduced

Thanks,
Sasi

[eWish]

Are you retrieving this data from a database and saving to a file? Can you provide a sample of the code you are using?

[KevinADC]

for (1 .. 1000) {
   do something
}