How do you read large text files in Java >20MB

[N002213F]

I have a Java text reader program that can easily read small text, but seems fails to read larger files >20MB. It seems to truncate the contents it reads.

I there a way of making sure all the data is read.

Thanks in advance.

[r035198x]

If you are sure there are no inefficiencies with the code, try using the classes in the nio package. They try to speed up things by using the OS itself.

[N002213F]

Some sample code, hope its helps;

int startPos = "2008-10-15 13:00:00,640 ".length();
BufferedReader br = new BufferedReader(new FileReader("c:\\temp\\test-prices_bulk.log"));
PrintWriter pw = new PrintWriter("c:\\temp\\test-prices_NASDAQ.log");
String line = null;
while ((line = br.readLine()) != null) {
    int endPos = line.indexOf("|");
    if(endPos == -1 || endPos < startPos){
        System.out.println("| not found or occurs earlier that expected.");
        continue;
    }
 
    String contractCode = line.substring(startPos, endPos);
    if(contractCode.indexOf("NASDAQ") != -1){
        pw.println(line);
    }
}
pw.close();
 

[N002213F]

Found the problem, but please promise you won't yell at me. I hadn't closed the PrintWriter.

The maximum file size a Java program can read is dependent on the maximum memory you allocate to it when its starts. ~20MB is fairly small considering the default is 64MB

[r035198x]

Found the problem, but please promise you won't yell at me. I hadn't closed the PrintWriter.

The maximum file size a Java program can read is dependent on the maximum memory you allocate to it when its starts. ~20MB is fairly small considering the default is 64MB

<Yelling>
But your line 17 ...
</Yelling>

[N002213F]

@WideEyed
Surprisingly i added it on the notepad when i was assembling the sample code, there is a lot that occurrs in between and didn't want to include it.

@Aha
I guess i should just stick to the notepad.

[N002199B]

@I_Know_these_guys_from_somewhere
This mistake reminds me of "No Problem"!!

that is the effect of copy and paste sipatha! But nice going.