Parsing Text File and storing unique words

[DCDeshpande]

Hi,

I am new to Java and need to parse a simple txt file into unique tokens and store them in a data structure. Can someone please recommend the most efficient way to do this?

I found out that StringTokenizer class can be used for parsing the text. I need to know the most efficient dynamic data structure available in Java to store the words and allow me to lookup words already in the list before adding new ones.

Thanks,

DCD

[BigDaddyLH]

Most likely, your data structure is a Set or a Map. You'll need to describe it better.

Here is Sun's tutorial on the Collections Framework:

Colections

[BigDaddyLH]

Demo:

import java.util.*;
 
public class SetDemo {
    public static void main(String[] args) {
        String[] data = {"some", "sample", "data", "some", "more", "done"};
        Set<String> words = new TreeSet<String>(Arrays.asList(data));
        System.out.println(words);
        //output: [data, done, more, sample, some]
    }
}