Parsing Text File and storing unique words

DCDeshpande

Hi,

I am new to Java and need to parse a simple txt file into unique tokens and store them in a data structure. Can someone please recommend the most efficient way to do this?

I found out that StringTokenizer class can be used for parsing the text. I need to know the most efficient dynamic data structure available in Java to store the words and allow me to lookup words already in the list before adding new ones.

Thanks,

DCD

BigDaddyLH

Most likely, your data structure is a Set or a Map. You'll need to describe it better.

Here is Sun's tutorial on the Collections Framework:

Colections

BigDaddyLH

Demo:

Expand|Select|Wrap|Line Numbers

 import java.util.*;
 
public class SetDemo {

    public static void main(String[] args) {

        String[] data = {"some", "sample", "data", "some", "more", "done"};

        Set<String> words = new TreeSet<String>(Arrays.asList(data));

        System.out.println(words);

        //output: [data, done, more, sample, some]

    }

}

Parsing Text File and storing unique words

Post your reply

Similar topics