Extract URLs from search engine results

[Nikkhah]

I want to write a program in java that it can parse search engine results and save URLs and titles in a file, but I don't know how can I do this?

[jkmyoung]

You probably want to look up HTTPRequest and Regular Expressions.

eg something like:
<a href=".*{url}">.*{title}</a>

[Nikkhah]

@jkmyoung
Do you know what instructions do I use?

[jkmyoung]

? What task are you specifically referring to?

If you haven't already, break your problem into steps. It's easier to help with one step at a time then all of them at once.

[Nikkhah]

@jkmyoung
I want to connect to google and save URLs. what do I do?

[Nikkhah]

I find a sample code that extract links from an html page. now how can I save html source of search results?

[jkmyoung]

Here's a quick example from Sun's website:
http://74.125.113.132/search?q=cache...&ct=clnk&gl=ca

    public static void main(String[] args) throws Exception {
        URL url = new URL("http://www.google.com/");
        URLConnection urlc = url .openConnection();
        BufferedReader in = new BufferedReader(
                new InputStreamReader(
                        urlc.getInputStream()));
        String inputLine;
 
        while ((inputLine = in.readLine()) != null) 
            System.out.println(inputLine);
        in.close();
    }
 

It's pretty easy to find with google.

Try modifying it to meet your needs, and come back if you have a problem.