how to retrieve data from given websites

[Yoshitha]

Hi

I want to Extracet(retrieve) data from some of websites and the retrieved
data has to be saved in excel or.csv files.
I need to develop this in ASP.net(using C#.net Vs 2003).

Can any one tell me the idea of how to get data from websites?

Thanx in advance
Yoshitha

[zEE]

let say u have a website
string url="http://www.hotmail.com";

now u can use MSXML dll

XMLHTTP ObjHttp = new XMLHTTP();
//Connecting to site
ObjHttp.open("post",url,false,null, null);
//Sending parameters (may be u dont required it)
ObjHttp.send("case="+TicketNum");

if (ObjHttp.status.ToString() == "200") //successfull response
{
return ObjHttp.responseText;
}

"ObjHttp.responseText" this will be string having html of the page
u need to parse it using Regex to get ur desired data

Hope it will help u

[Peter Bromberg [C# MVP]]

Yoshitha,
Check the documentation for the WebClient class. This is a simplified
wrapper over HttpWebRequest / Response. It has four basic methods. There's
plenty of good sample code in the MSDN documentation.
Peter

--
Co-founder, Eggheadcafe.com developer portal:
http://www.eggheadcafe.com
UnBlog:
http://petesbloggerama.blogspot.com


"Yoshitha" wrote:

Hi

I want to Extracet(retrieve) data from some of websites and the retrieved
data has to be saved in excel or.csv files.
I need to develop this in ASP.net(using C#.net Vs 2003).

Can any one tell me the idea of how to get data from websites?

Thanx in advance
Yoshitha

[Yoshitha]

hi
is it possible to retrieve data from other websites uing XTerm, XPath
Technology of ASP.net with regular Expressions.

"zEE" <ha*********@gmail.com> wrote in message
news:11**********************@h76g2000cwa.googlegr oups.com...

let say u have a website
string url="http://www.hotmail.com";

now u can use MSXML dll

XMLHTTP ObjHttp = new XMLHTTP();
//Connecting to site
ObjHttp.open("post",url,false,null, null);
//Sending parameters (may be u dont required it)
ObjHttp.send("case="+TicketNum");

if (ObjHttp.status.ToString() == "200") //successfull response
{
return ObjHttp.responseText;
}

"ObjHttp.responseText" this will be string having html of the page
u need to parse it using Regex to get ur desired data

Hope it will help u

[zEE]

all depends on ur needs.. what u really want to achieve from ur desired
website

[Yoshitha]

I need to get contact details of doctors, dentisit and so on from a site.
and the gathered details has to be stored in .xle or .csv file.
i need to gather data from this site
http://www.mydr.com.au/hcp/hcp.asp?mode=Pharmacist
http://www.mydr.com.au/hcp/hcp.asp?mode=Specialist
like wise i have some more urls.
the above links gives you teh search page in that we need to enter some
names for eg(AD) in surname text box and click on search button then it will
display some hyperlnks and when we click on hyperlink it will give contact
details.
and i need to get those details and store them into .xls or csv files.
here i used AD but we need to search with all posible combinations from A to
Z
and need to retrieve contact details of doctors etc.

that is my requirement
i need to achieve this using any method.

one more thing, for exmple if the page contains contact details directly of
all teh doctors and if that page is having paging(page 1,2...) if i want to
get data from all these pages how can be this achieved can you tell me.

REgards
Yoshitha

"zEE" <ha*********@gmail.com> wrote in message
news:11********************@y43g2000cwc.googlegrou ps.com...

all depends on ur needs.. what u really want to achieve from ur desired
website

[Ray Booysen]

mmmm screen scraping. Do you have permission to use the information
you'll be taking from this site?

Yoshitha wrote:

I need to get contact details of doctors, dentisit and so on from a site.
and the gathered details has to be stored in .xle or .csv file.
i need to gather data from this site
http://www.mydr.com.au/hcp/hcp.asp?mode=Pharmacist
http://www.mydr.com.au/hcp/hcp.asp?mode=Specialist
like wise i have some more urls.
the above links gives you teh search page in that we need to enter some
names for eg(AD) in surname text box and click on search button then it will
display some hyperlnks and when we click on hyperlink it will give contact
details.
and i need to get those details and store them into .xls or csv files.
here i used AD but we need to search with all posible combinations from A to
Z
and need to retrieve contact details of doctors etc.

that is my requirement
i need to achieve this using any method.

one more thing, for exmple if the page contains contact details directly of
all teh doctors and if that page is having paging(page 1,2...) if i want to
get data from all these pages how can be this achieved can you tell me.

REgards
Yoshitha

"zEE" <ha*********@gmail.com> wrote in message
news:11********************@y43g2000cwc.googlegrou ps.com...

all depends on ur needs.. what u really want to achieve from ur desired
website

[Yoshitha]

yes we do have permission
we can use either the urls i mentioned or can use yellowpages also
http://www.yellowpages.com.au/search...dingCode=23051
&businessType=dentist&stateId=9.

can you tell me how to get data from yellow pages link?
"Ray Booysen" <rj***********@rjb.za.net> wrote in message
news:#o**************@TK2MSFTNGP03.phx.gbl...

mmmm screen scraping. Do you have permission to use the information
you'll be taking from this site?

Yoshitha wrote:

I need to get contact details of doctors, dentisit and so on from a site. and the gathered details has to be stored in .xle or .csv file.
i need to gather data from this site
http://www.mydr.com.au/hcp/hcp.asp?mode=Pharmacist
http://www.mydr.com.au/hcp/hcp.asp?mode=Specialist
like wise i have some more urls.
the above links gives you teh search page in that we need to enter some
names for eg(AD) in surname text box and click on search button then it will display some hyperlnks and when we click on hyperlink it will give contact details.
and i need to get those details and store them into .xls or csv files.
here i used AD but we need to search with all posible combinations from A to Z
and need to retrieve contact details of doctors etc.

that is my requirement
i need to achieve this using any method.

one more thing, for exmple if the page contains contact details directly of all teh doctors and if that page is having paging(page 1,2...) if i want to get data from all these pages how can be this achieved can you tell me.

REgards
Yoshitha

"zEE" <ha*********@gmail.com> wrote in message
news:11********************@y43g2000cwc.googlegrou ps.com...

all depends on ur needs.. what u really want to achieve from ur desired
website

[Edwin Knoppert]

in VB's myobject you can find urldownloadtofile
Must be present in c# as well imo search..
It's the easiest way.

"Yoshitha" <jy********@nannacomputers.com> schreef in bericht
news:%2****************@TK2MSFTNGP02.phx.gbl...

yes we do have permission
we can use either the urls i mentioned or can use yellowpages also
http://www.yellowpages.com.au/search...dingCode=23051
&businessType=dentist&stateId=9.

can you tell me how to get data from yellow pages link?
"Ray Booysen" <rj***********@rjb.za.net> wrote in message
news:#o**************@TK2MSFTNGP03.phx.gbl...

mmmm screen scraping. Do you have permission to use the information
you'll be taking from this site?

Yoshitha wrote:

> I need to get contact details of doctors, dentisit and so on from a site. > and the gathered details has to be stored in .xle or .csv file.
> i need to gather data from this site
> http://www.mydr.com.au/hcp/hcp.asp?mode=Pharmacist
> http://www.mydr.com.au/hcp/hcp.asp?mode=Specialist
> like wise i have some more urls.
> the above links gives you teh search page in that we need to enter
> some
> names for eg(AD) in surname text box and click on search button then it will > display some hyperlnks and when we click on hyperlink it will give contact > details.
> and i need to get those details and store them into .xls or csv files.
> here i used AD but we need to search with all posible combinations from A to > Z
> and need to retrieve contact details of doctors etc.
>
> that is my requirement
> i need to achieve this using any method.
>
> one more thing, for exmple if the page contains contact details
> directly of > all teh doctors and if that page is having paging(page 1,2...) if i
> want to > get data from all these pages how can be this achieved can you tell me.
>
> REgards
> Yoshitha
>
>
>
>
>
> "zEE" <ha*********@gmail.com> wrote in message
> news:11********************@y43g2000cwc.googlegrou ps.com...
>> all depends on ur needs.. what u really want to achieve from ur
>> desired
>> website
>>
>
>