473,395 Members | 1,986 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,395 software developers and data experts.

Screen Scraping Error: (501) Not Implemented

Hi

I am getting a System.Net.WebException -- >The remote server returned
an error: (501) Not Implemented
when I try to read the contents from
http://www.ourcommunity.com.au/membe...s.do?orgId=319
Other urls which I have tried work fine.

I have tried using both WebRequest and WebClient

*****CODE USING WebRequest*******
string result;
WebResponse objResponse;
WebRequest objRequest = System.Net.HttpWebRequest.Create(url);
objResponse = objRequest.GetResponse();
//*** GetResponse() THROWS THE System.Net.WebException ****
using (StreamReader sr = new
StreamReader(objResponse.GetResponseStream()) )
{
result = sr.ReadToEnd();
// Close and clean up the StreamReader
sr.Close();
}
*****CODE USING WebClient*******
WebClient objWebClient = new WebClient();
byte[] aRequestedHTML;
aRequestedHTML = objWebClient.DownloadData(url);
//*** DownloadData() THROWS THE System.Net.WebException *******
UTF8Encoding objUTF8 = new UTF8Encoding();
string strRequestedHTML;
strRequestedHTML = objUTF8.GetString(aRequestedHTML);
result = strRequestedHTML;

Pretty much stuck here and not sure if there is any other way to get
the page content. Anyone knows of how I could bet the content from
http://www.ourcommunity.com.au/membe...s.do?orgId=319
Any help would be greatly appreciated

Feb 13 '07 #1
0 1415

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

4
by: Roland Hall | last post by:
Am I correct in assuming screen scraping is just the response text sent to the browser? If so, would that mean that this could not be screen scraped? function moi() { var tag = '<a href='; var...
3
by: Jim Giblin | last post by:
I need to scrape specific information from another website, specifically the prices of precious metals from several different vendors. While I will credit the vendors as the data source, I do not...
14
by: n8 | last post by:
Hi, Hi have to do the followign and have been racking my brain with various solutions that have had no so great results. I want to use the System.Net.WebClient to submit data to a form (log a...
3
by: maria.s | last post by:
Hi, I try to create a calender-item in the personal calendar folder from an ASP.NET application using XML-HTTP Request (WebDAV). System: Windows 2003 SP1, Exchange 2003 SP1 Configuration...
4
by: onetitfemme | last post by:
Say, people would like to log into their hotmail, yahoo and gmail accounts and "keep an eye" on some text/part of a site .. I think something like that should be out there, since not all sites...
9
by: Knoxy | last post by:
Hi guys, I've got this working but I have issues when there is any kind of c# coding on the page that I'm trying to scrape (pages within my site - its for a print page view basically), I get this...
2
by: aferriere | last post by:
Hi I am getting a System.Net.WebException -- >The remote server returned an error: (501) Not Implemented when I try to read the contents from url:http://...
1
by: aferriere | last post by:
Hi I am getting a System.Net.WebException -- >The remote server returned an error: (501) Not Implemented when I try to read the contents from http://www.ourcommunity.com.au/...
2
by: aferriere | last post by:
Hi I am getting a System.Net.WebException -- >The remote server returned an error: (501) Not Implemented when I try to read the contents from...
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.