473,396 Members | 1,921 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,396 software developers and data experts.

How can I get WebRequest.Create(url) to return all the data?

I am trying to download some web pages and parse out the data. I use WebRequest in C#.

WebRequest wrGETURL;
wrGETURL = WebRequest.Create(url);
WebResponse response = null;
Stream readStream = null;

try
{
response = wrGETURL.GetResponse();
readStream = response.GetResponseStream();

StreamReader objReader = new StreamReader(readStream, Encoding.UTF8);
WebResponse wr = wrGETURL.GetResponse();
Stream receiveStream = wr.GetResponseStream();
StreamReader reader = new StreamReader(receiveStream, Encoding.UTF8);
string content = reader.ReadToEnd();
}

The problem is that the content variable does not have all the data that a ViewSource does from a browser. The is a large set of missing data that shows up as ... in the C# code.

So why am I missing some of the content.
Jul 26 '16 #1
0 1200

Sign in to post your reply or Sign up for a free account.

Similar topics

7
by: zalzon | last post by:
Is it good practice in C++ for a member function to return data or is it better that data is stored in private member variable and printed in the member function? should i be using int...
2
by: David C. Barber | last post by:
upsized an MDB to ADP/SQL Server 2000 under Access 2000. All the DAO code that I've changed to ADO code is working fine, HOWEVER the form Record Source itself does not seem willing to return data....
4
by: Garibaldi | last post by:
Folks, I'm having a bad regex day and can sure use your help, please.. I have a Regex expression that works fine. It's purpose is to isolate all data from the start of a string begining with...
0
by: Daniel | last post by:
Can someone help me find an example that queries a db and return data to the caller. Below is what I'v been able to put together from this list buy my CFMX is returning an error. ...
0
by: ar | last post by:
What is the best way to return data from web service created in .NET: in recordset, in array, in hashtable or in any other collection? The web service will be created in either VB.Net or C# based...
2
by: Hrvoje Voda | last post by:
I'm using this store procedure to return data from sql server. SqlDataReader sqlRead = null; System.Data.SqlClient.SqlCommand ProfileBLOBSelect = new System.Data.SqlClient.SqlCommand(); ...
2
by: polaris431 | last post by:
In my ASP.NET app, I would like to return data back to the client in such a way that it appears to the client that a file is being returned. As you know, when you click on a link on some web pages...
2
by: Freddy Coal | last post by:
Hi, I make a a program with two Form, I call Form2 as showdialog() I Would like receive data when Form2 is closed, how make that?. How return data when the form is closing or closed?. Thanks...
1
by: opensourcer | last post by:
hi, can any 1 help me with the idea/code. How can i copy/store system func return data. ex : perl code for copy system return data. my $thecmd = "ss -l"; open (PIPEH, "$thecmd |"); ...
1
by: =?Utf-8?B?SnVhbiBQdWVibGE=?= | last post by:
Hi, I'm trying to use Linq in a webservice that returns a data from a query. As the data return from Linq to Sql is IEnumerable<Tand it's not possible to easily get a Dataset, Which is the best...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However,...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...
0
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each...
0
agi2029
by: agi2029 | last post by:
Let's talk about the concept of autonomous AI software engineers and no-code agents. These AIs are designed to manage the entire lifecycle of a software development project—planning, coding, testing,...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.