HttpWebRequest to save images

[Logician]

I am running on my PC Windows Forms to collect data from websites,
including images.

I hit a problem with images and javascript, and I would appreciate any
help.

The current code fails with a copy error. My Internet connected PC is
not the development machine, so I cannot debug on that PC and my other
PC has no Internet connection. So I cannot debug using .NET as normal.
My Code:
private string copyWebImage(st ring url, string TargetFile)
{
// add error handling
StringBuilder sb = new StringBuilder() ;
byte[] buf = new byte[8192];
try
{
HttpWebRequest request = (HttpWebRequest )WebRequest.Cre ate(url);

request.Timeout =5000;
HttpWebResponse response =
(HttpWebRespons e)request.GetRe sponse();
Stream responseStream = response.GetRes ponseStream();
StreamReader myTextReader = new StreamReader(re sponseStream);
char[] strBuffer = new char[25];
myTextReader.Re adBlock(strBuff er,0,25);
string stringBuffer = new string(strBuffe r);
//get image name from tiff or jpg or gif or jpeg
// insert name into database
// store image on pc as standard name

if (stringBuffer.I ndexOf("GIF8")>-1 ||
stringBuffer.In dexOf("JFIF")>-1)
{

// image found
//Image thisImage = Image.FromStrea m(responseStrea m);
//thisImage.Save( res
//thisImage.
//Stream ToStream = File.Create(Tar getFile);
//
thisImage.Save( ToStream,System .Drawing.Imagin g.ImageFormat.G if);
//BinaryReader br = new BinaryReader(re sponseStream);
byte[] b;
using (BinaryReader br = new BinaryReader(re sponseStream))
{
b= br.ReadBytes((i nt)responseStre am.Length);
br.Close();
}
FileStream fs= new FileStream(Targ etFile,FileMode .Create);
BinaryWriter w = new BinaryWriter(fs );
w.Write(b);

// BinaryWriter bw = new BinaryWriter(To Stream);
// bw.Write(br.Rea dBytes((int)res ponseStream.Len gth));
// bw.Flush();
// bw.Close();
//ToStream.Close( );
// br.Close();

}
else
{
// this is a text page
}
}
catch (WebException e)
{
return "image copy failed error "+e.ToStrin g();
}
catch (Exception e)
{
return "image copy failed error "+e.ToStrin g();
}

return "";
}

[Nicholas Paldino [.NET/C# MVP]]

Locician,

I don't see why you are doing all this stuff to get the index of GIF8 or
JFIF. I know you are trying to get the header of the image to determine
what type it is so that you can put it into an Image instance and then save
that, but I don't see why you just don't save the contents to disk directly,
since that is what you are doing in the end?
--
- Nicholas Paldino [.NET/C# MVP]
- mv*@spam.guard. caspershouse.co m

"Logician" <sa***@logician s.comwrote in message
news:11******** *************@1 9g2000hsx.googl egroups.com...

>I am running on my PC Windows Forms to collect data from websites,
including images.

I hit a problem with images and javascript, and I would appreciate any
help.

The current code fails with a copy error. My Internet connected PC is
not the development machine, so I cannot debug on that PC and my other
PC has no Internet connection. So I cannot debug using .NET as normal.
My Code:
private string copyWebImage(st ring url, string TargetFile)
{
// add error handling
StringBuilder sb = new StringBuilder() ;
byte[] buf = new byte[8192];
try
{
HttpWebRequest request = (HttpWebRequest )WebRequest.Cre ate(url);

request.Timeout =5000;
HttpWebResponse response =
(HttpWebRespons e)request.GetRe sponse();
Stream responseStream = response.GetRes ponseStream();
StreamReader myTextReader = new StreamReader(re sponseStream);
char[] strBuffer = new char[25];
myTextReader.Re adBlock(strBuff er,0,25);
string stringBuffer = new string(strBuffe r);
//get image name from tiff or jpg or gif or jpeg
// insert name into database
// store image on pc as standard name

if (stringBuffer.I ndexOf("GIF8")>-1 ||
stringBuffer.In dexOf("JFIF")>-1)
{

// image found
//Image thisImage = Image.FromStrea m(responseStrea m);
//thisImage.Save( res
//thisImage.
//Stream ToStream = File.Create(Tar getFile);
//
thisImage.Save( ToStream,System .Drawing.Imagin g.ImageFormat.G if);
//BinaryReader br = new BinaryReader(re sponseStream);
byte[] b;
using (BinaryReader br = new BinaryReader(re sponseStream))
{
b= br.ReadBytes((i nt)responseStre am.Length);
br.Close();
}
FileStream fs= new FileStream(Targ etFile,FileMode .Create);
BinaryWriter w = new BinaryWriter(fs );
w.Write(b);

// BinaryWriter bw = new BinaryWriter(To Stream);
// bw.Write(br.Rea dBytes((int)res ponseStream.Len gth));
// bw.Flush();
// bw.Close();
//ToStream.Close( );
// br.Close();

}
else
{
// this is a text page
}
}
catch (WebException e)
{
return "image copy failed error "+e.ToStrin g();
}
catch (Exception e)
{
return "image copy failed error "+e.ToStrin g();
}

return "";
}

[=?Utf-8?B?UGV0ZXIgQnJvbWJlcmcgW0MjIE1WUF0=?=]

As Nick indicated, all you need to do is issue the WebClient.Downl oadData
(urlOfImage) method and save the resultant byte[] array to disk with the name
of the image. Essentially, two lines of code.
-- Peter
Recursion: see Recursion
site: http://www.eggheadcafe.com
unBlog: http://petesbloggerama.blogspot.com
BlogMetaFinder: http://www.blogmetafinder.com

"Logician" wrote:

I am running on my PC Windows Forms to collect data from websites,
including images.

I hit a problem with images and javascript, and I would appreciate any
help.

The current code fails with a copy error. My Internet connected PC is
not the development machine, so I cannot debug on that PC and my other
PC has no Internet connection. So I cannot debug using .NET as normal.
My Code:
private string copyWebImage(st ring url, string TargetFile)
{
// add error handling
StringBuilder sb = new StringBuilder() ;
byte[] buf = new byte[8192];
try
{
HttpWebRequest request = (HttpWebRequest )WebRequest.Cre ate(url);

request.Timeout =5000;
HttpWebResponse response =
(HttpWebRespons e)request.GetRe sponse();
Stream responseStream = response.GetRes ponseStream();
StreamReader myTextReader = new StreamReader(re sponseStream);
char[] strBuffer = new char[25];
myTextReader.Re adBlock(strBuff er,0,25);
string stringBuffer = new string(strBuffe r);
//get image name from tiff or jpg or gif or jpeg
// insert name into database
// store image on pc as standard name

if (stringBuffer.I ndexOf("GIF8")>-1 ||
stringBuffer.In dexOf("JFIF")>-1)
{

// image found
//Image thisImage = Image.FromStrea m(responseStrea m);
//thisImage.Save( res
//thisImage.
//Stream ToStream = File.Create(Tar getFile);
//
thisImage.Save( ToStream,System .Drawing.Imagin g.ImageFormat.G if);
//BinaryReader br = new BinaryReader(re sponseStream);
byte[] b;
using (BinaryReader br = new BinaryReader(re sponseStream))
{
b= br.ReadBytes((i nt)responseStre am.Length);
br.Close();
}
FileStream fs= new FileStream(Targ etFile,FileMode .Create);
BinaryWriter w = new BinaryWriter(fs );
w.Write(b);

// BinaryWriter bw = new BinaryWriter(To Stream);
// bw.Write(br.Rea dBytes((int)res ponseStream.Len gth));
// bw.Flush();
// bw.Close();
//ToStream.Close( );
// br.Close();

}
else
{
// this is a text page
}
}
catch (WebException e)
{
return "image copy failed error "+e.ToStrin g();
}
catch (Exception e)
{
return "image copy failed error "+e.ToStrin g();
}

return "";
}

[Logician]

On Sep 17, 4:12 pm, Peter Bromberg [C# MVP]
<pbromb...@yaho o.yohohhoandabo ttleofrum.comwr ote:

As Nick indicated, all you need to do is issue the WebClient.Downl oadData
(urlOfImage) method and save the resultant byte[] array to disk with the name
of the image. Essentially, two lines of code.
-- Peter
Recursion: see Recursion
site: http://www.eggheadcafe.com
unBlog: http://petesbloggerama.blogspot.com
BlogMetaFinder: http://www.blogmetafinder.com

"Logician" wrote:

I am running on my PC Windows Forms to collect data from websites,
including images.

I hit a problem with images and javascript, and I would appreciate any
help.

The current code fails with a copy error. My Internet connected PC is
not the development machine, so I cannot debug on that PC and my other
PC has no Internet connection. So I cannot debug using .NET as normal.

My Code:
private string copyWebImage(st ring url, string TargetFile)
{
// add error handling
StringBuilder sb = new StringBuilder() ;
byte[] buf = new byte[8192];
try
{
HttpWebRequest request = (HttpWebRequest )WebRequest.Cre ate(url);

request.Timeout =5000;
HttpWebResponse response =
(HttpWebRespons e)request.GetRe sponse();
Stream responseStream = response.GetRes ponseStream();
StreamReader myTextReader = new StreamReader(re sponseStream);
char[] strBuffer = new char[25];
myTextReader.Re adBlock(strBuff er,0,25);
string stringBuffer = new string(strBuffe r);
//get image name from tiff or jpg or gif or jpeg
// insert name into database
// store image on pc as standard name

if (stringBuffer.I ndexOf("GIF8")>-1 ||
stringBuffer.In dexOf("JFIF")>-1)
{

// image found
//Image thisImage = Image.FromStrea m(responseStrea m);
//thisImage.Save( res
//thisImage.
//Stream ToStream = File.Create(Tar getFile);
//
thisImage.Save( ToStream,System .Drawing.Imagin g.ImageFormat.G if);
//BinaryReader br = new BinaryReader(re sponseStream);
byte[] b;
using (BinaryReader br = new BinaryReader(re sponseStream))
{
b= br.ReadBytes((i nt)responseStre am.Length);
br.Close();
}
FileStream fs= new FileStream(Targ etFile,FileMode .Create);
BinaryWriter w = new BinaryWriter(fs );
w.Write(b);

// BinaryWriter bw = new BinaryWriter(To Stream);
// bw.Write(br.Rea dBytes((int)res ponseStream.Len gth));
// bw.Flush();
// bw.Close();
//ToStream.Close( );
// br.Close();

}
else
{
// this is a text page
}

}
catch (WebException e)
{
return "image copy failed error "+e.ToStrin g();
}
catch (Exception e)
{
return "image copy failed error "+e.ToStrin g();
}

return "";
}- Hide quoted text -

- Show quoted text -

It works with DownloadFile(ur l,imageName). Thanks for the suggestion
about using WebClient.

I want to run this under UNIX and also implement Javascript link
following which is common on many websites.

Can C# work well under UNIX? Do you have experience of using WebClient
with .js based links?

[=?ISO-8859-1?Q?Arne_Vajh=F8j?=]

Logician wrote:

It works with DownloadFile(ur l,imageName). Thanks for the suggestion
about using WebClient.

I want to run this under UNIX and also implement Javascript link
following which is common on many websites.

Can C# work well under UNIX? Do you have experience of using WebClient
with .js based links?

I would expect both (Http)WebReques t and WebClient to work with
Mono on Unix (assuming Mono is available for your flavor of Unix).

The code will not interpret JavaScript.

Maybe you can do that by embedding a browser in your app. But that
will not work on Unix.

Arne