HTML::Parser problem parsing special charcters in HTML file.

[atulskulkarni]

Hello All,

I am trying to extract text from the HTML using the following code,

use strict;
use HTML::Parser 3.00 ();
 
my %inside;
my $p;
sub tag
{
}
 
sub text
{
    return if $inside{script} || $inside{style};
    print $_[0];
}
 
open(my $fh, shift) || die;
 
$p = HTML::Parser->new(api_version => 3,
          handlers    => [start => [\&tag, "tagname, '+1'"],
                  end   => [\&tag, "tagname, '-1'"],
                  text  => [\&text, "dtext"],
                 ],
          marked_sections => 1,
    );
 
while(<$fh>)
{
    $p->parse($_) || die "Can't open file: $!\n";;
}

It does so only falters when it finds the special characters like ’ or the likes. I wish to process these either to ignore them or replace them with some sensible ASCII chars. I tried the encode module it does not yield anything useful.

Any help is appreciated.

Regards,
Atul.

[numberwhun]

Hello All,

I am trying to extract text from the HTML using the following code,

use strict;
use HTML::Parser 3.00 ();
 
my %inside;
my $p;
sub tag
{
}
 
sub text
{
    return if $inside{script} || $inside{style};
    print $_[0];
}
 
open(my $fh, shift) || die;
 
$p = HTML::Parser->new(api_version => 3,
          handlers    => [start => [\&tag, "tagname, '+1'"],
                  end   => [\&tag, "tagname, '-1'"],
                  text  => [\&text, "dtext"],
                 ],
          marked_sections => 1,
    );
 
while(<$fh>)
{
    $p->parse($_) || die "Can't open file: $!\n";;
}

It does so only falters when it finds the special characters like ’ or the likes. I wish to process these either to ignore them or replace them with some sensible ASCII chars. I tried the encode module it does not yield anything useful.

Any help is appreciated.

Regards,
Atul.

Sorry, I don't know the answer but hopefully one of our experts will be able to assist you.

My appologies for the delay in getting an answer to your question.

Regards,

Jeff