473,386 Members | 1,846 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,386 software developers and data experts.

Crawling

I need to know if a web crawler simulates a link or if it redirects to a
link.

Meaning i have a link that looks like this

<a href="#" onclick=redirect(5))>Home</a>
Will a crawler be able to handle this?
Nov 19 '05 #1
1 1126
Most crawlers would not be smart enough to figure that out. Standard URLs
are safer if crawlability [is that a word?] is high on your list of
requirements.

--
I hope this helps,
Steve C. Orr, MCSD, MVP
http://SteveOrr.net
"chris" <cc**********@hotmail.com> wrote in message
news:%2****************@TK2MSFTNGP15.phx.gbl...
I need to know if a web crawler simulates a link or if it redirects to a
link.

Meaning i have a link that looks like this

<a href="#" onclick=redirect(5))>Home</a>
Will a crawler be able to handle this?

Nov 19 '05 #2

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

4
by: John Bradbury | last post by:
I am trying to develop a special putpose crawler using htmllib & urllib. How do you tell the server application that you are a modern browser and can handle frames? Thanks, john Bradbury
1
by: Benjamin Lefevre | last post by:
I am currently developping a web crawler, mainly crawling mobile page (wml, mobile xhtml) but not only (also html/xml/...), and I ask myself which speed I can reach. This crawler is developped in...
4
by: ask josephsen | last post by:
Hi NG I'm making a program to crawl the internet. It works by retrieving all links in a page, downloading the page of each link and again retrieving all the links. (If there is better ways I'd...
0
by: Jason Manfield | last post by:
I am trying to crawl the Web using HttpWebRequest and HttpWebResponse for the each of the links I discover. For content types like Application/pdf etc., I am able to convert the pdf file to text...
3
by: Mark | last post by:
Our site gets searched by robots all the time. This is great. However, many of our pages that we want to be cataloged are data driven, so we end up with pages like: ...
0
by: Heimlich Manure | last post by:
I'm emulating ROLAP in Postgres, populating a sorta-cube from a table with 200 million rows in it. Many aggregates over around 20 fields. Two questions : 1. Currently, it takes 1000 seconds to...
4
by: S Borg | last post by:
Hello, I have been writing very simple Python programs that parse HTML and such, mainly just to get a better feel for the language. Here is my question: If I parsed an HTML page into all of the...
0
by: Viktor Barasov | last post by:
I am searching for a web page where I can enter a new web page in russian language that should be visited by russian search engines/catalogs (like yahoo.ru) for indexing. Are there some...
2
by: teressa | last post by:
Hi Everyone, I was given a task to fix our printer friendly pages: Best practice recommendation was to dynamically load a JavaScript page. I have an asp page which is a printer-friendly page...
0
by: taylorcarr | last post by:
A Canon printer is a smart device known for being advanced, efficient, and reliable. It is designed for home, office, and hybrid workspace use and can also be used for a variety of purposes. However,...
0
by: aa123db | last post by:
Variable and constants Use var or let for variables and const fror constants. Var foo ='bar'; Let foo ='bar';const baz ='bar'; Functions function $name$ ($parameters$) { } ...
0
by: ryjfgjl | last post by:
If we have dozens or hundreds of excel to import into the database, if we use the excel import function provided by database editors such as navicat, it will be extremely tedious and time-consuming...
0
by: ryjfgjl | last post by:
In our work, we often receive Excel tables with data in the same format. If we want to analyze these data, it can be difficult to analyze them because the data is spread across multiple Excel files...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
1
by: nemocccc | last post by:
hello, everyone, I want to develop a software for my android phone for daily needs, any suggestions?
1
by: Sonnysonu | last post by:
This is the data of csv file 1 2 3 1 2 3 1 2 3 1 2 3 2 3 2 3 3 the lengths should be different i have to store the data by column-wise with in the specific length. suppose the i have to...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.