| |
by: David Jones |
last post by:
Hi, I'm interested in learning about web scraping/site scraping using
Python. Does anybody know of some online resources or have any modules that
are available to help out. O'Reilly published an interesting book
"Spidering Hacks" which covered some great scraping hacks but it is all
written in Perl. I don't know Perl and don't want to. I'm new to
programing and have been advised to start with Python. So far so good ...
but need some...
|
by: DesignGuy |
last post by:
I would like to download the RDF dump and generate static HTML pages (with
customizable headers and footers). I have only found one program called
iHierarchy that claims to do this ( http://simiax.com/ihier.html ) however
it is $199 and a demo to test is not available. Plus they're not answering
emails :(
Are there any other applications that will do this? Also, does any know or
care to guesstimate the size of the final static HTML...
|
by: Lorenzo |
last post by:
I've a web site with a classic asp login page (https), another where in a
textbox i write a sql query and a third that shows the resulset of the
query....
Now i want to create an asp.net application that have only one page with 2
textbox for login, a textbox where i'll write the sql query and a textbox
where shows the html of the previuos third page with the resultset of the
query...
i try using the HttpWebRequest Class but when i...
|
by: Paul W |
last post by:
Hi - I want to be able to capture the html generated by one of my pages. Is
there any way to do this from within the application, or must I use some
form of 'screen-scraping'. If screen-scraping, can someone point me in the
right direction and indicate how I get past the login screen, etc.(uses
forms authentication)? Thanks,
Paul.
|
by: Sanjay Arora |
last post by:
We are looking to select the language & toolset more suitable for a
project that requires getting data from several web-sites in real-
time....html parsing/scraping. It would require full emulation of the
browser, including handling cookies, automated logins & following
multiple web-link paths. Multiple threading would be a plus but not
requirement.
Some solutions were suggested:
Perl:
|
| |
by: Jim S |
last post by:
I have a need to read the contents of an html table on a remote web page into
a variable. I guess this is called screen scraping but not sure. I'm not
sure where to start or what the best practices are to accomplish this. For
instance; I have a healthcare app that need to check a gov't we page for a
user's license no# periodically. There is no login and I can put the user
info in the request URL no problem but not sure how to read the...
|
by: mailtogops |
last post by:
Hi All,
I am involved in one project which tends to collect news
information published on selected, known web sites inthe format of
HTML, RSS, etc and sortlist them and create a bookmark on our website
for the news content(we will use django for web development). Currently
this project is under heavy development.
I need a help on HTML parser.
|
by: s. d. rose |
last post by:
Hello All.
I am learning Python, and have never worked with HTML. However, I would
like to write a simple script to audit my 100+ Netware servers via their web
portal.
I was reading Chapter 8 of Dive into Python, which deals with this topic.
In the web portal of the server, there is a section similar to this:
-- clients and <A
href="http://eugenia.blogsome.com/?s=ipkall">clever</aservices. <--
|
by: Ecka |
last post by:
Hi everyone,
I'm trying to write a PHP script that connects to a bank's currency
convertor page using cURL and that part works fine. The issue is that I end
up with a page that includes a lot of information that I don't need. Using
the PHP function strip_tags I've ended with the text below and from the
remaining HTML code, I'd like to extract the lines starting with "<TABLE
BORDER="1" WIDTH="315">" up to its closing </TABLEtag. How do...
|
by: marktang |
last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, we’ll explore What is ONU, What Is Router, ONU & Router’s main usage, and What is the difference between ONU and Router. Let’s take a closer look !
Part I. Meaning of...
|
by: Hystou |
last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it.
First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
|
| |
by: Oralloy |
last post by:
Hello folks,
I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>".
The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed.
This is as boiled down as I can make it.
Here is my compilation command:
g++-12 -std=c++20 -Wnarrowing bit_field.cpp
Here is the code in...
|
by: jinu1996 |
last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven tapestry of website design and digital marketing. It's not merely about having a website; it's about crafting an immersive digital experience that captivates audiences and drives business growth.
The Art of Business Website Design
Your website is...
|
by: tracyyun |
last post by:
Dear forum friends,
With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
|
by: isladogs |
last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM).
In this session, we are pleased to welcome a new presenter, Adolph Dupré who will be discussing some powerful techniques for using class modules.
He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms.
Adolph will...
|
by: conductexam |
last post by:
I have .net C# application in which I am extracting data from word file and save it in database particularly. To store word all data as it is I am converting the whole word file firstly in HTML and then checking html paragraph one by one.
At the time of converting from word file to html my equations which are in the word document file was convert into image.
Globals.ThisAddIn.Application.ActiveDocument.Select();...
|
by: adsilva |
last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
|
| |
by: bsmnconsultancy |
last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...
|
