473,320 Members | 1,856 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,320 software developers and data experts.

How to save all search engine results urls in a text file

16
preferably only of the one that contain flash -flv files. All search results not only one displayed page.
Dec 24 '06 #1
5 2375
bartonc
6,596 Expert 4TB
preferably only of the one that contain flash -flv files. All search results not only one displayed page.
That will depend on how you get the search engine results.
Dec 24 '06 #2
bartonc
6,596 Expert 4TB
That will depend on how you get the search engine results.
Here's a tool for capture of URLs from IE:
html Snapshot (exe)
HTML Snapshot ActiveX control uses the internet explorers functionality to take (capture) a snapshot of a given URL. It hosts the Web browser control on windows to download Web page and then capture the whole HTML page it as image. It can be easily integrated into applications written in languages that support ActiveX control such as Visual C++, Visual Basic, Delphi, C++ Builder, and .Net languages. Convert HTML to image or HTML to JPEG. Fix bugs to support Internet Explorer 7. Version 2.1.2006.1118 can automatically clip the image by removing white area in the HTML generated image.

Tags: microsoft development tools, programming languages, development tools, html, activex control, c++, web browser, internet, web
Dec 24 '06 #3
dbojan
16
That will depend on how you get the search engine results.
From this search engine:

https://siteexplorer.search.yahoo.com/mysites

when I make all subdomains search just by typing a domain url in a search box like
blogspot.com -and after I verify my yahoo email password I get 28 millions webpages listed on thousands of search result pages.I want to save the urls only of the one that have flv files in a text file so some flash downloader preferably freeware could preview or download them selectively or all.
Dec 25 '06 #4
dbojan
16
Here's a tool for capture of URLs from IE:
html Snapshot (exe)
HTML Snapshot ActiveX control uses the internet explorers functionality to take (capture) a snapshot of a given URL. It hosts the Web browser control on windows to download Web page and then capture the whole HTML page it as image. It can be easily integrated into applications written in languages that support ActiveX control such as Visual C++, Visual Basic, Delphi, C++ Builder, and .Net languages. Convert HTML to image or HTML to JPEG. Fix bugs to support Internet Explorer 7. Version 2.1.2006.1118 can automatically clip the image by removing white area in the HTML generated image.

Tags: microsoft development tools, programming languages, development tools, html, activex control, c++, web browser, internet, web
I need a freeware or to do it in python.

Is my reply of your reply to my first post now enough you to know what program I would need? The snapshot program review doesn't say it can download all the urls to or from a text file of a search pages(that we can set up that it displays the minimum just the front page urls if we like) -not only all pages in one website and not to
show them in images but as text so the search engine can download them and there wasn't a word of the ability to filter only flash flv files,nor it was freeware.
Dec 25 '06 #5
bartonc
6,596 Expert 4TB
I need a freeware or to do it in python.

Is my reply of your reply to my first post now enough you to know what program I would need? The snapshot program review doesn't say it can download all the urls to or from a text file of a search pages(that we can set up that it displays the minimum just the front page urls if we like) -not only all pages in one website and not to
show them in images but as text so the search engine can download them and there wasn't a word of the ability to filter only flash flv files,nor it was freeware.
In the site that I gave it your other post, I also found "IIS utilities for Python". There are many ways to do what you want in python. Python has many new modules built in for url work. Check it out. Read the manuals.
Dec 25 '06 #6

Sign in to post your reply or Sign up for a free account.

Similar topics

1
by: phpkid | last post by:
Howdy I've been given conflicting answers about search engines picking up urls like: http://mysite.com/index.php?var1=1&var2=2&var3=3 Do search engines pick up these urls? I've been considering...
11
by: Petre Huile | last post by:
I have designed a site for a client, but they have hired an internet marketing person to incrase their search engine ranking and traffic. He wants to put extra-large fonts on every page which will...
5
by: George | last post by:
Hi, Anyone has the background for explaining? I have made a search on my name and I have got a link to another search engine. The link's title was the search phrase for the other search engine...
5
by: Sam | last post by:
Does anyone know of a way to create a search page under ASP.NET 2.0? I have started out by configuring a catalog in Index Server, registering the aspx, ascx extensions in the registry to allow...
8
by: david.lindsay.green | last post by:
Hello all, I am quite new a web scripting and making web pages in general and I have stumbled across a problem I have as yet been unable to solve. I am trying to take the contents of a textarea box...
4
by: zakhirn | last post by:
Hello, I have an extremely new user to XML and XSL, and I would like to know how to search XML data via a input form in HTML, and have the results displayed in HTML. If anyone has code that...
2
by: dbojan | last post by:
From this search engine: https://siteexplorer.search.yahoo.com/mysites when I make all subdomains search just by typing a domain url in a search box like blogspot.com -and after I verify my...
2
by: anbaxter | last post by:
I have a small challenge and you'll have to excuse me because I haven’t touched JS for some time and have gotten a bit rusty. I have an intranet site at work that has roughly 500,000 htm pages...
8
by: Bruno Rafael Moreira de Barros | last post by:
I have this framework I'm building in PHP, and it has Search Engine Friendly URLs, with site.com/controller/page/args... And on my View files, I have <?=$this->baseURL;?to print the base URL on the...
0
by: DolphinDB | last post by:
The formulas of 101 quantitative trading alphas used by WorldQuant were presented in the paper 101 Formulaic Alphas. However, some formulas are complex, leading to challenges in calculation. Take...
0
by: DolphinDB | last post by:
Tired of spending countless mintues downsampling your data? Look no further! In this article, you’ll learn how to efficiently downsample 6.48 billion high-frequency records to 61 million...
0
isladogs
by: isladogs | last post by:
The next Access Europe meeting will be on Wednesday 6 Mar 2024 starting at 18:00 UK time (6PM UTC) and finishing at about 19:15 (7.15PM). In this month's session, we are pleased to welcome back...
0
by: Vimpel783 | last post by:
Hello! Guys, I found this code on the Internet, but I need to modify it a little. It works well, the problem is this: Data is sent from only one cell, in this case B5, but it is necessary that data...
0
by: jfyes | last post by:
As a hardware engineer, after seeing that CEIWEI recently released a new tool for Modbus RTU Over TCP/UDP filtering and monitoring, I actively went to its official website to take a look. It turned...
1
by: PapaRatzi | last post by:
Hello, I am teaching myself MS Access forms design and Visual Basic. I've created a table to capture a list of Top 30 singles and forms to capture new entries. The final step is a form (unbound)...
0
by: CloudSolutions | last post by:
Introduction: For many beginners and individual users, requiring a credit card and email registration may pose a barrier when starting to use cloud servers. However, some cloud server providers now...
0
by: Shællîpôpï 09 | last post by:
If u are using a keypad phone, how do u turn on JavaScript, to access features like WhatsApp, Facebook, Instagram....
0
by: Faith0G | last post by:
I am starting a new it consulting business and it's been a while since I setup a new website. Is wordpress still the best web based software for hosting a 5 page website? The webpages will be...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.