473,666 Members | 2,048 Online
Bytes | Software Development & Data Engineering Community
+ Post

Home Posts Topics Members FAQ

Domain Names

Hi Guys,

I know this is a bit off topic, but im not having any luck googling it.

I want to know where I can go programatically to get a list of all
registered domains on the internet.
Cheers

--
Terry Burns
Mar 25 '06 #1
16 1458
"Terry Burns" <me@mine.com> wrote in message
news:On******** ******@tk2msftn gp13.phx.gbl...
I want to know where I can go programatically to get a list of all
registered domains on the internet.


All registered domains on the Internet...???

There must literally be millions of them!
Mar 25 '06 #2

"Mark Rae" <ma**@markN-O-S-P-A-M.co.uk> wrote in message
news:um******** ******@TK2MSFTN GP12.phx.gbl...
"Terry Burns" <me@mine.com> wrote in message
news:On******** ******@tk2msftn gp13.phx.gbl...
I want to know where I can go programatically to get a list of all
registered domains on the internet.


All registered domains on the Internet...???

There must literally be millions of them!


Tens of millions, in fact ...

http://www.whois.sc/internet-statistics/

--
Brendan Reynolds
Mar 25 '06 #3


--
Terry Burns
http://TrainingOn.net
"Brendan Reynolds" <br******@discu ssions.microsof t.com> wrote in message
news:ug******** *******@TK2MSFT NGP12.phx.gbl.. .

"Mark Rae" <ma**@markN-O-S-P-A-M.co.uk> wrote in message
news:um******** ******@TK2MSFTN GP12.phx.gbl...
"Terry Burns" <me@mine.com> wrote in message
news:On******** ******@tk2msftn gp13.phx.gbl...
I want to know where I can go programatically to get a list of all
registered domains on the internet.


All registered domains on the Internet...???

There must literally be millions of them!


Tens of millions, in fact ...

http://www.whois.sc/internet-statistics/

--
Brendan Reynolds


No, i mean is there a way to retrieve a list of domain names from the DNS
server and display them in a database using vb.net.

i was also wondering if it is possible to find the domain name by resolving
it with the ip Address, not sure if that is possible but

any help would be much appreciate .

Thanks Guys.
Mar 25 '06 #4
So, you want to programmaticall y build what a DNS server already does?
"Terry Burns" <me@mine.com> wrote in message
news:%2******** ********@TK2MSF TNGP14.phx.gbl. ..


--
Terry Burns
http://TrainingOn.net
"Brendan Reynolds" <br******@discu ssions.microsof t.com> wrote in message
news:ug******** *******@TK2MSFT NGP12.phx.gbl.. .

"Mark Rae" <ma**@markN-O-S-P-A-M.co.uk> wrote in message
news:um******** ******@TK2MSFTN GP12.phx.gbl...
"Terry Burns" <me@mine.com> wrote in message
news:On******** ******@tk2msftn gp13.phx.gbl...

I want to know where I can go programatically to get a list of all
registered domains on the internet.

All registered domains on the Internet...???

There must literally be millions of them!


Tens of millions, in fact ...

http://www.whois.sc/internet-statistics/

--
Brendan Reynolds


No, i mean is there a way to retrieve a list of domain names from the DNS
server and display them in a database using vb.net.

i was also wondering if it is possible to find the domain name by
resolving it with the ip Address, not sure if that is possible but

any help would be much appreciate .

Thanks Guys.

Mar 26 '06 #5
yes, i am building a crawler which returns the links on a website and stores
them in a database, i am trying to get domain names by
testing to see if i can resolve the ip address, incrementing them by one
each time until it hits a domain, it then stores in a database
and can be used later.

--
Terry Burns
http://TrainingOn.net
"Scott M." <s-***@nospam.nosp am> wrote in message
news:e3******** ********@tk2msf tngp13.phx.gbl. ..
So, you want to programmaticall y build what a DNS server already does?
"Terry Burns" <me@mine.com> wrote in message
news:%2******** ********@TK2MSF TNGP14.phx.gbl. ..


--
Terry Burns
http://TrainingOn.net
"Brendan Reynolds" <br******@discu ssions.microsof t.com> wrote in message
news:ug******** *******@TK2MSFT NGP12.phx.gbl.. .

"Mark Rae" <ma**@markN-O-S-P-A-M.co.uk> wrote in message
news:um******** ******@TK2MSFTN GP12.phx.gbl...
"Terry Burns" <me@mine.com> wrote in message
news:On******** ******@tk2msftn gp13.phx.gbl...

> I want to know where I can go programatically to get a list of all
> registered domains on the internet.

All registered domains on the Internet...???

There must literally be millions of them!

Tens of millions, in fact ...

http://www.whois.sc/internet-statistics/

--
Brendan Reynolds


No, i mean is there a way to retrieve a list of domain names from the DNS
server and display them in a database using vb.net.

i was also wondering if it is possible to find the domain name by
resolving it with the ip Address, not sure if that is possible but

any help would be much appreciate .

Thanks Guys.


Mar 26 '06 #6

"Terry Burns" <me@mine.com> wrote in message
news:%2******** ********@TK2MSF TNGP14.phx.gbl. ..


--
Terry Burns
http://TrainingOn.net
"Brendan Reynolds" <br******@discu ssions.microsof t.com> wrote in message
news:ug******** *******@TK2MSFT NGP12.phx.gbl.. .

"Mark Rae" <ma**@markN-O-S-P-A-M.co.uk> wrote in message
news:um******** ******@TK2MSFTN GP12.phx.gbl...
"Terry Burns" <me@mine.com> wrote in message
news:On******** ******@tk2msftn gp13.phx.gbl...

I want to know where I can go programatically to get a list of all
registered domains on the internet.

All registered domains on the Internet...???

There must literally be millions of them!
Tens of millions, in fact ...

http://www.whois.sc/internet-statistics/

--
Brendan Reynolds


No, i mean is there a way to retrieve a list of domain names from the DNS
server and display them in a database using vb.net.


"A list of domain names from the DNS server" doesn't make any sense to me.

Dig is the most versatile DNS client I know (that is, it's better than
nslookup or library calls). Take a look at the man page. It'll give you an
idea of how DNS is expected to be indexed. As far as I know, domain lists
don't exist in a single source. You could call DNS the first federated
database I suppose. If you want to know all the delegates of a given
authority, well, again, I don't think you can even get that.

You can pull A records to your hearts content tho.
i was also wondering if it is possible to find the domain name by
resolving it with the ip Address, not sure if that is possible but
Besides being a living thing, FQDNs and dotted quads are a many to many
relationship. You can also map dandeliones in your neighborhood. I
question the wisdom of both. :)
any help would be much appreciate .

Thanks Guys.


Mar 26 '06 #7
On Sat, 25 Mar 2006 19:57:47 -0000, Terry Burns wrote:
I want to know where I can go programatically to get a list of all
registered domains on the internet.


The only reliable way to do this is to linearly query each possible domain
name starting with a.com, a.net, a.org.. etc.. and ending with
zzzzzzzzzzzzzzz zzzzzzzzzzzzzzz zzzzzzzzzzzzzzz zzzzzzzzzzzzzzz zzzzzzzzzzzzzzz zz.com,
..org, etc... (actual maximimum length is probably much longer, that was
just an example).

Unless you have serious bandwidth, and lots of machines to do simultaneous
work, it's not likely you would complete this task in any decent timeframe,
and likely by the time you finished it would be out of date anyways, as
domains expire or are bought daily.
Mar 26 '06 #8
Just a quick note here. The Original Post Was made by my Son on my machine.
Just wanted to clear this up. He is sixteen and trying to find out about the
internet and wants to use .net to do it.

Having said this, his question is an interesting one, im not quite sure how
crawlers get notification of newly registered domain names in order to crawl
them.

Does anyone know ? It would seem to me that the DNS servers have all the
information one needs, its just about how to get it ?

--
Terry Burns
http://TrainingOn.net
"Terry Burns" <me@mine.com> wrote in message
news:%2******** ********@TK2MSF TNGP11.phx.gbl. ..
yes, i am building a crawler which returns the links on a website and
stores them in a database, i am trying to get domain names by
testing to see if i can resolve the ip address, incrementing them by one
each time until it hits a domain, it then stores in a database
and can be used later.

--
Terry Burns
http://TrainingOn.net
"Scott M." <s-***@nospam.nosp am> wrote in message
news:e3******** ********@tk2msf tngp13.phx.gbl. ..
So, you want to programmaticall y build what a DNS server already does?
"Terry Burns" <me@mine.com> wrote in message
news:%2******** ********@TK2MSF TNGP14.phx.gbl. ..


--
Terry Burns
http://TrainingOn.net
"Brendan Reynolds" <br******@discu ssions.microsof t.com> wrote in message
news:ug******** *******@TK2MSFT NGP12.phx.gbl.. .

"Mark Rae" <ma**@markN-O-S-P-A-M.co.uk> wrote in message
news:um******** ******@TK2MSFTN GP12.phx.gbl...
> "Terry Burns" <me@mine.com> wrote in message
> news:On******** ******@tk2msftn gp13.phx.gbl...
>
>> I want to know where I can go programatically to get a list of all
>> registered domains on the internet.
>
> All registered domains on the Internet...???
>
> There must literally be millions of them!

Tens of millions, in fact ...

http://www.whois.sc/internet-statistics/

--
Brendan Reynolds
No, i mean is there a way to retrieve a list of domain names from the
DNS server and display them in a database using vb.net.

i was also wondering if it is possible to find the domain name by
resolving it with the ip Address, not sure if that is possible but

any help would be much appreciate .

Thanks Guys.



Mar 26 '06 #9
On Sun, 26 Mar 2006 09:56:33 +0100, Terry Burns wrote:
Having said this, his question is an interesting one, im not quite sure how
crawlers get notification of newly registered domain names in order to crawl
them.
They don't get notification. They have to just query dns for all possible
name combinations. Unless of course they have some kind of backdoor deal
with a registrar (or someone that works for one). But even then, they'd
only know about accounts registered through that registrar.
Does anyone know ? It would seem to me that the DNS servers have all the
information one needs, its just about how to get it ?


No. DNS is a distributed architecture. The root DNS servers do have all
possible domain names in them, but they just defer to whatever DNS server
is defined for that name to provide everything else. This is a query-only
service. You have to know what you're looking for to get an answer.
Mar 26 '06 #10

This thread has been closed and replies have been disabled. Please start a new discussion.

Similar topics

2
1572
by: Phil Lamey | last post by:
Hi All, What do you do when your external DNS lists varying DNS names for the same server. I know you can specify a domain for the cookie but how can you request the cookie or a specific domain? IE: Let say in then DNS www.x.mydomain.com and www.y.mydomain.com point to the same server. Mostly we want the users using www.x.mydomain.com but somehow a user gets
3
16434
by: mrwoopey | last post by:
Hi, I am using the example "Authenticate against the Active Directory by Using Forms Authentication and Visual Basic .NET": http://support.microsoft.com/default.aspx?scid=KB;EN-US;326340 But I am having a problem figuring out the LDAP:// The LDAP:// that I pass looks like this (i substitued generic the
3
1600
by: Nick | last post by:
hi, all I just started to create my own website and I registered a new domain from yahoo, and then I want to register a webhost plan. And how to use this domain I registered? What I undertood about transfer domain is I can transfer the domain to the webhost vendor, and they can config it on their server to point this domain to my web pages, is this right? Is the transfer domain free? Thanks.
22
3159
by: magic_hat60622 | last post by:
Hi all. I've got an app that dumps a user id into a session after successful login. the login page is http://www.mydomain.com/login.php. If the user visits pages on my site without the www (i.e., http://mydomain.com/foo.php), the session works fine and login state is maintained. If he visits http://www.mydomain.com/foo.php, the app drops the logged-in state.
9
5414
by: Sam | last post by:
Validate domain name context Hello , Today I want to make sure from a given text is a domain style or not. for example : the domain can be example.com or example.com.us or example.us so , what is the pattren to check the given string is a domain style or not?
1
1286
by: Neo Geshel | last post by:
I know this probably OT, but I need to know if there is any way to “upgrade” the host header system of IIS 6 (Win 2003) to accept internationalized domain names. That is, domain names with characters other than the standard US character set. IIS in its current state will not accept anything other than a-z, . and - in a domain or subdomain. I need to set up a web site from a Japanese company whose properly-registered domain name...
0
1802
by: conniezhang | last post by:
Dear Valued Businessman/BusinessLady, Todaynic.com is one of the first ICANN Accredited Registrars and CNNIC Accredited Domestic Registrars in China. Great amount of domain extensions with low prices and provide VDNS (Virtual Domain Name Server) services of its Secondary Domain Name. 10XGE FDDI directly to ChinaNet to ensure stability and high speed. CyberIP, Anti-spam email, Website DIY,Internet call cards. SCP's auto management(Smart...
6
3106
by: Guy Macon | last post by:
While I agree with the sentiment, the oringinal title on this thread ("OT: Specially for , why you should always use example.com for obfuscating domains") is wrong. There are other reserved domain names besides example.com. The search for reserved domain names should start with RFC 2606 ( http://www.faqs.org/rfcs/rfc2606.html ) which defines; *.test *.example
0
8444
marktang
by: marktang | last post by:
ONU (Optical Network Unit) is one of the key components for providing high-speed Internet services. Its primary function is to act as an endpoint device located at the user's premises. However, people are often confused as to whether an ONU can Work As a Router. In this blog post, well explore What is ONU, What Is Router, ONU & Routers main usage, and What is the difference between ONU and Router. Lets take a closer look ! Part I. Meaning of...
0
8356
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can effortlessly switch the default language on Windows 10 without reinstalling. I'll walk you through it. First, let's disable language synchronization. With a Microsoft account, language settings sync across devices. To prevent any complications,...
0
8869
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers, it seems that the internal comparison operator "<=>" tries to promote arguments from unsigned to signed. This is as boiled down as I can make it. Here is my compilation command: g++-12 -std=c++20 -Wnarrowing bit_field.cpp Here is the code in...
0
8639
tracyyun
by: tracyyun | last post by:
Dear forum friends, With the development of smart home technology, a variety of wireless communication protocols have appeared on the market, such as Zigbee, Z-Wave, Wi-Fi, Bluetooth, etc. Each protocol has its own unique characteristics and advantages, but as a user who is planning to build a smart home system, I am a bit confused by the choice of these technologies. I'm particularly interested in Zigbee because I've heard it does some...
1
6198
isladogs
by: isladogs | last post by:
The next Access Europe User Group meeting will be on Wednesday 1 May 2024 starting at 18:00 UK time (6PM UTC+1) and finishing by 19:30 (7.30PM). In this session, we are pleased to welcome a new presenter, Adolph Dupr who will be discussing some powerful techniques for using class modules. He will explain when you may want to use classes instead of User Defined Types (UDT). For example, to manage the data in unbound forms. Adolph will...
0
4198
by: TSSRALBI | last post by:
Hello I'm a network technician in training and I need your help. I am currently learning how to create and manage the different types of VPNs and I have a question about LAN-to-LAN VPNs. The last exercise I practiced was to create a LAN-to-LAN VPN between two Pfsense firewalls, by using IPSEC protocols. I succeeded, with both firewalls in the same network. But I'm wondering if it's possible to do the same thing, with 2 Pfsense firewalls...
0
4368
by: adsilva | last post by:
A Windows Forms form does not have the event Unload, like VB6. What one acts like?
2
2011
muto222
by: muto222 | last post by:
How can i add a mobile payment intergratation into php mysql website.
2
1775
bsmnconsultancy
by: bsmnconsultancy | last post by:
In today's digital era, a well-designed website is crucial for businesses looking to succeed. Whether you're a small business owner or a large corporation in Toronto, having a strong online presence can significantly impact your brand's success. BSMN Consultancy, a leader in Website Development in Toronto offers valuable insights into creating effective websites that not only look great but also perform exceptionally well. In this comprehensive...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.