Open Source Database required for storing huge data from Web crawler

[KushShukla]

I have an idea to implement a web application.
I will be having a web crawler that will fetch pages and information from the sites and store it to database. The registered end user can access the information by querying from the database.

I will be using the Web-Crawler written in Python.
Initially, I can design my website using some free online tools like weebly.com and later on can publish by buying some domain.

I have no idea which open source database to use for this purpose and link it to web site.
I am unaware of the limits which the open source databases provide ?

Please help me with my queries?

[Luuk]

Possible choices (this list is not complete):
1) MySQL
2) PostgeSQL
3) SLite

1) This is easy to setup, can do what you describe.
2) Somewhat harder to setup, can do what you describe.
3) no setup. Not good in concurrent updates (which you do not seem to need )

[KushShukla]

Thanks Luuk!
What amount of data can I store in these databases.
What is the difference between these open source databases and the paid ones?

Thanks in advance!

[mHealth]

PostGreSQL is outdated, SQLLite is for Android, better go for MySQL.

[KushShukla]

Thanks mHealth, I will check for MySQL.

[Luuk]

"PostgreSQL is outdated?"
Why is the latest release done in 2014
http://www.postgresql.org/docs/9.3/s...ase-9-3-4.html
How is this 'outdated'

"SQLite is for Android"
http://www.sqlite.org/famous.html
This page shows some applications which use SQLite, and those are not only for Android.....

@KushShukla
"What amount of data can I store in these databases."
until your hard drive is full ;)