Storing GBs of data

[jeet232]

I'm writing a search engine, i'll need to store giga bytes of data, and i'm dividing it in multiple machines and multiple structures;

now, my question is that which is the best implementation for storing million of items in the data structure.

i know hash_map will be more suitable, but is there any other specific implementation available?

Another thing, is it necessary to store copies of objects in hashmap or map class? can i store pointers in them?

[weaknessforcats]

This question is far too complex to be addressed here.

Obvious questions arise, like why are you doing this instead of using an exisiting engine?? Like Oracle, LDAP, SQL Server, MySQL, etc.

But mainly, what you are asking requires a textbook fo knowedge and years of experience. It will be faster for you to do the research rather than have me do it for you.

I can tell you that your solution is not just a simple doo-dad like a hash_map.

Before you can ask questions like this, I presume you have written down your design using a suitable design tool like UML. And I presume you are prepared to spend years in development- with more persons than just yourself.

[jeet232]

Well, that is general issue,
people assume tht writing a good design requires UML etc.

I design my creations in the air!
and I've done those "things" which highly experienced computer scientists haven't done yet.

not being offensive.

[weaknessforcats]

End of discussion.

This is a professional forum and I do not not want to waste your time.