[DB-SIG] Managing Large/Huge Data Base + First Steps

[Vernon Cole]

Nicolò:

You are correct -- this is a project for Python, not PHP. However, I suspect
that a text file will not help you. Perhaps a large random access data file
(which is what an SQL database uses internally) would be an appropriate
answer.

Projects such as you describe take either a lot of time, or a lot of money.
An SQL database (with a large enough storage array under it) could be built
to hold 10^8 items, but access speed may be a problem if the contents change
frequently. Otherwise you may need a computer (or an array of computers)
with a LOT of virtual memory. Fast memory is expensive. If you can wait
weeks for your results, you can build your "planet" on disk for not much
money. If you need results in minutes, you will need to purchase time on a
supercomputer. Your budget will be the deciding factor.

How much data does each "cell" hold?

How often do they change state?
--
Vernon Cole
(Perhaps you should answer me directly -- this group is ususally used only
for low-bandwidth announcements and such. If anyone else wants to jump in
they may, of course. -- VC)


2009/6/29 Nicolò Lazzaro <n.lazzaro at hotmail.it>

>  Hi all! I'm trying to build a program that works in some way like a "life
> evolution simulator". This "planet" should be made of - at least - 10^8
> cells, that continuously change their state and are subject to mathematical
> functions. I've just came to python, after realizing that PHP and SQL (of
> what I know some basic scripting) could never fit this project, thinking of
> moving from databases to text files.
> So I've come to this mailing list, hoping to learn something useful for my
> purpose and willing to know were should I look (after some beginner tutorial
> of course) to get the right skills in this specific field.
>
> Thank you for reading! I hope to find some answer, have a nice day! :-D
> Nicolo'
> ------------------------------
> Invite your mail contacts to join your friends list with Windows Live
> Spaces. It's easy! Try it!<http://spaces.live.com/spacesapi.aspx?wx_action=create&wx_url=/friends.aspx&mkt=en-us>
>
> _______________________________________________
> DB-SIG maillist  -  DB-SIG at python.org
> http://mail.python.org/mailman/listinfo/db-sig
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/db-sig/attachments/20090629/271006a7/attachment.htm>