[DB-SIG] Best format to store web data?

jam jam@newimage.com
Mon, 28 Jun 1999 08:26:36 -0400


On Mon, Jun 28, 1999 at 11:07:01AM +0200, Gerrit Holl wrote:
> 
> Hallo,
> 
> I've got some websites (not too big), and now I'm building a script to generate
> the news.
> 
> What is the best data format to store the news in? I've got about 2 news items
> a day, and every newsitem is about 400 characters text, and a "user", "date",
> "headline". I store this in s dictonairy and than cPickle it, is that the
> best way, or is mysql easier and faster?
> 
> groeten,
> Gerrit.
> 

hi.

I've already written a couple of different generations of something like
this for my website.

the answer is 'it depends'. ;) 

if you are only going to have a couple of news items a day, and you aren't
worrying about getting hundreds of hits per minute, then by all means, store
the thing in a simple text file and don't even worry about pickle. on the
other hand, if you are going to try to expand the system, and you are
already familiar with the ins-and-outs of relational databases (or want to
learn it), then go with mysql.

how about this.. get it up and working with simple text files or pickle, and
then start working on the sql based version. this way you can have something
together fairly quickly, and then start replacing bits as you go along. you
can write tools that will inject your text format files into the database
when it becomes available.

hope that helps.

regards,
Jeff
-- 
|| visit gfd <http://quark.newimage.com/> 
|| psa member #293 <http://www.python.org/> 
|| New Image Systems & Services, Inc. <http://www.newimage.com/>