[Catalog-sig] start on static generation, and caching - apache config.

[René Dudfield]

Hi,

turning on caching is the plan as well, but after the static files.
See my earlier emails on the subject.

However static pages have their uses too, and are a bit faster than
the cached ones.


On 7/9/07, Phillip J. Eby <pje at telecommunity.com> wrote:
> At 01:48 PM 7/7/2007 -0400, Jim Fulton wrote:
>
> >On Jul 7, 2007, at 12:43 PM, Martin v. Löwis wrote:
> >...
> > > I'm quite skeptical on caching in general (even about the static page
> > > generation). It *should* be possible to make it fast enough so that
> > > it doesn't need caching.
> >
> >Sure, with more hardware than we want to afford.
> >
> > > I consider caching a work-around, not a
> > > solution - and one with severe drawbacks.
> >
> >The pages we're talking about are static.  They change at well-known
> >times. IMO, It's crazy to serve static content dynamically when it's
> >easy to serve it statically.
>
> If they're effectively static, why can't Apache cache
> them?  Shouldn't we be able to simply add Last-Modified/If-Modified
> support to the PyPI output, and enable Apache's disk caching for
> non-logged-in users?
>
> That is, as long as there is a quick last-modified-time query for a
> package, we can use those to process the If-Modified header.  The
> modification time could even be memcached, so as not to need a
> database hit 99% of the time.
>
> While that's not necessarily as fast as static page generation, it's
> a lot less complex to get right, and it saves the main piece of CPU
> load: i.e., doing SQL queries and actually generating the page.
>
> Pages that pertain to more than one package might be a bit more
> complex to do this on, but if I understand correctly it's mainly the
> package-specific pages we're concerned with here, correct?  Even so,
> it's possible to have any updates also update a global "something's
> changed" time, and use that time as the Last-Modified of those pages.
>
> _______________________________________________
> Catalog-SIG mailing list
> Catalog-SIG at python.org
> http://mail.python.org/mailman/listinfo/catalog-sig
>