[Python-Dev] Semi-official read-only Github mirror of the CPython Mercurial repository

[Eli Bendersky]

On Mon, Oct 6, 2014 at 12:37 PM, Benjamin Peterson <benjamin at python.org>
wrote:

> Eli,
> Thanks for setting this up. People are evidently finding it quite useful
> and are wondering if it could be more frequently run. We don't want you
> to have to absorb the bandwidth costs yourself, though. Is the code you
> use available somewhere? It shouldn't be hard to set up the cron job on
> PSF infrastructure.
>
>
Sorry I missed this. Alex reached out directly a few days ago and I updated
it to hourly; I don't think there are significant costs involved, but if
someone at the PSF wants to run this, I have no objections to that either.

It's using the hg-fast-export tool, though, so its whole cache is required
(incremental updates are done and it has its own hg hash -> git hash
mapping).

Eli





> On Sat, Jul 12, 2014, at 09:15, Eli Bendersky wrote:
> > Just a quick update on this. I've finally found time to set up a VPS at
> > DigitalOcean of myself, and I'm moving the cronjob for updating the
> > Github
> > mirrors to it. This lets me ramp up the update frequency. For now I'll
> > set
> > it to every 4 hours, but in the future I may make it even more frequent.
> > Hopefully this will not overrun my bandwidth allocation :)
> >
> > The CPython mirror (https://github.com/python/cpython) has been pretty
> > popular so far, with over 70 forks.
> >
> > Eli
> >
> >
> >
> > On Mon, Sep 30, 2013 at 6:09 AM, Eli Bendersky <eliben at gmail.com> wrote:
> >
> > > Hi all,
> > >
> > > https://github.com/python/cpython is now live as a semi-official,
> *read
> > > only* Github mirror of the CPython Mercurial repository. Let me know
> if you
> > > have any problems/concerns.
> > >
> > > I still haven't decided how often to update it (considering either
> just N
> > > times a day, or maybe use a Hg hook for batching). Suggestions are
> welcome.
> > >
> > > The methodology I used to create it is via hg-fast-export. I also
> tried to
> > > pack and gc the git repo as much as possible before the initial Github
> push
> > > - it went down from almost ~2GB to ~200MB (so this is the size of a
> fresh
> > > clone right now).
> > >
> > > Eli
> > >
> > > P.S. thanks Jesse for the keys to https://github.com/python
> > >
> > >
> > >
> > >
> > _______________________________________________
> > Python-Dev mailing list
> > Python-Dev at python.org
> > https://mail.python.org/mailman/listinfo/python-dev
> > Unsubscribe:
> > https://mail.python.org/mailman/options/python-dev/benjamin%40python.org
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-dev/attachments/20141015/c6ef3adb/attachment.html>