Semi-official read-only Github mirror of the CPython Mercurial repository
Hi all, https://github.com/python/cpython is now live as a semi-official, *read only* Github mirror of the CPython Mercurial repository. Let me know if you have any problems/concerns. I still haven't decided how often to update it (considering either just N times a day, or maybe use a Hg hook for batching). Suggestions are welcome. The methodology I used to create it is via hg-fast-export. I also tried to pack and gc the git repo as much as possible before the initial Github push - it went down from almost ~2GB to ~200MB (so this is the size of a fresh clone right now). Eli P.S. thanks Jesse for the keys to https://github.com/python
On Sep 30, 2013, at 9:09 AM, Eli Bendersky <eliben@gmail.com> wrote:
Hi all,
https://github.com/python/cpython is now live as a semi-official, *read only* Github mirror of the CPython Mercurial repository. Let me know if you have any problems/concerns.
I still haven't decided how often to update it (considering either just N times a day, or maybe use a Hg hook for batching). Suggestions are welcome.
The methodology I used to create it is via hg-fast-export. I also tried to pack and gc the git repo as much as possible before the initial Github push - it went down from almost ~2GB to ~200MB (so this is the size of a fresh clone right now).
Eli
P.S. thanks Jesse for the keys to https://github.com/python
_______________________________________________ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/donald%40stufft.io
Awesome! I find Github way nicer for reading source than hg.python.org's web interface, any chance I could convince you to do this for the peps repo too? ;) ----------------- Donald Stufft PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA
https://github.com/python/cpython is now live as a semi-official, *read only* Github mirror of the CPython Mercurial repository. Let me know if you have any problems/concerns.
I still haven't decided how often to update it (considering either just N times a day, or maybe use a Hg hook for batching). Suggestions are welcome.
The methodology I used to create it is via hg-fast-export. I also tried to pack and gc the git repo as much as possible before the initial Github push - it went down from almost ~2GB to ~200MB (so this is the size of a fresh clone right now).
Eli
P.S. thanks Jesse for the keys to https://github.com/python
_______________________________________________ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/donald%40stufft.io
Awesome! I find Github way nicer for reading source than hg.python.org's web interface, any chance I could convince you to do this for the peps repo too? ;)
Yes, that shouldn't pose a problem. I'll let it hum for a couple of days just to see everything is OK and then I'll add peps too. Eli
On Mon, Sep 30, 2013 at 6:54 AM, Donald Stufft <donald@stufft.io> wrote:
On Sep 30, 2013, at 9:09 AM, Eli Bendersky <eliben@gmail.com> wrote:
Hi all,
https://github.com/python/cpython is now live as a semi-official, *read only* Github mirror of the CPython Mercurial repository. Let me know if you have any problems/concerns.
I still haven't decided how often to update it (considering either just N times a day, or maybe use a Hg hook for batching). Suggestions are welcome.
The methodology I used to create it is via hg-fast-export. I also tried to pack and gc the git repo as much as possible before the initial Github push - it went down from almost ~2GB to ~200MB (so this is the size of a fresh clone right now).
Eli
P.S. thanks Jesse for the keys to https://github.com/python
_______________________________________________ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/donald%40stufft.io
Awesome! I find Github way nicer for reading source than hg.python.org's web interface, any chance I could convince you to do this for the peps repo too? ;)
Here you go - https://github.com/python/peps Both mirrors are currently updated twice per night (23:00 and 04:30 US Pacific time). I may switch over to a VPS at some point and have more regular updates. Eli
https://github.com/python/cpython is now live as a semi-official, *read only* Github mirror of the CPython Mercurial repository. Let me know if you have any problems/concerns.
Thanks for this, Eli. I use git regularly at work, so I'm getting much more comfortable with it. Do you have a suggested workflow for people who might want to use Git in preference to Hg, but still have write access? Skip
On Mon, Sep 30, 2013 at 7:08 AM, Skip Montanaro <skip@pobox.com> wrote:
https://github.com/python/cpython is now live as a semi-official, *read only* Github mirror of the CPython Mercurial repository. Let me know if you have any problems/concerns.
Thanks for this, Eli. I use git regularly at work, so I'm getting much more comfortable with it. Do you have a suggested workflow for people who might want to use Git in preference to Hg, but still have write access?
Petri Lehtinen runs a clone at https://github.com/akheron/cpython which uses more advanced tricks like hg-git and his own git-hg wrapper to allow him to do this, AFAIK. If this path is important for you, contact Petri and he can provide guidance on how to set it up. For python/cpython I really wanted the simplest flow to reach a read-only stage, because I lack the necessary git/hg-fu to set up and maintain something more complex "semi-officially". I think the most common workflow is to do small changes vs. Mercurial anyway. When I'm working on longer-term patches I do them in my Git mirror (because I prefer Git branching) and then apply & test patches onto a Mercurial R/W clone before committing. Thus, for most users I think the read-only mirror is preferable because it's much easier to use and reason about. All writes go solely through Mercurial, so it's clear where the official source is :) Eli
Just a quick update on this. I've finally found time to set up a VPS at DigitalOcean of myself, and I'm moving the cronjob for updating the Github mirrors to it. This lets me ramp up the update frequency. For now I'll set it to every 4 hours, but in the future I may make it even more frequent. Hopefully this will not overrun my bandwidth allocation :) The CPython mirror (https://github.com/python/cpython) has been pretty popular so far, with over 70 forks. Eli On Mon, Sep 30, 2013 at 6:09 AM, Eli Bendersky <eliben@gmail.com> wrote:
Hi all,
https://github.com/python/cpython is now live as a semi-official, *read only* Github mirror of the CPython Mercurial repository. Let me know if you have any problems/concerns.
I still haven't decided how often to update it (considering either just N times a day, or maybe use a Hg hook for batching). Suggestions are welcome.
The methodology I used to create it is via hg-fast-export. I also tried to pack and gc the git repo as much as possible before the initial Github push - it went down from almost ~2GB to ~200MB (so this is the size of a fresh clone right now).
Eli
P.S. thanks Jesse for the keys to https://github.com/python
Eli, Thanks for setting this up. People are evidently finding it quite useful and are wondering if it could be more frequently run. We don't want you to have to absorb the bandwidth costs yourself, though. Is the code you use available somewhere? It shouldn't be hard to set up the cron job on PSF infrastructure. On Sat, Jul 12, 2014, at 09:15, Eli Bendersky wrote:
Just a quick update on this. I've finally found time to set up a VPS at DigitalOcean of myself, and I'm moving the cronjob for updating the Github mirrors to it. This lets me ramp up the update frequency. For now I'll set it to every 4 hours, but in the future I may make it even more frequent. Hopefully this will not overrun my bandwidth allocation :)
The CPython mirror (https://github.com/python/cpython) has been pretty popular so far, with over 70 forks.
Eli
On Mon, Sep 30, 2013 at 6:09 AM, Eli Bendersky <eliben@gmail.com> wrote:
Hi all,
https://github.com/python/cpython is now live as a semi-official, *read only* Github mirror of the CPython Mercurial repository. Let me know if you have any problems/concerns.
I still haven't decided how often to update it (considering either just N times a day, or maybe use a Hg hook for batching). Suggestions are welcome.
The methodology I used to create it is via hg-fast-export. I also tried to pack and gc the git repo as much as possible before the initial Github push - it went down from almost ~2GB to ~200MB (so this is the size of a fresh clone right now).
Eli
P.S. thanks Jesse for the keys to https://github.com/python
_______________________________________________ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/benjamin%40python.org
On Mon, Oct 6, 2014 at 12:37 PM, Benjamin Peterson <benjamin@python.org> wrote:
Eli, Thanks for setting this up. People are evidently finding it quite useful and are wondering if it could be more frequently run. We don't want you to have to absorb the bandwidth costs yourself, though. Is the code you use available somewhere? It shouldn't be hard to set up the cron job on PSF infrastructure.
Sorry I missed this. Alex reached out directly a few days ago and I updated it to hourly; I don't think there are significant costs involved, but if someone at the PSF wants to run this, I have no objections to that either. It's using the hg-fast-export tool, though, so its whole cache is required (incremental updates are done and it has its own hg hash -> git hash mapping). Eli
Just a quick update on this. I've finally found time to set up a VPS at DigitalOcean of myself, and I'm moving the cronjob for updating the Github mirrors to it. This lets me ramp up the update frequency. For now I'll set it to every 4 hours, but in the future I may make it even more frequent. Hopefully this will not overrun my bandwidth allocation :)
The CPython mirror (https://github.com/python/cpython) has been pretty popular so far, with over 70 forks.
Eli
On Mon, Sep 30, 2013 at 6:09 AM, Eli Bendersky <eliben@gmail.com> wrote:
Hi all,
https://github.com/python/cpython is now live as a semi-official, *read only* Github mirror of the CPython Mercurial repository. Let me know if you have any problems/concerns.
I still haven't decided how often to update it (considering either just N times a day, or maybe use a Hg hook for batching). Suggestions are welcome.
The methodology I used to create it is via hg-fast-export. I also
pack and gc the git repo as much as possible before the initial Github
On Sat, Jul 12, 2014, at 09:15, Eli Bendersky wrote: tried to push
- it went down from almost ~2GB to ~200MB (so this is the size of a fresh clone right now).
Eli
P.S. thanks Jesse for the keys to https://github.com/python
_______________________________________________ Python-Dev mailing list Python-Dev@python.org https://mail.python.org/mailman/listinfo/python-dev Unsubscribe: https://mail.python.org/mailman/options/python-dev/benjamin%40python.org
participants (4)
-
Benjamin Peterson -
Donald Stufft -
Eli Bendersky -
Skip Montanaro