<div dir="ltr">s/states/salt states/</div><div class="gmail_extra"><br><br><div class="gmail_quote">On Sat, Jan 25, 2014 at 9:15 PM, Kyle Kelley <span dir="ltr"><<a href="mailto:rgbkrk@gmail.com" target="_blank">rgbkrk@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Congrats! Thanks for always making the PyPI infrastructure better and better.<div><br></div><div>Where are the states stored?</div>
</div><div class="gmail_extra"><br><br><div class="gmail_quote"><div><div class="h5">On Sat, Jan 25, 2014 at 5:18 PM, Donald Stufft <span dir="ltr"><<a href="mailto:donald@stufft.io" target="_blank">donald@stufft.io</a>></span> wrote:<br>
</div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5"><div><div><br>
On Jan 25, 2014, at 7:04 PM, Chris Jerdonek <<a href="mailto:chris.jerdonek@gmail.com" target="_blank">chris.jerdonek@gmail.com</a>> wrote:<br>
<br>
> On Sat, Jan 25, 2014 at 3:38 PM, Donald Stufft <<a href="mailto:donald@stufft.io" target="_blank">donald@stufft.io</a>> wrote:<br>
>> Today (Sat Jan 25, 2014) the Infrastructure team has migrated PyPI to new<br>
>> infrastructure.<br>
>><br>
>> The old infrastructure was:<br>
>><br>
>> - a single database server managed by OSUOSL<br>
>> - a pair of load balancers shared by all of the <a href="http://python.org" target="_blank">python.org</a> services hosted on<br>
>> OSUOSL<br>
>> - a single backend VM that served as everything else for PyPI<br>
>><br>
>> The VM that was acting as the backend server from PyPI was partially hand<br>
>> configured and partially setup to be managed by chef. Additionally it had an<br>
>> issue that caused it to kernel panic every so often which had been the cause of<br>
>> a number of downtimes in the last few months. Because it was primarily<br>
>> configured and administered by hand and because the way it was set up it was<br>
>> not feasible to have any sort of failover or spare.<br>
>><br>
>> The new infrastructure is:<br>
>><br>
>> - 2 Web VMs<br>
>> - 2 Database servers in Master/Slave Configuration<br>
>> - 2 PgPool Servers pooling connections to the database servers and load<br>
>> balancing reads across them.<br>
>> - 2 GlusterFS servers backed by Cloud Block Storage acting as the file storage<br>
>> for package and package docs<br>
>> - 1 metrics server to handle updating the download counts as they come in from<br>
>> Fastly<br>
>><br>
>> All of the VMs are hosted on Rackspace’s Public Cloud and have their<br>
>> configuration completely controlled and managed using Salt. Going forward this<br>
><br>
> Can you say a little about the choice to use Salt instead of Chef? I<br>
> don't really care either way, but am just curious. Is it because Salt<br>
> is written in Python, or were there other reasons (functionality,<br>
> etc)?<br>
><br>
> --Chris<br>
<br>
</div></div>I’d need to ask Ernest to be sure, but I believe it was mostly that he was more familiar<br>
with it. The fact that it was written in Python was a bonus as well ;) I don’t think that<br>
there was anything that Chef was missing or that Salt had over Chef, just familiarity<br>
of the person who did most of the work. I’ll double check with Ernest to make sure there<br>
wasn’t another reason :)<br>
<div><div><br>
-----------------<br>
Donald Stufft<br>
PGP: 0x6E3CBCE93372DCFA // 7C6B 7C5D 5E2B 6356 A926 F04F 6E3C BCE9 3372 DCFA<br>
<br>
</div></div><br></div></div><div class="im">_______________________________________________<br>
Distutils-SIG maillist - <a href="mailto:Distutils-SIG@python.org" target="_blank">Distutils-SIG@python.org</a><br>
<a href="https://mail.python.org/mailman/listinfo/distutils-sig" target="_blank">https://mail.python.org/mailman/listinfo/distutils-sig</a><br>
<br></div></blockquote></div><br></div>
</blockquote></div><br></div>