[docs] How to preview ReST documentation changes?

I can't seem to find a simple how-to on this anywhere. I just want to make some changes to the Python docs and view them before submitting a patch. I understand I need to use Sphinx, but how exactly to do this (including how to configure it properly for the Python docs format) I just can't tell.