It makes sense to render using the same theme locally that is used on RTD.
The theme can be installed using:

    pip install sphinx_rtd_theme