Take another swing at noindex metadata

[ConorMacBride]

The sunpy main website, sunpy stable and latest docs all block robots. The following doesn't seem to have the intended effect:

sunpy-sphinx-theme/sunpy_sphinx_theme/sunpy/layout.html

Lines 17 to 19 in 3c7125a

	{% if not version_slug in to_be_indexed | default([]) %}
	<meta name="robots" content="noindex, nofollow" >
	{% endif %}

to_be_indexed seems to be defined here

sunpy-sphinx-theme/sunpy_sphinx_theme/sunpy/theme.conf

Line 21 in 3c7125a

to_be_indexed = ['stable', 'latest']

however I cannot find any reference to version_slug anywhere. Does anyone know if and where version_slug is defined?

[Cadair]

Yeah this doesn't seem to be working. It would probably be better to reverse this logic anyway, so that if no to_be_indexed is defined all versions are indexed.

[nabobalis]

I will remove it and index everything.

[nabobalis]

Its been removed from the theme, now up to each package to deal with it.

[Cadair]

We should keep track of this, as we don't want to have to go and configure it in each sponsored package forever.

Thanks for the hot-fix though.