simple-repository-browser redirect metadata problem

[Slomo17]

I am trying to setup a simple-repository-server with a simple-repsoitory-browser, but i get the following error. When i start both without the --stream-http-resources flag for the server i can search local and external packages (pypi.org) in the gui, but when i click on an external package no metadata are shown as expacted only an "Internal server error ()". showing local packages work fine. Also installing local and external packages via pip works fine. When using --stream-http-resources everything works. So there must be a problem with the redirection to pypi.org

Here are the logs when trying to search for pandas and clicking on the package:

simple-repository-server   | INFO:httpx:HTTP Request: GET https://pypi.org/simple/pandas/ "HTTP/1.1 200 OK"
simple-repository-server   | INFO:     172.24.0.3:54292 - "GET /simple/pandas/ HTTP/1.1" 200 OK
simple-repository-server   | INFO:httpx:HTTP Request: GET https://pypi.org/simple/pandas/ "HTTP/1.1 200 OK"
simple-repository-server   | INFO:     172.24.0.3:54292 - "GET /simple/pandas/ HTTP/1.1" 200 OK
simple-repository-server   | INFO:httpx:HTTP Request: GET https://pypi.org/simple/pandas/ "HTTP/1.1 200 OK"
simple-repository-server   | INFO:httpx:HTTP Request: HEAD https://files.pythonhosted.org/packages/3d/f7/f425a00df4fcc22b292c6895c6831c0c8ae1d9fac1e024d16f98a9ce8749/pandas-2.3.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata "HTTP/1.1 200 OK"
simple-repository-server   | INFO:     172.24.0.3:54292 - "HEAD /resources/pandas/pandas-2.3.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata HTTP/1.1" 302 Found
simple-repository-browser  | ERROR:simple_repository_browser.error:Unhandled exception
simple-repository-browser  | Traceback (most recent call last):
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/simple_repository/components/http.py", line 186, in get_resource
simple-repository-browser  |     resp.raise_for_status()
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/httpx/_models.py", line 829, in raise_for_status
simple-repository-browser  |     raise HTTPStatusError(message, request=request, response=self)
simple-repository-browser  | httpx.HTTPStatusError: Redirect response '302 Found' for url 'http://simple-repository-server:8000/resources/pandas/pandas-2.3.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata'
simple-repository-browser  | Redirect location: 'https://files.pythonhosted.org/packages/3d/f7/f425a00df4fcc22b292c6895c6831c0c8ae1d9fac1e024d16f98a9ce8749/pandas-2.3.3-cp310-cp310-macosx_10_9_x86_64.whl.metadata'
simple-repository-browser  | For more information check: https://developer.mozilla.org/en-US/docs/Web/HTTP/Status/302
simple-repository-browser  | 
simple-repository-browser  | The above exception was the direct cause of the following exception:
simple-repository-browser  | 
simple-repository-browser  | Traceback (most recent call last):
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/simple_repository_browser/_app.py", line 88, in catch_exceptions_middleware
simple-repository-browser  |     return await call_next(request)
simple-repository-browser  |            ^^^^^^^^^^^^^^^^^^^^^^^^
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 168, in call_next
simple-repository-browser  |     raise app_exc from app_exc.__cause__ or app_exc.__context__
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 144, in coro
simple-repository-browser  |     await self.app(scope, receive_or_disconnect, send_no_error)
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 63, in __call__
simple-repository-browser  |     await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
simple-repository-browser  |     raise exc
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
simple-repository-browser  |     await app(scope, receive, sender)
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in __call__
simple-repository-browser  |     await self.app(scope, receive, send)
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 716, in __call__
simple-repository-browser  |     await self.middleware_stack(scope, receive, send)
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 736, in app
simple-repository-browser  |     await route.handle(scope, receive, send)
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 462, in handle
simple-repository-browser  |     await self.app(scope, receive, send)
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 716, in __call__
simple-repository-browser  |     await self.middleware_stack(scope, receive, send)
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 736, in app
simple-repository-browser  |     await route.handle(scope, receive, send)
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 290, in handle
simple-repository-browser  |     await self.app(scope, receive, send)
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 120, in app
simple-repository-browser  |     await wrap_app_handling_exceptions(app, request)(scope, receive, send)
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
simple-repository-browser  |     raise exc
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
simple-repository-browser  |     await app(scope, receive, sender)
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 106, in app
simple-repository-browser  |     response = await f(request)
simple-repository-browser  |                ^^^^^^^^^^^^^^^^
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 430, in app
simple-repository-browser  |     raw_response = await run_endpoint_function(
simple-repository-browser  |                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 316, in run_endpoint_function
simple-repository-browser  |     return await dependant.call(**values)
simple-repository-browser  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/simple_repository_browser/controller.py", line 181, in project
simple-repository-browser  |     response = t.result()
simple-repository-browser  |                ^^^^^^^^^^
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/simple_repository_browser/model.py", line 240, in project_page
simple-repository-browser  |     info_file, pkg_info = await self.crawler.fetch_pkg_info(
simple-repository-browser  |                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/simple_repository_browser/crawler.py", line 176, in fetch_pkg_info
simple-repository-browser  |     info_file, pkg_info = await package_info(
simple-repository-browser  |                           ^^^^^^^^^^^^^^^^^^^
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/simple_repository_browser/fetch_description.py", line 265, in package_info
simple-repository-browser  |     file, info = await _fetch_metadata_resource(
simple-repository-browser  |                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/simple_repository_browser/fetch_description.py", line 185, in _fetch_metadata_resource
simple-repository-browser  |     resource = await repository.get_resource(project_name, resource_name)
simple-repository-browser  |                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/simple_repository/components/core.py", line 194, in get_resource
simple-repository-browser  |     return await self.source.get_resource(
simple-repository-browser  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/simple_repository/components/metadata_injector.py", line 65, in get_resource
simple-repository-browser  |     return await super().get_resource(
simple-repository-browser  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/simple_repository/components/core.py", line 194, in get_resource
simple-repository-browser  |     return await self.source.get_resource(
simple-repository-browser  |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
simple-repository-browser  |   File "/usr/local/lib/python3.11/site-packages/simple_repository/components/http.py", line 188, in get_resource
simple-repository-browser  |     raise errors.SourceRepositoryUnavailable() from e
simple-repository-browser  | simple_repository.errors.SourceRepositoryUnavailable

i checked the redirected url and it is accessible from my device, is this a browser problem? I tired it with firefox, brave and chrome, same problem on all three.

[pelson]

Thanks for reporting! This is entirely on the server-side, and won't have anything to do with the browser.

It is also a bit strange, since we explicitly setup the http client to follow redirects unconditionally https://github.com/simple-repository/simple-repository-server/blob/abde61874ec4c0be684371c273bf819c785cacf4/simple_repository_server/__main__.py#L109, yet clearly it isn't following a 302.

Indeed, if I dig deeper, I can see that the http client in https://github.com/simple-repository/simple-repository-browser/blob/main/simple_repository_browser/_app.py#L56 is not being setup correctly.

OK, so I identified the issue and was able to reproduce locally.

I have made a fix in simple-repository/simple-repository-browser#38, which is available as v0.10.0 (https://pypi.org/project/simple-repository-browser/0.10.0/).

Please let me know how you get on with it.

[Slomo17]

That was quick, thanks its working now.