[Bug]: LiteLLMProxy no longer show the list of models to the users

[mbeltagy]

What happened?

In the most recent update to liteLLM proxy, only the admin can the under "Model + Endpoints"... normal users get a blank page now matter which option they choose. View: Current Team Models or View: All Available Models

Relevant log output

litellm-proxy     | 10:34:21 - LiteLLM Proxy:ERROR: auth_exception_handler.py:79 - litellm.proxy.proxy_server.user_api_key_auth(): Exception occured - Only proxy admin can be used to generate, delete, update info for new keys/users/teams. Route=/schedule/model_cost_map_reload/status. Your role=internal_user. Your user_id=e3fd90****************************f9
litellm-proxy     | Requester IP Address:172.24.0.1
litellm-proxy     | Traceback (most recent call last):
litellm-proxy     |   File "/usr/lib/python3.13/site-packages/litellm/proxy/auth/user_api_key_auth.py", line 1143, in _user_api_key_auth_builder
litellm-proxy     |     _ = await common_checks(
litellm-proxy     |         ^^^^^^^^^^^^^^^^^^^^
litellm-proxy     |     ...<11 lines>...
litellm-proxy     |     )
litellm-proxy     |     ^
litellm-proxy     |   File "/usr/lib/python3.13/site-packages/litellm/proxy/auth/auth_checks.py", line 247, in common_checks
litellm-proxy     |     _is_route_allowed = _is_allowed_route(
litellm-proxy     |         route=route,
litellm-proxy     |     ...<4 lines>...
litellm-proxy     |         valid_token=valid_token,
litellm-proxy     |     )
litellm-proxy     |   File "/usr/lib/python3.13/site-packages/litellm/proxy/auth/auth_checks.py", line 369, in _is_allowed_route
litellm-proxy     |     return _is_api_route_allowed(
litellm-proxy     |         route=route,
litellm-proxy     |     ...<3 lines>...
litellm-proxy     |         user_obj=user_obj,
litellm-proxy     |     )
litellm-proxy     |   File "/usr/lib/python3.13/site-packages/litellm/proxy/auth/auth_checks.py", line 324, in _is_api_route_allowed
litellm-proxy     |     RouteChecks.non_proxy_admin_allowed_routes_check(
litellm-proxy     |     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
litellm-proxy     |         user_obj=user_obj,
litellm-proxy     |         ^^^^^^^^^^^^^^^^^^
litellm-proxy     |     ...<4 lines>...
litellm-proxy     |         valid_token=valid_token,
litellm-proxy     |         ^^^^^^^^^^^^^^^^^^^^^^^^
litellm-proxy     |     )
litellm-proxy     |     ^
litellm-proxy     |   File "/usr/lib/python3.13/site-packages/litellm/proxy/auth/route_checks.py", line 245, in non_proxy_admin_allowed_routes_check
litellm-proxy     |     RouteChecks._raise_admin_only_route_exception(
litellm-proxy     |     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^
litellm-proxy     |         user_obj=user_obj, route=route
litellm-proxy     |         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
litellm-proxy     |     )
litellm-proxy     |     ^
litellm-proxy     |   File "/usr/lib/python3.13/site-packages/litellm/proxy/auth/route_checks.py", line 142, in _raise_admin_only_route_exception
litellm-proxy     |     raise Exception(
litellm-proxy     |         f"Only proxy admin can be used to generate, delete, update info for new keys/users/teams. Route={route}. Your role={user_role}. Your user_id={masked_user_id}"
litellm-proxy     |     )
litellm-proxy     | Exception: Only proxy admin can be used to generate, delete, update info for new keys/users/teams. Route=/schedule/model_cost_map_reload/status. Your role=internal_user.

Are you a ML Ops Team?

Yes

What LiteLLM version are you on ?

v1.80.7

Twitter / LinkedIn details

No response

[NoAchache]

Hello, any update on that bug?

[yuneng-jiang]

Hey sorry I missed this the first time around. Trying to get more information as I do not see this on my end.

blank page

By this do you mean the entire page is blank or just no models showing on the table?

The log output you included should not affect the models page. Instead would you (or anyone else affected) be able to include their network tab errors in their browser so I can triage better?

[agbragin]

We're affected by the issue as well.

[Inthuson]

I got the same issue. The models are available from the Playground and I can see it in the AI Hub but not in the Models + Endpoints tab.

Okay looks like the master admin has access to all the models via config.yaml and db. Although users in the 'proxy_admin' group can select and invoke via the Playground. They can only see it in the Model Hub and not Models + Endpoints.

[yuneng-jiang]

The table gets its data from v2/model/info, can anyone include their network tab's response from this endpoint?

[yciabaud]

Hello, running the v1.81.3 here, we have the same issue. The v2/model/info sets include_team_models=true and my internal users are not assigned to a team. Calling it with include_team_models=false or without include_team_models is listing the models as expected.
I wil ltry to set a team to see if it fixes this.

Samples:

GET /v2/model/info?include_team_models=true&page=1&size=50
{"data":[],"total_count":0,"current_page":1,"total_pages":0,"size":50}

GET /v2/model/info?include_team_models=false&page=1&size=50
{"data":[{"model_name":"bedrock-mistral-7b","litellm_params":{"aws_region_name":"eu-west-3","use_in_pass_through":false,"use_litellm_proxy":false,"merge_reasoning_content_in_choices":false,"model":"bedrock/mistral.mistral-7b-instruct-v0:2"},"model_info":{"id":"a77148226777c7070afbde7bc212ef9de046603521a05bf5d25568c59c7d92b4","db_model":false,"key":"mistral.mistral-7b-instruct-v0:2","max_tokens":8191,"max_input_tokens":32000,"max_output_tokens":8191,"input_cost_per_token":1.5e-07,"input_cost_per_token_flex":null,"input_cost_per_token_priority":null,"cache_creation_input_token_cost":null,"cache_creation_input_token_cost_above_200k_tokens":null,"cache_read_input_token_cost":null,"cache_read_input_token_cost_above_200k_tokens":null,"cache_read_input_token_cost_flex":null,"cache_read_input_token_cost_priority":null,"cache_creation_input_token_cost_above_1hr":null,"input_cost_per_character":null,"input_cost_per_token_above_128k_tokens":null,"input_cost_per_token_above_200k_tokens":null,"input_cost_per_query":null,"input_cost_per_second":null,"input_cost_per_audio_token":null,"input_cost_per_image_token":null,"input_cost_per_image":null,"input_cost_per_audio_per_second":null,"input_cost_per_video_per_second":null,"input_cost_per_token_batches":null,"output_cost_per_token_batches":null,"output_cost_per_token":2e-07,"output_cost_per_token_flex":null,"output_cost_per_token_priority":null,"output_cost_per_audio_token":null,"output_cost_per_character":null,"output_cost_per_reasoning_token":null,"output_cost_per_token_above_128k_tokens":null,"output_cost_per_character_above_128k_tokens":null,"output_cost_per_token_above_200k_tokens":null,"output_cost_per_second":null,"output_cost_per_video_per_second":null,"output_cost_per_image":null,"output_cost_per_image_token":null,"output_vector_size":null,"citation_cost_per_token":null,"tiered_pricing":null,"litellm_provider":"bedrock","mode":"chat","supports_system_messages":null,"supports_response_schema":null,"supports_vision":null,"supports_function_calling":null,"supports_tool_choice":true,"supports_assistant_prefill":null,"supports_prompt_caching":null,"supports_audio_input":null,"supports_audio_output":null,"supports_pdf_input":null,"supports_embedding_image_input":null,"supports_native_streaming":null,"supports_web_search":null,"supports_url_context":null,"supports_reasoning":null,"supports_computer_use":null,"search_context_cost_per_query":null,"tpm":null,"rpm":null,"ocr_cost_per_page":null,"annotation_cost_per_page":null,"supported_openai_params":["max_tokens","temperature","top_p","stop","stream"]}},

...

,"total_count":23,"current_page":1,"total_pages":1,"size":50}

[yciabaud]

I can confirm that assigning a user to a team is a workaround for this bug

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

[mbeltagy]

The page is empty

I get those errors looking at the console:

   Failed to get proxy config for general_settings: Error: Authentication Error, Only proxy admin can be used   
 to generate, delete, update info for new keys/users/teams. Route=/config/list. Your role=internal_user. Your   
 user_id=[REDACTED]                                                                                             
   NextJS 9                                                                                                     
   75ee9aba04c74e23.js:1:7995                                                                                   
       NextJS 190                                                                                               
   Failed to create key: ApiError: Authentication Error, Only proxy admin can be used to generate, delete,      
 update info for new keys/users/teams. Route=/credentials. Your role=internal_user. Your user_id=[REDACTED]     
       NextJS 9                                                                                                 
   39f15eb671ac68ef.js:143:29678                                                                                
   Failed to get in-product nudges: ApiError: Authentication Error, Only proxy admin can be used to generate,   
 delete, update info for new keys/users/teams. Route=/in_product_nudges. Your role=internal_user. Your          
 user_id=[REDACTED]                                                                                             
       NextJS 9                                                                                                 
   39f15eb671ac68ef.js:143:1869                                                                                 
   Failed to fetch in-product nudges: ApiError: Authentication Error, Only proxy admin can be used to generate, 
 delete, update info for new keys/users/teams. Route=/in_product_nudges. Your role=internal_user. Your          
 user_id=[REDACTED]                                                                                             
       NextJS 9                                                                                                 
   a4315c6eaf401064.js:677:255584                                                                               
   XHRGET                                                                                                       
   https://[REDACTED_HOST]/__next._tree.txt?_rsc=1r34m                                                          
   [HTTP/2 404  152ms]                                                                                          
                                                                                                                
   XHRGET                                                                                                       
   https://[REDACTED_HOST]/get/config/callbacks                                                                 
   [HTTP/2 401  602ms]                                                                                          
                                                                                                                
   Failed to get callbacks: ApiError: Authentication Error, Only proxy admin can be used to generate, delete,   
 update info for new keys/users/teams. Route=/get/config/callbacks. Your role=internal_user. Your               
 user_id=[REDACTED]                                                                                             
       NextJS 9                                                                                                 
   39f15eb671ac68ef.js:143:37725                                                                                
   Error fetching model data: ApiError: Authentication Error, Only proxy admin can be used to generate, delete, 
 update info for new keys/users/teams. Route=/get/config/callbacks. Your role=internal_user. Your               
 user_id=[REDACTED]                                                                                             
       NextJS       

[oliver124810]

I have the same issue:

litellm-1     |   File "/app/.venv/lib/python3.13/site-packages/litellm/proxy/auth/route_checks.py", line 241, in _raise_admin_only_route_exception
litellm-1     |     raise Exception(
litellm-1     |         f"Only proxy admin can be used to generate, delete, update info for new keys/users/teams. Route={route}. Your role={user_role}. Your user_id={masked_user_id}"
litellm-1     |     )
litellm-1     | Exception: Only proxy admin can be used to generate, delete, update info for new keys/users/teams. Route=/config/list. Your role=internal_user. Your user_id=67b713****************************b5
litellm-1     | INFO:     172.21.0.1:42496 - "GET /config/list?config_type=general_settings HTTP/1.1" 401 Unauthorized
litellm-1     | 10:56:57 - LiteLLM Proxy:ERROR: auth_exception_handler.py:97 - litellm.proxy.proxy_server.user_api_key_auth(): Exception occured - Only proxy admin can be used to generate, delete, update info for new keys/users/teams. Route=/credentials. Your role=internal_user. Your user_id=67b713****************************b5

I have only internal users and they are all assigned to a team, so the mentioned workaround does not help.

This used to work, so I assume it was triggered by a recent update.