You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Traceback (most recent call last):
File "/home/agl/.local/bin/alpaca_eval", line 8, in
sys.exit(main())
File "/home/agl/.local/lib/python3.9/site-packages/alpaca_eval/main.py", line 468, in main
fire.Fire(ALL_FUNCTIONS)
File "/usr/local/conda/lib/python3.9/site-packages/fire/core.py", line 141, in Fire
component_trace = _Fire(component, args, parsed_flag_args, context, name)
File "/usr/local/conda/lib/python3.9/site-packages/fire/core.py", line 475, in _Fire
component, remaining_args = _CallAndUpdateTrace(
File "/usr/local/conda/lib/python3.9/site-packages/fire/core.py", line 691, in _CallAndUpdateTrace
component = fn(*varargs, **kwargs)
File "/home/agl/.local/lib/python3.9/site-packages/alpaca_eval/main.py", line 106, in evaluate
leaderboard = utils.get_precomputed_leaderboard(precomputed_leaderboard, reference_outputs, annotators_config)
File "/home/agl/.local/lib/python3.9/site-packages/alpaca_eval/utils.py", line 391, in get_precomputed_leaderboard
leaderboard = load_or_convert_to_dataframe(precomputed_leaderboard).to_dict(orient="index")
File "/home/agl/.local/lib/python3.9/site-packages/alpaca_eval/utils.py", line 264, in load_or_convert_to_dataframe
if isinstance(df, AnyPath):
File "/usr/local/conda/lib/python3.9/typing.py", line 720, in instancecheck
return self.subclasscheck(type(obj))
File "/usr/local/conda/lib/python3.9/typing.py", line 723, in subclasscheck
raise TypeError("Subscripted generics cannot be used with"
TypeError: Subscripted generics cannot be used with class and instance checks
I get the above error when i run alpaca_eval evaluate --model_outputs 'example/outputs.json'.Can you tell me why this is?
The text was updated successfully, but these errors were encountered:
I get the above error when i run
alpaca_eval evaluate --model_outputs 'example/outputs.json'
.Can you tell me why this is?The text was updated successfully, but these errors were encountered: