Crash using Llama on AWS bedrock #894
Description
Crashes with ValueError exception in predict.py - "Required 'max_tokens' or 'max_output_tokens' not specified in settings." if you use Bedrock with llama2 or llama3
{{ message }}
Crashes with ValueError exception in predict.py - "Required 'max_tokens' or 'max_output_tokens' not specified in settings." if you use Bedrock with llama2 or llama3