`inputs` tokens + `max_new_tokens` must be <= 2048.
-
Tech
Input validation error: `inputs` tokens + `max_new_tokens` must be <= 2048.
I have deployed Mistral on Sagemaker using the Huggignface image. I am getting good response for small input prompts. when…
Read More »