Jun 18

Model Stability Issue: Variable Errors on Subsequent Prompts

I'm experiencing model stability issues with SARVAM 105B the chat works correctly on the first prompt but then fails on subsequent prompts with errors about "extra/less variables than required." This typically occurs on the second prompt or later in the conversation, causing the model to crash or return error messages instead of generating responses. The expected behavior is consistent performance across all prompts in a conversation, but the actual behavior is a disruption after the initial successful interaction. This significantly impacts user experience and makes the model unreliable for extended conversations.

Closed