You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Solve [TASK] using the ReAct format. Alternate between Thought and Action steps:
Thought: [reason about current state]
Action: [specify what you would do or look up]
Observation: [what the action yields]
...repeat until...
Final Answer: [conclusion]
Deployment Guidance
The Thought-Action-Observation loop requires schema maintenance that degrades significantly in 7B models (Mistral: 0.60, near Class III boundary). MedLLaMA-2 approaches Class IV (0.48). Reliable only on frontier and 70B+ models. Best suited for agentic task categories not included in this evaluation set.