4 × NVIDIA H100 (94 GB), one node of the Capella HPC cluster
Thinking
Default: on, with effort high (75 on the model's scale from 1 to 100).
reasoning_effort: low (= 50), high (= 75), xhigh (= 75, the same as high) and max (= 100).
minimal and medium are rejected with error 400.
Numeric effort from 1 to 100: yes, but only as chat_template_kwargs: {"reasoning_effort": 30}.
A number in reasoning_effort itself is rejected with error 400.
In our tests the effort changed the amount of thinking only a little.
Turn off: reasoning_effort: "none" (no effort value at all), chat_template_kwargs: {"enable_thinking": false}
or chat_template_kwargs: {"thinking": false}.