A consistency probe from a notebook comparing TypeSafe's Jev decision model with OpenAI's GPT-6 Luna, called two ways: through its decision head (the Decisions API) and through ordinary chat completions at temperature 0. All three were called through OpenRouter, classifying short assistant queries into one of 150 intents from the CLINC150 dataset.
- Pick the queries from earlier results, not by hand. From a first run over 2,000 CLINC150 test queries, take two that Jev answered with top probability 0.99 or higher (confident) and three it scored between 0.45 and 0.65
