noul.md

Noul

A Noul question asks the model to evaluate a yes/no question and return the probability that the answer is yes.

Writing a Noul question

A Noul question evaluates a single yes/no question (or statement). It is defined by its instructions: the yes/no question to evaluate. It's good practice to phrase it so a high probability means "yes", so that the returned answer is unambiguous in its meaning.

You can optionally add criteria with true and false descriptions to clarify what each outcome means, which can be helpful when the question itself has more nuance to explain. Try your Noul question prompts with and without criteria to see which works better in your use-case.

Request

Response

{
  "model": "jev-latest",
  "answers": {
    "is_human_escalation": {
      "type": "noul",
      "noul": 0.99
    },
    "is_repeat_contact": {
      "type": "noul",
      "noul": 0.93
    }
  },
  "usage": {
    "input_tokens": 360,
    "output_tokens": 39
  }
}

noul ranges from 0 to 1, representing the probability that the answer is yes. Most often you will threshold it into a boolean when your code needs a hard decision.

Example questions

"Is the customer requesting a refund?"
"Does this resume mention experience with distributed systems?"
"Does the message contain personally identifiable information?"
"Does the room have a minifridge?"

Tips and advanced usage

• Phrasing. Beyond a plain question, you can phrase the instruction as a statement for the model to evaluate for truthfulness. For "the customer is requesting a refund", a value near 1 means the statement is true. Try both phrasings with your own data to see what works best.
• Optional criteria. The instruction is enough for most Noul questions, but when the boundary between yes and no is subtle, pass criteria with true and false descriptions to pin down what each outcome means.