The same sentence. A different choice order.

Change the system, sentence, and choice order. The bars show the mean native score from three recorded calls. These invented examples are separate from the main study.

I don't understand why this is still not ready; I need it today.

Choice order in the request

  1. 1. Confusion
  2. 2. Frustration
  3. 3. Sadness
  4. 4. Disapproval
  5. 5. Anxiety
  6. 6. Distrust
  7. 7. Positive

Scores by emotion

Mean score from three calls. Changes are in percentage points from order 1.

  • Frustration70.3%Change from order 1: 0.0 pp
  • Disapproval0.0%Change from order 1: 0.0 pp
  • Sadness0.0%Change from order 1: 0.0 pp
  • Confusion13.0%Change from order 1: 0.0 pp
  • Anxiety16.3%Change from order 1: 0.0 pp
  • Distrust0.0%Change from order 1: 0.0 pp
  • Positive0.0%Change from order 1: 0.0 pp
Largest emotion range across all 14 order means: 21.000 percentage points.

Jev 1.14.0. Sentence 3. Order 1 of 14. Largest emotion range: 21.000 percentage points.

View the fixed question and emotion definitions

Which emotion family best describes the user's reaction to an AI assistant in this sentence? Choose the best match among the seven supplied families. Judge only the user's words. Use each family's supplied definition.

Frustration
Annoyance or hostility toward the assistant or its work, including anger, repeated-mistake exasperation, insults, profanity, sarcasm, or requests to escalate because of the assistant.
Disapproval
Calm rejection of the assistant's work or proposal without annoyance or hostility. A plain edit instruction alone is not disapproval.
Sadness
Disappointment with the assistant's result, resignation or giving up on the task, self-blame, or personal distress expressed in the exchange.
Confusion
Not understanding the assistant's message, work, state, or behavior.
Anxiety
Worry or time pressure directed at the assistant or its actions. A deadline mentioned without worry or pressure is not enough.
Distrust
Distrust: doubt about the assistant's honesty, accuracy, claims, or whether it did what it said.
Positive
Gratitude to the assistant, satisfaction with its work, or delight at its output.

The 14 orders rotate a seeded base order and its reverse. Every emotion appears twice at each position. These are recorded scores for invented examples. The seven scores share one probability mass. Native prompt formats and calibration differ across systems.

Back to the research post