Voice Agents Under Acoustic Stress: From Signal Degradation to Interaction and Action

Recording

Timers and Such v1.0, dev-real/anonymous0_24.wav. Mono, 16 kHz, 28,989 samples (1.8118125 seconds) in every comparison file.

Shared attenuation

All three files use gain 0.908076 (about −0.84 dB), followed by the same PCM16 export. This preserves relative levels without clipping; it does not equalize the clips’ loudness. “Original speech” is a comparison copy of the untouched source recording. These exact PCM16 files are the model inputs specified for this gallery.

Marked number

Samples [15461, 18682), or 0.9663125–1.167625 seconds. Start inclusive; end exclusive. These are historical automatic forced-alignment estimates, not human phonetic annotations. The silenced condition sets this interval to zero and retains the duration.

Machinery event

The complete released 0.75-second Holman nc4 event spans samples [14934, 26934), or 0.933375–1.683375 seconds. It overlaps the duration phrase, including part of “minutes.” The creator’s released recording includes mastering and beat-length editing.

Local SNR

−10 dB, calibrated from speech and added-noise energy only within the marked number interval, before their shared attenuation. After PCM16 export: −9.9999966 dB. This is neither whole-recording SNR nor physical sound pressure. No SNR applies to the silenced condition.

Input review

Human listening and a residual-cue audit remain pending. No model response determined the segment boundaries or machinery selection. The visible transcript is for visitors; it is not model input.

Frozen requests

Qwen3-Omni-30B-A3B-Instruct; model and processor revision 26291f793822fb6be9555850f06dfe95f2d7e695. Each request uses a fresh conversation and seed 1234, Thinker audio input with text output, BF16, SDPA, and batch size one. Sampling: temperature 0.6, top-p 0.95, top-k 20, maximum 256 new tokens. The model receives only the audio waveform and generic timer prompt/tool schema, with the neutral input.wav placeholder. See the complete generation settings and frozen request manifest. No model is loaded by this page.

Exact SHA-256 values for the PCM16 files:

• Original speech: f12141a1dfefa3d3a90066b85d5f0dcb4bc60e07f1238efaa7c5fbe9017dbcad
• Machinery noise: e11df5ec40467079404ec9dd583803371ef69be2559f2de84a1a50d81625509f
• Number segment silenced: 05785e5e0d8401fdbda697dfd9838251b4369a0d1c4e1774b38f9235a3443bf5

Original preparation manifest (before inference) · Saved gallery evidence states

S1 · Correct timer without clarification

[
  {
    "t": 0,
    "type": "user_instruction",
    "duration_available": true
  },
  {
    "t": 1,
    "type": "timer_created",
    "timer_id": "timer_1",
    "duration_seconds": 540,
    "execution": "scripted_inert_simulation"
  }
]

S2 · Clarification followed by the correct timer

[
  {
    "t": 0,
    "type": "user_instruction",
    "duration_available": false
  },
  {
    "t": 1,
    "type": "agent_clarification",
    "text": "How many minutes?"
  },
  {
    "t": 2,
    "type": "user_reply",
    "duration_seconds": 540
  },
  {
    "t": 3,
    "type": "timer_created",
    "timer_id": "timer_1",
    "duration_seconds": 540,
    "execution": "scripted_inert_simulation"
  }
]

S3 · Wrong timer cancelled and replaced after correction

[
  {
    "t": 0,
    "type": "user_instruction",
    "duration_available": true
  },
  {
    "t": 1,
    "type": "timer_created",
    "timer_id": "timer_wrong",
    "duration_seconds": 360,
    "execution": "scripted_inert_simulation"
  },
  {
    "t": 2,
    "type": "user_correction",
    "duration_seconds": 540
  },
  {
    "t": 3,
    "type": "timer_cancelled",
    "timer_id": "timer_wrong"
  },
  {
    "t": 4,
    "type": "timer_created",
    "timer_id": "timer_correct",
    "duration_seconds": 540,
    "execution": "scripted_inert_simulation"
  }
]

S4 · Clarification requested; user declines to continue

[
  {
    "t": 0,
    "type": "user_instruction",
    "duration_available": false
  },
  {
    "t": 1,
    "type": "agent_clarification",
    "text": "How many minutes?"
  },
  {
    "t": 2,
    "type": "user_refusal",
    "text": "Never mind."
  }
]

S5 · Correct duration guessed before it is obtained

[
  {
    "t": 0,
    "type": "user_instruction",
    "duration_available": false
  },
  {
    "t": 1,
    "type": "timer_created",
    "timer_id": "timer_1",
    "duration_seconds": 540,
    "execution": "scripted_inert_simulation"
  }
]

Event fixtures and hand-calculated expectations · Computed scores, violations, and final states

Exceeding a time or turn limit prevents goal attainment and task success. Budget failures are reported separately from prohibited actions. Invalid event sequences are rejected explicitly. Only inert timers in local memory are used.

3 of 3 first-response records are available. Saved records are checked against the exact audio hash, model and processor revisions, generic prompt, resolved settings, seed 1234, and pinned runtime. Human-review flags remain pending. No parsed timer proposal is executed, and first responses are not passed through the conversation scorer.

The download includes a separate optional GPU entry point and pinned runtime instructions. The two CPU commands above do not install or load model dependencies. GPU reproduction needs the specified 96 GB RTX PRO 6000 and a separately obtained pinned model snapshot.