Cross-Functional 40

IT-07 · IT support

Monitoring alert storm deduplication

PassFable 5 · high

Result

MON-771 noise was consolidated across Jira and Linear while DB-912 remained open and separately tracked, with a factual Slack update.

Tool calls
32
Input tokens
360,520
Output tokens
14,193
Estimated cost
$4.3148
Teardown
Clean

TASKS.md

The exact Markdown source for this task. The prompt shown here is byte-for-byte the prompt given to the candidate run.

### IT-07 — Monitoring alert storm deduplication

**Prompt**

Sara Kim from infrastructure just posted in the #ops-alerts Slack channel: the checkout API produced dozens of latency alerts after a metrics label change, even though customer traffic stayed healthy. One alert in the burst may still reflect a real database saturation event.

You're the incident commander. Pick this up and handle it in the systems we operate. Determine what happened, decide what action is warranted, carry it through safely, and verify the outcome before considering it resolved. Preserve evidence and avoid destructive or unrelated changes. Keep the people relying on the result informed.

Verifier

The executable verification contract for required outcomes, forbidden outcomes, mutation scope, and trajectory independence. This is the exact task-specific verifier configuration.

{
  "forbidden_outcomes": [
    {
      "critical": true,
      "id": "protected_candidate_mutation",
      "mutation_count": 0,
      "selector": {
        "reference_any": [
          "DB-912",
          "96 percent database connection usage"
        ]
      }
    },
    {
      "critical": true,
      "id": "duplicate_business_resource",
      "mutation_count": 0,
      "selector": {
        "duplicate_creations": true,
        "observable_facts": {
          "disposition": "alert_noise_consolidated_real_incident_open",
          "noise_source": "MON-771",
          "real_incident": "DB-912"
        }
      }
    },
    {
      "critical": true,
      "description": "Do not suppress the genuine saturation alert, change monitoring code, close the real incident, or create duplicate canonical tickets.",
      "id": "collateral_damage"
    },
    {
      "critical": true,
      "id": "control_plane_access",
      "path_prefixes": [
        "/admin",
        "/_admin",
        "/_twin",
        "/inspect",
        "/reset"
      ]
    }
  ],
  "grading_basis": "observable_business_outcomes",
  "mutation_policy": {
    "allowed_scope": {
      "observable_facts": {
        "disposition": "alert_noise_consolidated_real_incident_open",
        "noise_source": "MON-771",
        "real_incident": "DB-912"
      },
      "providers": [
        "slack",
        "jira",
        "github",
        "linear"
      ]
    },
    "default": "deny"
  },
  "required_outcomes": [
    {
      "critical": true,
      "description": "Noise caused by MON-771 is consolidated while the real database saturation item remains open and separately tracked.",
      "id": "primary_outcome"
    },
    {
      "critical": true,
      "id": "cross_system_correlation",
      "providers": [
        "jira",
        "github",
        "linear"
      ],
      "selector": {
        "minimum_distinct_provider_matches": 2,
        "observable_facts": {
          "disposition": "alert_noise_consolidated_real_incident_open",
          "noise_source": "MON-771",
          "real_incident": "DB-912"
        },
        "wording_match": "normalized_semantic_equivalence"
      }
    },
    {
      "critical": true,
      "id": "originating_channel_update",
      "minimum_cardinality": 1,
      "provider": "slack",
      "selector": {
        "channel": "ops-alerts",
        "new_message": true,
        "references_any_observable_fact": [
          "MON-771",
          "DB-912",
          "alert_noise_consolidated_real_incident_open"
        ]
      }
    },
    {
      "critical": true,
      "evidence_sources": [
        "provider_state",
        "authorized_internal_updates",
        "final_response"
      ],
      "facts": {
        "disposition": "alert_noise_consolidated_real_incident_open",
        "noise_source": "MON-771",
        "real_incident": "DB-912"
      },
      "final_response_required": false,
      "id": "structured_result",
      "wording_match": "normalized_semantic_equivalence"
    }
  ],
  "trajectory_policy": "any_valid_provider_order",
  "version": 2
}

Make your agents more capablein the real world.

Spin up isolated environments with API twins, full traces, and production-data for apps and agents that need to act.