Update RCA100

# RCA-100

# RCA-100 v1.1

A benchmark of **103 chaos-drill–injected incidents** across a Kubernetes + OpenTelemetry demo store, with per-task observability dumps and four-layer ground-truth annotations suitable for Root-Cause-Analysis (RCA) agent evaluation.

| **Tasks** | 103 (opaque IDs `t001`..`t103`) |

| **Cluster** | OpenTelemetry demo store on Alibaba Cloud ACK |

| **Modalities** | metrics · logs · traces · events · alerts · topology |

| **Total size** | ~3.4 GB |

| **Total size** | ~3.43 GB |

---

> **v1.1 release note (2026-07-01):** metric entity identifiers/names were backfilled, task alert entities were normalized, ReplicaSet topology labels were corrected, and internal load-test/build identifiers in traces were redacted as `<load-test-agent>` / `<internal-build>`. Task and row counts are unchanged from v1.0.

Public cases: `https://aiops-benchmark.oss-cn-hongkong.aliyuncs.com/rca/rca100/v1.1/`

---

└── answer_key/

    ├── RCA100_ANSWER_KEY_README.md

    ├── mapping.json              (t001..t103 -> canonical case_id)

    ├── taxonomy.json             (fault hierarchy and scoring rubric)

    └── t001.gt.json .. t103.gt.json    (per-case four-layer ground truth)

```

```jsonc

{

  "task_id": "t034",

  "task_version": "1.0",

  "task_version": "v1.1",

  "alert_event_id": "195ff92b621c1d2937d5fcd36e7747fa",

  "alert_title": "inventory接口流量下跌告警",

  "alert_trigger_time": "2026-04-20T11:21:54+08:00",

- `root_cause_types[]` — fault types from the 28-class taxonomy (Identification).

- `raw_ground_truth` — JSON-encoded structured fault chain: `outcome.target_entities`, `reasoning.steps[*]` (typed `cause` / `propagation` / `impact` with per-step `observability` checkpoints carrying `<comparator, value, unit>` numeric constraints).

- `mapping.json` — resolves `t001..t103` to canonical case IDs of the form `F<id>-<faultType>.<transId>`.

- `taxonomy.json` — defines the fault hierarchy and partial-credit scoring rubric.

Scoring: `Final = 0.4 · Entity + 0.3 · Fault + 0.3 · Process`, where Process jointly measures causal-chain node match rate and observability-checkpoint hit rate (numeric condition must match, not merely the metric name).

# RCA-100 v1.0 — Answer Key Package

# RCA-100 v1.1 — Answer Key Package

Generated 2026-05-26 by **Alibaba Cloud AIOps Team**. Contains ground-truth annotations for the 103 RCA-100 v1.0 cases.

Updated for RCA-100 v1.1 by **Alibaba Cloud AIOps Team**. Contains ground-truth annotations for all 103 cases.

## Contents (104 files)

## Contents (106 files, including this README)

- `mapping.json` — task_id (t001..t103) → case_id mapping

- `taxonomy.json` — fault hierarchy and partial-credit scoring rubric

- `t001.gt.json` ... `t103.gt.json` — per-case ground truth (each ~5–9 KB)

## Per-case GT schema (top-level fields)

- `time_range_start`, `time_range_end` — incident window (UTC)

- `root_cause_entities[]` — list of GT root-cause entity names

- `alert_event_id`, `alert_title`, `alert_trigger_time` — triggering alert

- `alert_entity_id`, `alert_entity_type`, `alert_entity_domain` — normalized alert entity fields where available

- `prompt_text` — task prompt (handed to agent at evaluation)

- `raw_ground_truth` — structured fault chain + canonical RCA narrative

## Use

- For agent scoring: do NOT include this in the prompt context. Score against `root_cause_entities` and `raw_ground_truth.fault_type` only.

- For training: cite RCA-100 v1.0 and link to the public dataset URL.

- For training: cite RCA-100 v1.1 and link to the public dataset URL.

- For redistribution: please contact the Alibaba Cloud AIOps Team before sharing publicly.

## Public dataset (no answer key)

- Cases: `oss://aiops-benchmark/rca/rca100/v1.0/cases/` (publicly readable)

- Root docs: `README.md`, `manifest.txt`, `summary.json` at `/rca/rca100/v1.0/` (publicly readable)

- Cases: `oss://aiops-benchmark/rca/rca100/v1.1/cases/` (publicly readable)

- Root docs: `README.md`, `manifest.txt`, `summary.json` at `/rca/rca100/v1.1/` (publicly readable)

- This answer_key/ folder is **no longer publicly readable** as of 2026-05-26; distribute through controlled channels only.

## Contact