inspect_evals
Copyright 2024 UK AI Security Institute

This product is licensed under the MIT License. It includes code from
third-party projects licensed under the Apache License, Version 2.0,
the full text of which is included in third-party-licenses/Apache-2.0.txt.
Copyright notices for those components are listed below.

---

BBEH (BigBench Extra Hard)
Copyright 2025 Google LLC
Source: https://github.com/google-deepmind/bbeh

Included in: src/inspect_evals/bbeh/utils.py

---

GDM In-House CTF
Copyright 2024 DeepMind Technologies Limited

Included in:
  src/inspect_evals/gdm_in_house_ctf/challenges/spray/app.py
  src/inspect_evals/gdm_in_house_ctf/challenges/idor/app.py
  src/inspect_evals/gdm_in_house_ctf/challenges/sqli/app.py
  src/inspect_evals/gdm_in_house_ctf/challenges/cmd_injection/app.py

---

GDM In-House CTF
Copyright 2024 Google LLC

Included in:
  src/inspect_evals/gdm_in_house_ctf/challenges/pw_reuse/db.sql
  src/inspect_evals/gdm_in_house_ctf/challenges/db_3/db.sql
  src/inspect_evals/gdm_in_house_ctf/challenges/sqli/app.sql

---

SciCode
Copyright 2024 The SciCode Authors
Source: https://github.com/scicode-bench/SciCode

Included in (adapted):
  src/inspect_evals/scicode/process_data.py
    (adapted from https://github.com/scicode-bench/SciCode/blob/main/src/scicode/parse/parse.py)
  src/inspect_evals/scicode/test_util.py
    (adapted from https://github.com/scicode-bench/SciCode/blob/main/src/scicode/compare/cmp.py)

---

GAIA Benchmark Scorer
Copyright 2023 The GAIA Benchmark Authors
Source: https://huggingface.co/spaces/gaia-benchmark/leaderboard/blob/main/scorer.py

Included in (partially copied): src/inspect_evals/gaia/scorer.py

---

HELM (Holistic Evaluation of Language Models)
Copyright 2022 Stanford CRFM
Source: https://github.com/stanford-crfm/helm

Included in (partially copied): src/inspect_evals/air_bench/air_bench.py

---

Gorilla (Berkeley Function Call Leaderboard)
Copyright 2023 The Gorilla Authors
Source: https://github.com/ShishirPatil/gorilla

Included in (partially copied):
- src/inspect_evals/bfcl/data.py
- src/inspect_evals/bfcl/score/scorer.py
- src/inspect_evals/bfcl/score/multi_turn_scorer.py
- src/inspect_evals/bfcl/solve/single_turn_solver.py
- src/inspect_evals/bfcl/solve/multi_turn_solver.py
- src/inspect_evals/bfcl/utils/task_categories.py
- src/inspect_evals/bfcl/utils/function_parsing.py
- src/inspect_evals/bfcl/backends/loader.py
- src/inspect_evals/bfcl/backends/downloader.py
- src/inspect_evals/bfcl/prompts.py

---

HuggingFace Datasets
Copyright 2020 The HuggingFace Datasets Authors and the current dataset script contributor.

Included in:
  src/inspect_evals/piqa/huggingface_artifact/piqa.py
  src/inspect_evals/apps/huggingface_artifact/apps.py

---

HuggingFace Datasets
Copyright 2022 The HuggingFace Datasets Authors and the current dataset script contributor.

Included in:
  src/inspect_evals/medqa/huggingface_artifact/med_qa.py

---

TensorFlow Datasets / HuggingFace Datasets
Copyright 2020 The TensorFlow Datasets Authors and the HuggingFace Datasets Authors.

Included in:
  src/inspect_evals/abstention_bench/recipe/abstention_datasets/huggingface_artifact/situated_qa.py

---

TensorFlow Datasets / HuggingFace Datasets
Copyright 2022 The TensorFlow Datasets Authors and the HuggingFace Datasets Authors.

Included in:
  src/inspect_evals/abstention_bench/recipe/abstention_datasets/huggingface_artifact/qasper.py

---

APE (Attempt to Persuade Eval)
Copyright 2025 Alignment Research Center
Source: https://github.com/AlignmentResearch/AttemptPersuadeEval

Included in (adapted):
  src/inspect_evals/ape/prompts.py
  src/inspect_evals/ape/utils.py

---

latch-eval-tools
Copyright LatchBio
Source: https://github.com/latchbio/latch-eval-tools

Included in (adapted):
  src/inspect_evals/scbench/graders/base.py
  src/inspect_evals/scbench/graders/numeric.py
  src/inspect_evals/scbench/graders/marker_gene.py
  src/inspect_evals/scbench/graders/distribution.py
  src/inspect_evals/scbench/graders/label_set.py
  src/inspect_evals/scbench/graders/multiple_choice.py
  src/inspect_evals/scbench/graders/spatial.py
