Issues

• [Proposal]: Report task structure and student workload as Tier 1 metrics

  enhancement
  ls1intum/exgen-bench#67 · Filter by author HawKhiem opened on Oct 27, 2026

• [Proposal]: apply the oracle gate to gradable tests only

  enhancement
  ls1intum/exgen-bench#57 · Filter by author HawKhiem opened on Oct 26, 2026
  1

• [Proposal]: Revise H1 thresholds that current Tier 1 metrics cannot measure

  enhancement
  ls1intum/exgen-bench#51 · Filter by author HawKhiem opened on Oct 26, 2026

• [Proposal]: Tier 1 model-assisted: may the model decide the outcome, or only the tests?

  enhancement
  ls1intum/exgen-bench#50 · Filter by author HawKhiem opened on Oct 26, 2026
  1

• [Proposal]: Decide the validation protocol for the Tier 2 judge

  enhancement
  ls1intum/exgen-bench#48 · Filter by author HawKhiem opened on Oct 26, 2026
  2

• Dependency Dashboard

  ls1intum/exgen-bench#46 · Filter by author renovate opened on Oct 9, 2026

• Harden LocalCI timeout/infra detection beyond a build-log string match

  ls1intum/exgen-bench#27 · Filter by author spethso opened on Aug 25, 2026
  

• Re-verify M2 (java-oracle LocalCI) against a hosted Artemis deployment

  ls1intum/exgen-bench#25 · Filter by author spethso opened on Aug 25, 2026

• WP2c: container BuildBackend for coverage, mutation, and differential testing

  ls1intum/exgen-bench#24 · Filter by author spethso opened on Aug 25, 2026

• A corpus run cannot be evaluated or re-scored by any repository command

  ls1intum/exgen-bench#17 · Filter by author FelixTJDietrich opened on Aug 6, 2026

• Multi-language generation is blocked on the system under test

  ls1intum/exgen-bench#12 · Filter by author FelixTJDietrich opened on Aug 1, 2026

• The independent evaluator suite does not exist

  ls1intum/exgen-bench#11 · Filter by author FelixTJDietrich opened on Aug 1, 2026

• Generator-visible fixture is never digested or compared across a pair

  ls1intum/exgen-bench#9 · Filter by author FelixTJDietrich opened on Aug 1, 2026

• Component digests are declared, never resolved or recorded

  ls1intum/exgen-bench#8 · Filter by author FelixTJDietrich opened on Aug 1, 2026

• Percentile cluster bootstrap under-covers below ~40 clusters

  ls1intum/exgen-bench#7 · Filter by author FelixTJDietrich opened on Aug 1, 2026