Search results

Question: unused fact extraction in event ordering evaluation

Status: Open.

#9 In mohammadtavakoli78/BEAM;

· edwinyyyu opened on Apr 14, 2026

int() conversion silently drops 0.5 partial-credit scores in 9 of 10 rubric evaluators

Status: Open.

#8 In mohammadtavakoli78/BEAM;

· edwinyyyu opened on Apr 13, 2026

Potential source-of-truth mismatch in 10M/1 knowledge_update[1]: gold answer appears to depend on plan_new.txt, not chat.json

Status: Open.

#7 In mohammadtavakoli78/BEAM;

· yursil opened on Apr 11, 2026

Disputed gold label: contradiction_resolution[0] in chat 100K/1 — question tests supersession, not contradiction

Status: Open.

#6 In mohammadtavakoli78/BEAM;

· yursil opened on Apr 8, 2026

Disputed gold label: abstention[1] in chat 100K/1 — 'background and previous development projects' is answerable

Status: Open.

#5 In mohammadtavakoli78/BEAM;

· yursil opened on Apr 8, 2026

Disputed gold label: abstention[0] in chat 100K/1 - feedback definition ambiguity

Status: Open.

#4 In mohammadtavakoli78/BEAM;

· yursil opened on Apr 8, 2026