Skip to content

Task 02E: resolution typology + ILS pilot on event-resolved markets#5

Merged
MaksymDS merged 4 commits into
masterfrom
task02e/resolution-typology
Apr 27, 2026
Merged

Task 02E: resolution typology + ILS pilot on event-resolved markets#5
MaksymDS merged 4 commits into
masterfrom
task02e/resolution-typology

Conversation

@MaksymDS
Copy link
Copy Markdown
Contributor

Summary

  • Phase 1: fflow/scoring/resolution_type.py — heuristic classifier returning event_resolved / deadline_resolved / surprise_resolved / unclassifiable. Migration 0005 adds resolution_type column to markets.
  • Phase 2: Classified 11,200 markets (vol≥50K, target categories): event_resolved=1145 (10.2%), deadline_resolved=1224 (10.9%, 0% YES rate — validates classifier), unclassifiable=8831 (78.8%). Report: RESOLUTION_TYPOLOGY_DISTRIBUTION.md
  • Phase 3: Ran UMA collector on 1,145 event_resolved markets. Result: 0 evidence URLs. All event_resolved markets are Polymarket admin-resolved (no UMA). Architectural finding documented in EVENT_RESOLVED_UMA_COVERAGE.md.
  • Phase 4: Skipped — no article-quality evidence URLs exist anywhere in corpus.
  • Phase 5: ILS pilot with resolved_at−1d proxy (Option B pivot). 725 markets scored, 20.3% positive ILS. Median −0.084 vs FFICD −2.714. Top signal: Epstein files markets (ILS 0.55–0.93). Full report: TASK_02E_ILS_EVENT_RESOLVED.md.

Key finding

The resolved_at−1d anchor is 18× better than end_date−1d for event markets. 20% positive ILS rate warrants control group comparison.

Stop condition met

Awaiting user review of Phase 5 ILS distribution before planning Task 03.

🤖 Generated with Claude Code

MaksymDS and others added 4 commits April 27, 2026 13:27
- fflow/scoring/resolution_type.py: heuristic classifier returning
  event_resolved / deadline_resolved / surprise_resolved / unclassifiable
  based on question text, resolution_outcome, and last_price gap
- fflow/models.py: add resolution_type String(50) column to Market
- alembic/versions/0005_resolution_type.py: migration 0005 adds column +
  index ix_markets_resolution_type
- fflow/cli.py: add `fflow score classify-types` batch command

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Classified 11,200 markets (vol>=50K, target categories):
  event_resolved=1145 (10.2%, 29% YES)
  deadline_resolved=1224 (10.9%, 0% YES) — validates classifier
  unclassifiable=8831 (78.8%)

deadline_resolved 100% NO rate confirms: these markets have no
definable T_news; ILS is undefined for them by design.

reports/RESOLUTION_TYPOLOGY_DISTRIBUTION.md: full breakdown per
category + 20-market manual review samples per type.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Ran UMA collector on 1,145 event_resolved markets (vol>=50K).
Result: 0 evidence URLs obtained.

Finding: all event_resolved markets are Polymarket admin-resolved
(resolution_proposer=NULL). UMA is used only for crypto oracles
(data.chain.link, 197) and sports results (hltv.org+others, 297).
Zero overlap with event_resolved classification.

Phase 4 (article whitelist tier1) is skipped — no article URLs exist.
Phase 5 (ILS pilot) is blocked pending T_news strategy pivot.
Pivot options documented in EVENT_RESOLVED_UMA_COVERAGE.md.

fflow/collectors/uma.py: add --event-resolved mode + batch progress logging
fflow/cli.py: expose --event-resolved + --min-volume flags

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
… ILS

T_news strategy: resolved_at-1d proxy (tier=2, confidence=0.60).
Validates anchoring hypothesis: median ILS -0.084 vs FFICD -2.714.
20.3% positive ILS (vs 0% FFICD). Top signal: Epstein files markets
(ILS 0.55-0.93) — consistent with pre-resolution informed trading.

fflow/cli.py:
  - seed-proxy: add --anchor, --resolution-type, --min-volume,
    --confidence flags; support resolved_at anchor
  - score batch: add --resolution-type filter

Phase 4 (article whitelist tier1) was skipped — 0 article URLs exist.
Phase 5 STOP: awaiting user review. See TASK_02E_ILS_EVENT_RESOLVED.md.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@MaksymDS MaksymDS merged commit 504f49b into master Apr 27, 2026
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant