I build research systems that turn ambitious AI claims into reproducible, inspectable evidence.
Nullius in verba.Take nobody's word for it.
Featured research
Evaluation artifacts produce scores. They do not automatically bind the historical evidence or alternative semantics needed to replay the claim attached to that score.
Versioned inputs, observations, traces, state, and support.
Primary admissible readings and a separate review envelope.
Exact score, winner, complete order, or pairwise relation.
Not another benchmark score—a contract for what may be inferred.
Every unit receives a terminal record. A STOP is not a zero score; it identifies the first missing object and the minimum artifact needed to unblock replay.
Primary and review families remain separate. A winner can stay identified even when the complete order does not.
A fresh run cannot reconstruct a historical evaluation event. Replay requires bound observations, mediator decisions, state, support joins, and semantic admission.
“The result is a reviewable claim-replay contract rather than a forced evaluator meaning or a single flip label.”Conclusion · arXiv v3
Open-source contributions
darthjee / navi #716
Split a monolithic parser into focused HTML-root, value-resolution, field-mapping, and filter components while preserving both public parser surfaces.
awslabs / stickler #284
Implemented ROC AUC, Rand index, V-measure, and Kendall tau-b in NumPy, removing scikit-learn from the core dependency surface.
holaboss-ai / holaOS #470
Added ordered local and Explorer attachments, previews, limits, attachment-only submits, and retry behavior that avoids orphaned sessions.
3b1b / manim #2501
Added a planar rotation path for (N, 2) arrays while retaining the existing axis-angle behavior for individual and batched 3D vectors.
lacs-project / sysknife #256
Closed a saved-preference prompt-envelope boundary by neutralising both opening and closing tags in new, legacy, and manually edited files.
tarolling / seiri #173
Required canonical import targets to remain inside the project root across C++, Python, and TypeScript, with graph-level rejection as a second boundary.
Selected work
Selected recognition
Three operating principles
01Lex me quoque ligat.
The law binds me too.
02In dubio, siste.
When in doubt, stop.
03Nihil ultra testimonium.
Nothing beyond the evidence.
Festina lente.
Make haste slowly.