Tagged “open-source”
intake-eval-harness: an evaluation harness for tool-using MCP servers
A small evaluation harness for tool-using MCP servers: run a fixed suite against a server, score the final answer, and enforce deterministic assertions over the tool trace. Tool-using systems fail in ways a unit test does not catch (the model picks the wrong tool, skips a required step, or answers without calling anything), so a fixed suite turns those failures into a repeatable number instead of a surprise in production. Extracted from intake-triage-mcp.
stars: a categorized index of my starred repositories
A curated snapshot of my GitHub Lists: 2635 unique repositories across 28 public lists, rendered into a browsable research library. Selection is manual (I decide what belongs in each list); the rendering, the ordering by star count, and the metadata are mechanical and point-in-time. It is a working library, not a ranking or a recommendation engine, and inclusion is not endorsement: the lists hold tools I am evaluating, comparing, monitoring, or may want to revisit.