Changelog

Every release of Proctor, newest first.

The current version is 1.0.0. This page is copied from CHANGELOG.md in the repository at build time.

All notable changes to io.github.jantursky:proctor are listed here. The format follows Keep a Changelog, and versions follow Semantic Versioning.

[Unreleased]

proctor: RunnerConfig.groupId and RunResult.groupId to mark runs that belong together; suite DSL (evalSuite), graders (exact match, regex, JSON schema, semantic similarity, LLM judge), a runner with pacing, quota backoff and repeats, a fake backend, and the result JSON format (schema version 1).
proctor-mlkit: Gemini Nano through the ML Kit GenAI Prompt API, with stable and preview model selection, a foreground guard, a host activity and MlKitBackend.download() for fetching the model.
proctor-ios: Apple Foundation Models through a small Swift bridge.
proctor-report: HTML and Markdown reports that compare platforms, model versions and prompt versions.
io.github.jantursky.proctor Gradle plugin with the proctorReport task and CI pass conditions.
Sample ticket-triage suites, an Android instrumented runner and a headless iOS simulator runner.
Android sample app: a download bar with elapsed time while the model downloads, a shortcut to AICore in Google Play, and availability polling so a finished download is noticed even when AICore sends no completion.
Sample report with runs of all four Gemini Nano 4 models (stable and preview, full and fast) on a Pixel 11 Pro.