MMAlign Platform Monorepo

Licensed under the Apache License 2.0.

Layout

mmalign-platform/
├── configs/              # models, scenarios, methods, evaluators (tracked)
├── data/                 # platform workspace — gitignored except README
│   ├── benchmarks/
│   │   ├── builtin/      # self-contained packages (metadata.yaml each)
│   │   └── user/         # user-uploaded packages
│   └── results/
├── examples/benchmarks/builtin/  # tracked seed packages
├── packages/mmalign/
├── apps/{api,cli,webui}/
└── scripts/setup-data.sh

Setup

pnpm install
uv sync --all-packages --extra dev
./scripts/setup-data.sh

Requires pnpm and uv on PATH.

Paths

Purpose	Dev (default)	Deploy
Workspace	./data/	MMALIGN_USE_XDG=1 → ~/.local/share/mmalign/data/
Datasets	data/benchmarks/	under workspace
Results	data/results/	under workspace (or MMALIGN_RESULTS_DIR)

Commands

CLI entry point lives in the mmalign-cli package (not mmalign).

pnpm dev    # API (:8000) + WebUI (Vite)
pnpm test   # core pytest + webui typecheck

uv run --package mmalign-cli mmalign seed --reset --scale small   # mock corpus (use large for denser demo)
uv run --package mmalign-cli mmalign benchmark -m mock -s education -n 2 --evaluator mock_judge
uv run --package mmalign-cli mmalign serve                        # API only; docs at /api/docs

For a real model (needs OPENAI_API_KEY or the env named in configs/models.yaml):

uv run --package mmalign-cli mmalign benchmark -m gpt-4.1 -s education

Mock data

mmalign seed generates the entire demo corpus from a single seed: benchmark packages (data/benchmarks/builtin/), runs / samples / review labels in the FileResultStore, and data/results/platform_stats.json. Every dashboard chart (overview metrics, heatmap, controller time-series, drift, cross-modal consistency, review agreement) derives from this corpus — no endpoint hardcodes its own numbers. Use --scale small for a quick lightweight set.