Package Exports
- ai-coding-coach
- ai-coding-coach/dist/index.js
This package does not declare an exports field, so the exports above have been automatically detected and optimized by JSPM instead. If any package subpath is missing, it is recommended to post an issue to the original package (ai-coding-coach) to support the "exports" field. If that is not possible, create a JSPM override to customize the exports field for this package.
Readme
ai-coding-coach
Score your AI coding sessions. Reduce spend by coaching the habits that waste credits.
What it does
Reads your Claude Code transcripts and scores your interaction quality across 8 axes using an LLM-as-judge rubric. Tracks improvement over time. Surfaces the single biggest thing you can change to get more value from AI coding tools.
Install
npm install -g ai-coding-coachOr run without installing:
npx ai-coding-coach scoreUsage
# Score your most recent session
ai-coding-coach score
# Score a specific transcript
ai-coding-coach score --path ~/.claude/projects/my-project/abc123.jsonl
# View history
ai-coding-coach history
# Open the dashboard
ai-coding-coach dashboard
# Run eval harness (rubric stability testing)
ai-coding-coach eval --provider bedrockClaude Code skill
A /coach skill is included for direct integration with Claude Code. To install:
mkdir -p ~/.claude/skills/coach
cp $(npm root -g)/ai-coding-coach/skill/coach.md ~/.claude/skills/coach/SKILL.mdThen use /coach in any Claude Code session to score your last session inline.
Provider setup
The scoring engine needs an LLM. Pick one:
| Provider | Setup | Cost |
|---|---|---|
| Anthropic API | export ANTHROPIC_API_KEY=sk-ant-... |
~$0.05/score |
| AWS Bedrock | aws configure |
~$0.03/score |
| Claude Code CLI | Install Claude Code (free with Max) | $0 |
Auto-detection tries them in that order. Override with --provider <name>.
Scoring rubric
8 axes, scored 1-10:
- Task Decomposition - Do you break work into steps?
- Context Discipline - Do you scope context appropriately?
- Verification Behaviour - Do you define pass/fail criteria?
- Evidence-Seeking - Do you demand proof?
- Plan-Before-Code - Do you plan before implementing?
- Trust Calibration - Do you critically review AI output?
- Session Hygiene - Do you manage context window effectively?
- Yegge Level - Where are you on the AI adoption ladder (L1-L8)?
Each score comes with a confidence level, evidence citation, and actionable suggestion.
Example output
Session Score: 7.8/10 (L6 - AI-first)
Task Decomposition ████████░░ 8/10 high
Context Discipline ███████░░░ 7/10 high
Verification ████████░░ 8/10 high
Evidence-Seeking ████████░░ 8/10 medium
Plan-Before-Code ███████░░░ 7/10 medium
Trust Calibration █████████░ 9/10 high
Session Hygiene ███████░░░ 7/10 high
Yegge Level ██████░░░░ L6 high
Top suggestion: Define acceptance criteria before implementation.
When you say "add X", also say "it passes when Y".Eval harness
Validates rubric stability across transcripts:
# Create eval-manifest.json with paths to 20 transcripts
ai-coding-coach eval --provider bedrock --runs 3
# Save baseline for regression detection
ai-coding-coach eval --provider bedrock --save-baselinePass criteria:
- Score std dev < 1.5 per axis across 3 runs of same transcript
- No axis consistently scores 1 or 10 (floor/ceiling problem)
License
GNU Affero General Public License v3.0 (AGPLv3) with commercial exemption option.
Open source projects are free to use under AGPLv3. Organizations requiring proprietary use can obtain a commercial license exemption. See LICENSE for details.