JSPM

ai-coding-coach

0.1.1
  • ESM via JSPM
  • ES Module Entrypoint
  • Export Map
  • Keywords
  • License
  • Repository URL
  • TypeScript Types
  • README
  • Created
  • Published
  • Downloads 17
  • Score
    100M100P100Q74612F
  • License AGPL-3.0-or-later

Score your AI coding sessions. Reduce spend by coaching the habits that waste credits.

Package Exports

  • ai-coding-coach
  • ai-coding-coach/dist/index.js

This package does not declare an exports field, so the exports above have been automatically detected and optimized by JSPM instead. If any package subpath is missing, it is recommended to post an issue to the original package (ai-coding-coach) to support the "exports" field. If that is not possible, create a JSPM override to customize the exports field for this package.

Readme

ai-coding-coach

Score your AI coding sessions. Reduce spend by coaching the habits that waste credits.

What it does

Reads your Claude Code transcripts and scores your interaction quality across 8 axes using an LLM-as-judge rubric. Tracks improvement over time. Surfaces the single biggest thing you can change to get more value from AI coding tools.

Install

npm install -g ai-coding-coach

Or run without installing:

npx ai-coding-coach score

Usage

# Score your most recent session
ai-coding-coach score

# Score a specific transcript
ai-coding-coach score --path ~/.claude/projects/my-project/abc123.jsonl

# View history
ai-coding-coach history

# Open the dashboard
ai-coding-coach dashboard

# Run eval harness (rubric stability testing)
ai-coding-coach eval --provider bedrock

Claude Code skill

A /coach skill is included for direct integration with Claude Code. To install:

mkdir -p ~/.claude/skills/coach
cp $(npm root -g)/ai-coding-coach/skill/coach.md ~/.claude/skills/coach/SKILL.md

Then use /coach in any Claude Code session to score your last session inline.

Provider setup

The scoring engine needs an LLM. Pick one:

Provider Setup Cost
Anthropic API export ANTHROPIC_API_KEY=sk-ant-... ~$0.05/score
AWS Bedrock aws configure ~$0.03/score
Claude Code CLI Install Claude Code (free with Max) $0

Auto-detection tries them in that order. Override with --provider <name>.

Scoring rubric

8 axes, scored 1-10:

  1. Task Decomposition - Do you break work into steps?
  2. Context Discipline - Do you scope context appropriately?
  3. Verification Behaviour - Do you define pass/fail criteria?
  4. Evidence-Seeking - Do you demand proof?
  5. Plan-Before-Code - Do you plan before implementing?
  6. Trust Calibration - Do you critically review AI output?
  7. Session Hygiene - Do you manage context window effectively?
  8. Yegge Level - Where are you on the AI adoption ladder (L1-L8)?

Each score comes with a confidence level, evidence citation, and actionable suggestion.

Example output

Session Score: 7.8/10 (L6 - AI-first)

 Task Decomposition    ████████░░  8/10  high
 Context Discipline    ███████░░░  7/10  high
 Verification          ████████░░  8/10  high
 Evidence-Seeking      ████████░░  8/10  medium
 Plan-Before-Code      ███████░░░  7/10  medium
 Trust Calibration     █████████░  9/10  high
 Session Hygiene       ███████░░░  7/10  high
 Yegge Level           ██████░░░░  L6    high

Top suggestion: Define acceptance criteria before implementation.
When you say "add X", also say "it passes when Y".

Eval harness

Validates rubric stability across transcripts:

# Create eval-manifest.json with paths to 20 transcripts
ai-coding-coach eval --provider bedrock --runs 3

# Save baseline for regression detection
ai-coding-coach eval --provider bedrock --save-baseline

Pass criteria:

  • Score std dev < 1.5 per axis across 3 runs of same transcript
  • No axis consistently scores 1 or 10 (floor/ceiling problem)

License

GNU Affero General Public License v3.0 (AGPLv3) with commercial exemption option.

Open source projects are free to use under AGPLv3. Organizations requiring proprietary use can obtain a commercial license exemption. See LICENSE for details.