@thinkhive/mcp-explainer v2.0.1

MCP (Model Context Protocol) server for the ThinkHive Explainer API. Provides AI agents with access to trace analysis, RAG evaluation, hallucination detection, quality metrics, and business impact analytics.

What's New in v2.0.0

• RAG Evaluation: Measure context relevance, groundedness, faithfulness, and citation accuracy
• Hallucination Detection: Identify unsupported claims, factual errors, and contradictions
• Quality Metrics: Track quality scores across agents with trend analysis
• ROI Analytics: Calculate business impact, revenue at risk, and cost savings
• Silent Failure Detection: Find cases where agents appear successful but failed to help
• Fix Generation: AI-powered fix suggestions for failure patterns
• Enhanced Prompts: Pre-built prompts for common analysis workflows

Features

• 25+ powerful tools for trace analysis, quality metrics, and business analytics
• STDIO transport for Claude Code CLI integration
• HTTP/SSE transport for web clients and external integrations
• Comprehensive trace support: multi-turn conversations, tool calls, RAG context
• Company isolation for multi-tenant security
• Audit logging for compliance
• Tier-based feature gates (free, starter, professional, enterprise)

Installation

npm install @thinkhive/mcp-explainer

Quick Start

Claude Code CLI

Add to your Claude Code configuration (~/.claude/claude_desktop_config.json):

{
  "mcpServers": {
    "thinkhive-explainer": {
      "command": "npx",
      "args": ["@thinkhive/mcp-explainer"],
      "env": {
        "THINKHIVE_API_KEY": "thk_your_api_key_here",
        "THINKHIVE_API_URL": "https://demo.thinkhive.ai"
      }
    }
  }
}

Programmatic Usage

import { startStdioServer } from '@thinkhive/mcp-explainer';

// Start STDIO server
await startStdioServer();

HTTP/SSE Transport

import express from 'express';
import { setupHttpTransport } from '@thinkhive/mcp-explainer';

const app = express();
app.use(express.json());

setupHttpTransport({
  app,
  basePath: '/mcp',
});

app.listen(3001, () => {
  console.log('MCP server running on http://localhost:3001');
});

Environment Variables

Available Tools

Trace Analysis

Quality Metrics (NEW)

ROI Analytics (NEW)

Failure Clusters

Fix Generation (NEW)

Silent Failures (NEW)

Webhooks

Evaluation

Tool Examples

Analyze a Trace with Quality Metrics

{
  "trace": {
    "id": "trace-123",
    "userMessage": "What's the refund policy?",
    "agentResponse": "Our refund policy allows returns within 30 days...",
    "outcome": "success"
  },
  "options": {
    "evaluateRAG": true,
    "detectHallucinations": true,
    "computeBusinessImpact": true
  }
}

Evaluate RAG Quality

{
  "traceId": "trace-123",
  "question": "What's the refund policy?",
  "answer": "Our refund policy allows returns within 30 days...",
  "contexts": [
    "Customers may return items within 30 days of purchase...",
    "Refunds are processed within 5-7 business days..."
  ]
}

Get ROI Summary

{
  "agentId": "customer-support",
  "dateRange": {
    "from": "2024-01-01T00:00:00Z",
    "to": "2024-01-31T23:59:59Z"
  },
  "includeProjections": true
}

Detect Silent Failures

{
  "agentId": "sales-assistant",
  "signals": [
    "repeat_contact",
    "escalation",
    "negative_feedback"
  ]
}

Available Prompts

Supported Models (December 2025)

The ThinkHive API backend uses the latest AI models for maximum accuracy:

Azure OpenAI

• GPT-5 Series: gpt-5.2, gpt-5, gpt-5-pro, gpt-5-mini
• GPT-4.1 Series: gpt-4.1, gpt-4.1-mini, gpt-4.1-nano
• O-Series Reasoning: o4-mini, o3-pro, o3, o3-mini
• Embeddings: text-embedding-3-large, text-embedding-3-small

Anthropic Claude (via Azure)

• Claude 4.5 Series: claude-opus-4.5, claude-sonnet-4.5, claude-haiku-4.5

Google Gemini (Direct API)

• Gemini 3: gemini-3-flash, gemini-3-flash-lite
• Gemini 2.5: gemini-2.5-pro, gemini-2.5-flash

API Key Tiers

Security

• API Key Authentication: Secure key validation with company scoping
• Company Isolation: All queries scoped to authenticated company
• Rate Limiting: Per-API-key rate limiting
• Audit Logging: All tool calls logged for compliance

Troubleshooting

"API key required" error

Make sure THINKHIVE_API_KEY environment variable is set.

Rate limit exceeded

Wait for the rate limit window to reset (1 minute) or upgrade your tier.

Feature not available

Some features require higher tiers. Check the tier column in the tools table.

Links

• ThinkHive Platform
• API Documentation
• MCP Specification
• GitHub Issues

License

MIT