Package Exports

cat-crawl
cat-crawl/dist/index.js

This package does not declare an exports field, so the exports above have been automatically detected and optimized by JSPM instead. If any package subpath is missing, it is recommended to post an issue to the original package (cat-crawl) to support the "exports" field. If that is not possible, create a JSPM override to customize the exports field for this package.

Readme

cat-crawl (CLI)

cat-crawl crawls web and video content, turns it into clean Markdown, and saves it into Obsidian.

Typical workflow: send a link to a Feishu, Telegram, or Discord bot, or pass it to the CLI. cat-crawl will fetch the article body or extract video transcripts, organize the content into readable Markdown, and write it into your Obsidian vault.

If your Obsidian vault syncs through iCloud, you can see the result directly on your phone.

For personal knowledge-base workflows, it feels like a specialized, lower-token open-claw.

What It Supports

Web article clipping: WeChat, X / Twitter, generic article pages
Video transcription: YouTube, Douyin, local video files
Channels: CLI, Feishu, Telegram, Discord
AI providers: OpenAI, Gemini, Vertex (ADC/OAuth)

What It Does

Crawl article body from a link
Extract speech/text from videos
Organize content into chaptered Markdown
Add Chinese translation for English content
Save directly into Obsidian

Prerequisites

Node.js >= 22
Obsidian CLI installed (obsidian command)
For video transcription:
- ffmpeg
- yt-dlp (for YouTube)
- whisper-cli + local whisper.cpp model file

Install

npm install -g cat-crawl

Basic Commands

# Start channel listeners
cat-crawl obsidian start --telegram
cat-crawl obsidian start --all-channels

# Run one-shot from CLI input/url
cat-crawl obsidian run "https://mp.weixin.qq.com/s/xxxx"
cat-crawl obsidian run "https://www.youtube.com/watch?v=xxxx"

# Configure channel / agent
cat-crawl obsidian config set channel telegram
cat-crawl obsidian config set agent openai
cat-crawl obsidian config set agent gemini
cat-crawl obsidian config set agent vertex

# Telegram pairing approval
cat-crawl obsidian pairing approve telegram <code>

Config File

Config is stored in:

~/.cat-crawl/config.json

Recommended nested format:

{
  "agent": {
    "provider": "gemini",
    "gemini": {
      "apiKey": "<GEMINI_API_KEY>",
      "model": "gemini-3.1-flash-lite-preview"
    }
  },
  "transcription": {
    "provider": "whisper_cpp",
    "whisperCpp": {
      "bin": "whisper-cli",
      "modelPath": "/absolute/path/to/model.bin"
    }
  },
  "obsidian": {
    "vault": "知识库",
    "folders": [
      {
        "folder": "Clippings/AI",
        "description": ""
      }
    ]
  }
}

vertex uses Vertex AI's ADC/OAuth flow. Configure the agent through the CLI or ~/.cat-crawl/config.json.

Source Repo

cat-crawl on GitHub