Package Exports

@twick/ai-models
@twick/ai-models/dist/index.js
@twick/ai-models/dist/index.mjs

This package does not declare an exports field, so the exports above have been automatically detected and optimized by JSPM instead. If any package subpath is missing, it is recommended to post an issue to the original package (@twick/ai-models) to support the "exports" field. If that is not possible, create a JSPM override to customize the exports field for this package.

Readme

@twick/ai-models

Provider adapters and orchestration primitives for Twick generative AI integrations.

What is included

Provider adapter interface for generation workflows (caption, voice, avatar, media)
Multi-provider orchestration with unified job status and fallback
Job store interface with in-memory implementation
Timeline injection helpers to normalize provider output into patch contracts
Caption normalization helpers for legacy cloud payloads
Types for ModelInfo, AIModelProvider, and patch/result DTOs (apps supply model lists via services)

Core API

import {
  ProviderRegistry,
  GenerationOrchestrator,
  InMemoryJobStore,
  type ProviderAdapter,
  toTimelinePatch,
} from "@twick/ai-models";

const registry = new ProviderRegistry();
const voiceAdapter: ProviderAdapter = /* your implementation */;
const avatarAdapter: ProviderAdapter = /* your implementation */;

registry.registerAdapter(voiceAdapter);
registry.registerAdapter(avatarAdapter);
registry.setProviderConfig({ provider: "your-provider", apiKey: process.env.API_KEY });

const orchestrator = new GenerationOrchestrator(registry, new InMemoryJobStore());

const voiceJob = await orchestrator.createJob({
  type: "voice",
  provider: "your-provider",
  fallbackProviders: [],
  input: {
    text: "Welcome to this lesson.",
    language: "en-US",
    voiceId: "narrator-1",
  },
});

const completed = await orchestrator.dispatch(voiceJob.id);
const patch = toTimelinePatch(completed);

Why this matters

This provides a provider-agnostic backend layer so Twick apps can:

Integrate different caption/voice/avatar/media APIs behind one contract
Add fallback between providers without changing app-level flow
Keep timeline/caption/export pipeline stable while swapping models
Feed normalized patch data into @twick/workflow for project/timeline application

Notes

Implement ProviderAdapter for each production provider (e.g. Sora, HeyGen, ElevenLabs).
GenerationOrchestrator is backend-oriented and can run in cloud functions or Node services.