JSPM

  • Created
  • Published
  • Downloads 22
  • Score
    100M100P100Q65023F

Transposer connector is a PeerTube language tool plugin to transcribe and translate with Whisper

Package Exports

    This package does not declare an exports field, so the exports above have been automatically detected and optimized by JSPM instead. If any package subpath is missing, it is recommended to post an issue to the original package (peertube-plugin-transposer-connector) to support the "exports" field. If that is not possible, create a JSPM override to customize the exports field for this package.

    Readme

    Transposer Connector

    A multilingual video plugin for PeerTube, developed by fairkom.

    Transposer enables automatic transcription and translation of video content using Whisper by OpenAI. It's designed to make video content accessible in multiple languages and supports modern web protocols like ActivityPub and REST.

    โœจ Features

    • Transcribe and translate videos automatically
    • Translate transcripts into 26 languages
    • Save transcriptions as captions
    • Edit captions directly in the UI
    • Translate video metadata into 26 languages
    • Switch metadata language in the UI
    • Change the UI language dynamically
    • Access metadata via:
      • ActivityPub (JSON-LD)
      • REST API endpoint

    ๐ŸŒ Supported Languages

    Transposer currently supports translation into 26 languages. (A complete list can be added here if desired.)

    • ๐Ÿ‡ฆ๐Ÿ‡ช Arabic (ar)
    • ๐Ÿ‡ง๐Ÿ‡ฆ Bosnian (bs)
    • ๐Ÿ‡ง๐Ÿ‡ฌ Bulgarian (bg)
    • ๐Ÿ‡ญ๐Ÿ‡ท Croatian (hr)
    • ๐Ÿ‡จ๐Ÿ‡ฟ Czech (cs)
    • ๐Ÿ‡ณ๐Ÿ‡ฑ Dutch (nl)
    • ๐Ÿ‡ฌ๐Ÿ‡ง English (en)
    • ๐Ÿ‡ช๐Ÿ‡ช Estonian (et)
    • ๐Ÿ‡ซ๐Ÿ‡ฎ Finnish (fi)
    • ๐Ÿ‡ซ๐Ÿ‡ท French (fr)
    • ๐Ÿ‡ฉ๐Ÿ‡ช German (de)
    • ๐Ÿ‡ฌ๐Ÿ‡ท Greek (el)
    • ๐Ÿ‡ฎ๐Ÿ‡ฑ Hebrew (he)
    • ๐Ÿ‡ญ๐Ÿ‡บ Hungarian (hu)
    • ๐Ÿ‡ฎ๐Ÿ‡น Italian (it)
    • ๐Ÿ‡ต๐Ÿ‡ฑ Polish (pl)
    • ๐Ÿ‡ต๐Ÿ‡น Portuguese (pt)
    • ๐Ÿ‡ท๐Ÿ‡ด Romanian (ro)
    • ๐Ÿ‡ท๐Ÿ‡บ Russian (ru)
    • ๐Ÿ‡ท๐Ÿ‡ธ Serbian (sr)
    • ๐Ÿ‡ธ๐Ÿ‡ฐ Slovak (sk)
    • ๐Ÿ‡ธ๐Ÿ‡ฎ Slovenian (sl)
    • ๐Ÿ‡ช๐Ÿ‡ธ Spanish (es)
    • ๐Ÿ‡ธ๐Ÿ‡ช Swedish (sv)
    • ๐Ÿ‡น๐Ÿ‡ท Turkish (tr)
    • ๐Ÿ‡บ๐Ÿ‡ฆ Ukrainian (uk)

    ๐Ÿš€ Getting Started

    Visit: https://tube.dev.displ.eu/p/transposer

    From there, you can:

    • Trigger transcription, translation, and metadata translation
    • Edit and manage captions
    • View and switch between language versions of metadata and UI

    Query Parameters

    • Switch metadata language:
      ?metadatalanguage={langcode}
    • Switch UI language:
      ?uilanguage={langcode}

    ๐Ÿ”— Accessing Metadata

    You can access translated metadata using different endpoints:

    • REST API (proxied):

    https://api.transposer.eu/dev/peertube/metadata/

    • REST API (direct PeerTube plugin)

    https:///plugins/transposer-connector/router/language/metadata/video/

    • REST API (direct PeerTube with version of plugin)

    https:///plugins/transposer-connector//router/language/metadata/video/

    • ActivityPub (JSON-LD format)

    curl -H "Accept: application/activity+json"
    https:///videos/watch/

    โš™๏ธ How It Works

    To support high-volume PeerTube instances, Transposer is designed for asynchronous processing using a queuing system.

    The architecture includes:

    • A dedicated Transposer Engine
    • Support for multiple adapters, including one for Whisper
    • A Kafka pipeline for distributed processing
    • Kong Gateway for exposing APIs and managing routing

    This ensures scalable handling of transcription and translation jobs with minimal impact on the PeerTube server.

    ๐Ÿ”ง Dependencies

    ! Note: This plugin is still under development.

    Youโ€™ll need a Language Transposer Service account to enable transcription and translation features.

    To request test access, email: support@fairkom.eu After receiving credentials, configure the plugin in the PeerTube admin interface by adding the provided service URL.

    ๐Ÿง‘โ€๐Ÿ’ป Codebase

    ๐Ÿ“ฆ Changelog

    See here: Changelog

    TODOs

    • ๐Ÿ” Restrict Access to Authenticated Users: Ensure the page is only accessible to users who are logged in.
    • ๐Ÿ†• Allow Language Change via Query Parameter: Add the ability to change the caption language using a query parameter, for example, &lang=es.
    • ๐Ÿงช Add GitLab CI Pipeline: Set up a GitLab CI pipeline with SonarQube for automated testing and quality checks.
    • ๐Ÿ”„ Refactor Code: Refactor the codebase to improve maintainability, performance, and clarity.