JSPM

arrow-table-joins

0.0.1
    • ESM via JSPM
    • ES Module Entrypoint
    • Export Map
    • Keywords
    • License
    • Repository URL
    • TypeScript Types
    • README
    • Created
    • Published
    • Downloads 10
    • Score
      100M100P100Q41708F
    • License ISC

    Package Exports

    • arrow-table-joins

    This package does not declare an exports field, so the exports above have been automatically detected and optimized by JSPM instead. If any package subpath is missing, it is recommended to post an issue to the original package (arrow-table-joins) to support the "exports" field. If that is not possible, create a JSPM override to customize the exports field for this package.

    Readme

    streaming in-place Arrow Table joins

    For now only the full outer join over fixed-width columns is implemented.

    import { joinFull } from 'arrow-table-joins';
    import { Table, RecordBatchStreamReader } from 'apache-arrow';
    
    const lilTableStream = RecordBatchStreamReader.from(getLilTable());
    const bigTableStream = RecordBatchStreamReader.from(getBigTable());
    
    const joinedRecordBatches = [];
    // join the values of `lilTable` into `bigTable` in-place
    for await (const recordBatch of joinFull('id', bigTable, lilTable)) {
        joinedRecordBatches.push(recordBatch);
    }
    
    const joinedTable = new Table(joinedRecordBatches);
    
    console.log(joinedTable);