Package Exports

crawlee-storage-extensions
crawlee-storage-extensions/dist/index.js

This package does not declare an exports field, so the exports above have been automatically detected and optimized by JSPM instead. If any package subpath is missing, it is recommended to post an issue to the original package (crawlee-storage-extensions) to support the "exports" field. If that is not possible, create a JSPM override to customize the exports field for this package.

Readme

Crawlee Storage extensions

Package for Crawlee that brings some extensions to the Storages.

Currently supports:

Key-Value Store encryption

Installation

npm install crawlee-storage-extensions

KvStore encryption & decryption example

import { encryptKeyValueStore } from 'crawlee-storage-extensions';
import { KeyValueStore } from 'crawlee';

// Opens Default KvStore
const kvStore = await KeyValueStore.open();

// Secret key is used to encrypt and decrypt the values
const encryptedKvStore = encryptKeyValueStore(kvStore, 'MY_SECRET_KEY');

await encryptedKvStore.setValue('MY_KEY', 'MY_VALUE'); // Stores the value in encrypted form

const encryptedValue = await kvStore.getValue('MY_KEY'); // Loads the value in encrypted form
console.log(encryptedValue); // eyJkYXRhIjoiekRKaEg1VG5HZDRGZFF1aCtDS0VLdz09IiwiaXYiOiJWeVpNUG9VNW81endwOWpGcS9aeE1RPT0ifQ==

const decryptedValue = await encryptedKvStore.getValue('MY_KEY'); // Loads the decrypted value
console.log(decryptedValue); // MY_VALUE

Contribution

New features are added on-the-go as needed, feel free to create pull-request with your own changes.