This is the github for Hyperparam, where we share open-source contributions to the AI and Data Engineering communities. AI needs lots of data, so we're building tools for working with massive text datasets in the browser.
🦜 Hyparquet — Parquet file parser for loading datasets in the browser.
🐤 Hyparquet Writer — Parquet file writer in JavaScript.
⛄ Icebird — Apache Iceberg table reader in JavaScript.
🐿️ Squirreling — Async SQL engine for querying large datasets in the browser.
🏛️ HighTable — Windowed table component for viewing arbitrarily large datasets.
🔍 HypGrep — Full text search for parquet with a compact n-gram index.
📐 HypVector — Store and query embedding vectors directly out of parquet files.
🦙 HyLlama — Parse metadata from llama.cpp gguf files in JavaScript.
👀 Hyperparam CLI — Scalable dataset viewer for machine learning datasets.
