Advanced Chunking in JavaScript/TypeScript with Chonkie
Advanced Chunking in JavaScript/TypeScript with Chonkie
Hi HN, We’re Shreyash and Bhavnick. We built Chonkie, an open-source library for advanced chunking and embedding of text and code. It was previously Python-only, but we just released a TypeScript version: https://github.com/chonkie-inc/chonkie-ts Many AI projects in JS/TS (like those using Vercel's AI SDK or Mastra) rely on basic text splitters. But better chunking = better retrieval = better performance. That’s what Chonkie is built for. Current native chunkers (in TS): - Code Chunker – handles Python, TypeScript, etc. - Recursive Chunker – rule-based, hierarchical splitting - Token Chunker – split by token count (fully customizable) - Sentence Chunker – split on sentence boundaries. Delimiters are customizable, so it works for multiple languages. All chunkers support custom tokenizers, chunk overlap, delimiters, and more. Coming soon in native TS (already available via the API client): - Semantic Chunker – splits texts wherever it detects a shift in meaning. - SDPM Chunker – merges semantically similar disjoint chunks - Late Chunker – generates context-aware embeddings for each chunk - Slumber Chunker – LLM-refined recursive chunks. Significantly reduces token usage (and thus cost) while maximizing chunk quality. - Embeddings Refinery - Embed chunks with any embedding model - Overlap Refinery – Create overlaps between consecutive chunks for better context preservation. Chonkie is free, open-source, and MIT licensed. GitHub: https://github.com/chonkie-inc/chonkie-ts We’d love your feedback, ideas, or contributions. Thanks!
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
An Extensible Lisp Interpreter in JavaScript/TypeScript for DSLs
Synt – Find similar functions and classes in JavaScript/TypeScript code
Vulkan API for JavaScript/TypeScript
Subtls, a TLS 1.3 client for JavaScript/TypeScript
Statically parse dependency trees of JavaScript and TypeScript projects
Dependency injection container library for JavaScript/TypeScript
The last TypeScript release built on JavaScript
A time-travel debugger for JavaScript/TypeScript
Convert JavaScript to TypeScript with ChatGPT
A WASM port and JavaScript+Typescript wrapper for Monocypher