Prompt Compression for LLMs App
Prompt Compression for LLMs App
Hi HN! I've noticed that as the applications of LLMs continue to expand, the demand for tokens is increasing, which also brings significant cost burdens to users. Currently, there aren't many effective prompt compression products on the market, so I've created a simple demo site: https://hello-llm.com . This application includes two features: lossy compression and lossless compression. 1. Lossy compression allows users to specify the compression ratio and is faster; 2. Lossless compression lets the model determine the compression ratio, aiming to retain as much useful information as possible, albeit slower. This is just a demo, and I plan to assess its feasibility and gather enough feedback before deciding whether to launch a formal product. Everyone is welcome to try it out!
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Correct prediction on native model
Similar products
Evolving Text Compression Algorithms by Mutating Code with LLMs
Image Resizing and Compression
I made an interactive prompt compression demo
Compression-Based Classification
Achico – A free macOS file compression app
Oroch – a C++ library for integer array compression
Janet bindings for the LZO compression library
Kanzi, fast lossless data compression
Image Compression and Resizing Tool
GPTCache – Redis for LLMs