GPTBanker – map/reduce over documents of any length with OpenAI
GPTBanker – map/reduce over documents of any length with OpenAI
Hi all! I created a app that can map/reduce over documents of an arbitrary length with OpenAI completions. You can enter in your OpenAI key and try it out. The backend is built with LangChain, which made it easy to manage the models, workflows (chains), and troubleshoot pipelines with buffer issues. Learnings: - Tokens was the most helpful key for calls rather than characters or words. LangChain also just implemented a token splitter, which made it easier for me to adapt to documents of any type. - Davinci performed much better than Curie for summarizing long documents over multiple chunks - Oftentimes a map step was the only thing needed and the reduce/combine introduced more errors instead of improving context.
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Reduce your OpenAI bill.
Map / reduce for webhooks
Async-iterators (js map, each, reduce for async functions)
Map, Reduce and Filter in Go
Distributed Map-Reduce with Celery and Python 3
ymacro – map/reduce macro lib for C
Cataloging the NYRB and LRB with OpenAI Embeddings
Analyzing Documents with Three Sigma
Doksbin - Pastebin for Documents
LavaSend - SnapChat for documents