PromptMage – Simplify and Manage Your LLM Workflows

Hacker News

Hello HN community, I'm excited to share a project we've been working on called PromptMage, an open-source tool designed to simplify the process of creating and managing complex workflows for large language models (LLMs). Backstory As developers and researchers working with LLMs, we found ourselves constantly grappling with the challenges of prompt iteration, testing, and version control. Existing tools didn't quite fit our needs for an integrated, intuitive workflow management solution. So, we decided to build one. PromptMage was born out of a desire to streamline these processes and make LLM technology more accessible to teams of all sizes. What is PromptMage? PromptMage is a self-hosted python tool that provides a user-friendly interface for developing, testing, and managing LLM prompts. It offers several key features: - Prompt Playground: A space to rapidly test, compare, and refine prompts. - Integrated Version Control: Track changes and collaborate on prompt development with ease. - Auto-generated API: A FastAPI-powered API is automatically created for seamless integration and deployment. - Evaluation Mode: Conduct both manual and automated testing to ensure prompt reliability before deployment. Why PromptMage? We built PromptMage to fill a gap we felt keenly in our own work—an all-in-one solution that integrates prompt testing and version control directly into the workflow. Unlike other tools, PromptMage is designed with developers in mind, offering a straightforward setup and intuitive interface to foster collaboration and iteration. How to Try It Out PromptMage is currently in its alpha state and is under active development. We encourage you to install it, set it up (which should take about 5 minutes), and give it a spin. We’re eager for feedback from the community to help shape its future. You can deploy it locally or on your server. Check it out here: < https://promptmage.io/getting-started/ > Don't forget to leave a star on github: < https://github.com/tsterbak/promptmage > What’s Next? We have a roadmap full of exciting features and enhancements. We're aiming to expand PromptMage’s capabilities to better support developers, researchers, and organizations as they navigate the rapidly evolving landscape of AI and LLM technology. We’d love to hear your thoughts and feedback! Whether it's bug reports, feature requests, or contributions, all are welcome. Let's work together to make PromptMage a valuable tool for the community. Feel free to ask any questions or share your experiences in the comments below! Thanks :)

Visit product View on Hacker NewsAug 28, 2024

Share card

Actual performance

10points

6comments

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Indie HackersFits the IH revenue-focused audience · Strong signals: created, started, organizations · Missing: supports, reddit linkedin, podcasting

96%96% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Product HuntOn track for Day 1 leaderboard · Strong signals: model, user, models · Missing: mac, agents, macos

91%91% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: excited, exist, lua · Missing: https docs, just released, open source

63%63% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

AppSumoMay struggle as an AppSumo deal · Strong signals: intuitive, host, friendly · Missing: plus, platform, reviews

46%46% predicted probability of success on AppSumo, based on ML models trained on real launch data.

TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal

44%44% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Strong signals: active · Missing: arr, mrr, revenue

9%9% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Strong signals: collaborate · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Django-LLM (manage langchain in Django)38%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Django-LLM (manage langchain in Django)

Hacker News1

My Attempt to Simplify Philosophy39%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

My Attempt to Simplify Philosophy

Hacker News15

Airtable15%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Simplify your workflows

AppSumo

Redis-LLM – Redis module integrates LLM with Redis45%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Redis-LLM – Redis module integrates LLM with Redis

Hacker News2

LitLLM the Spiciest LLM Wrapper34%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

LitLLM the Spiciest LLM Wrapper

Hacker News1

LLM Reasonsers46%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

LLM Reasonsers

Hacker News2

Resilient LLM23%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Resilient LLM

Hacker News1

Hegelion – Force your LLM to argue with itself before answering58%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Hegelion – Force your LLM to argue with itself before answering

Hacker News1

I Stopped Hoping My LLM Would Cooperate49%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I Stopped Hoping My LLM Would Cooperate

Hacker News3

LLM Hotkey39%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

TrustMRROther

Browse all products Analyze your launch