Tawazi – A Python library for parallel execution of functions in DAGs

Hacker News

Tawazi is a lightweight, pure Python library designed to simplify parallel execution of functions in a Directed Acyclic Graph (DAG) structure. Several features include: Integration by decorating existing code. Automatic concurrent (or parallel) execution management. Easy task scheduling without dealing with low-level concurrency primitives. Thread safety. Lightweight. Python 3.7 -> 3.11 support. Asyncify IO Bound sync Code. Extend the original DAG by composing it with smaller DAGs. We built this library by iterating a lot on user feedback, since the first users were our own colleagues from the R&D team, who used the library when developing the API codebase ! We tried to make it as generic as possible, so it wouldn’t just be tailored for their needs but for everyone’s. But the downside of developing with a fixed user base is that we tend to focus on their requests and having other users would be a blessing to get other points of view. This library is pretty battle-tested since we’ve been using this library for almost 2 years in production now ! As our job develops APIs that require long calculations and each API call requires running many heavy computer vision deep learning models encapsulated in functions, that depend on the result of other functions and so on. The crux is that as functions don’t take the same time to run, parts of the code could be run while other parts wait. As this can naturally be modelled as a DAG, we decided to write (and open-source !) a library enabling easy parallelization of such workflows. Open sourcing our work has always been something we had wanted to do and this was the perfect excuse to do it ! Any critic/feedback/questions is absolutely welcome and encouraged (and will mean a lot !) and we’ll try to address those as precisely as possible ! Matthias & Bashir

Visit product View on Hacker NewsOct 17, 2024

Share card

Actual performance

4points

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: model, user, computer · Missing: mac, agents, macos

93%93% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Indie HackersFits the IH revenue-focused audience · Strong signals: para · Missing: supports, reddit linkedin, podcasting

91%91% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: exist, existing, ide · Missing: https docs, excited, just released

83%83% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRFits verified-revenue profile · Strong signals: users, way, para · Missing: mobile apps, ios, personal

55%55% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Strong signals: users · Missing: plus, platform, intuitive

26%26% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

14%14% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Taskmap – a python framework for parallel and asynchronous task execution45%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Taskmap – a python framework for parallel and asynchronous task execution

Hacker News1

A Python library for Unicode string collation55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A Python library for Unicode string collation

Hacker News4

A Python library for accessing Wunderlist67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

A Python library for accessing Wunderlist

Hacker News1

Ohne I/O, a Python 3.4+ coroutine library without any I/O55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Ohne I/O, a Python 3.4+ coroutine library without any I/O

Hacker News2

Combinatorix, yet another combinator library in Python55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Combinatorix, yet another combinator library in Python

Hacker News4

Tt Python library67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Tt Python library

Hacker News1

Python library for GoPro cameras67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Python library for GoPro cameras

Hacker News131

B2blaze – A Backblaze B2 library for Python55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

B2blaze – A Backblaze B2 library for Python

Hacker News359

Matrixprofile-ts – A Python library for timeseries motifs and discords58%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Matrixprofile-ts – A Python library for timeseries motifs and discords

Hacker News95

Python library for parsing Dockerfile65%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Python library for parsing Dockerfile

Hacker News2

Browse all products Analyze your launch