Garnet – Distributed Python on Kubernetes

Hacker News

Garnet (https://garnet.ai) is a framework to run distributed and parallel Python on Kubernetes. We make it easy to scale from laptop to cluster, without requiring any devops work. Garnet plugs into any existing Python environment (notebook, IDE, CI/CD pipelines, custom apps) using a lightweight client library, and enables users to scale popular data/ml libraries (including pandas, NumPy, scikit-learn, XGBoost, etc.) and custom code to a remote cluster for execution. Under the hood, we natively wire up Dask with Kubernetes for scheduling, which brings advantages such as dynamic resource allocation, ephemeral clusters and autoscaling, while abstracting the devops complexity for developers and data scientists. Our vision is to build the orchestration layer for distributed computing in Python. We’re starting off with Dask, but have goals of supporting other frameworks such as Ray and Modin in the future. Some of the cool use cases we’ve seen from our users are: Bursting to the cloud from local dev environments for data and memory intensive computations Standing up managed Dask and Kubernetes clusters programmatically in 3-4 lines of Python, without any devops knowledge (Docker, k8s etc.) Parallelize existing codebases in pandas, NumPy, scikit-learn, XGBoost etc. with minimal code changes, without opting for a more complex system such as Spark Currently, users can download our client library and run Dask workloads on our fully managed cluster (see docs). We’re working on adding the capability to run Garnet on your own cloud (Kubernetes) in an upcoming release. We’re excited to hear your feedback, and what you’d like to see. Please drop your email on our website so we can get in touch directly.

Visit product View on Hacker NewsJan 23, 2021

Share card

Actual performance

5points

2comments

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: apps, user, dock · Missing: mac, agents, macos

90%90% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Hacker NewsStrong engagement from HN community · Strong signals: excited, exist, existing · Missing: https docs, just released, lua

84%84% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

Indie HackersFits the IH revenue-focused audience · Strong signals: para, including · Missing: supports, reddit linkedin, podcasting

78%78% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

TrustMRRFits verified-revenue profile · Strong signals: apps, users, para · Missing: mobile apps, ios, personal

65%65% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Strong signals: users · Missing: plus, platform, intuitive

32%32% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

20%20% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Kubernetes and Python57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Kubernetes and Python

Hacker News2

Limitted Authorization for a Kubernetes User with Python57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Limitted Authorization for a Kubernetes User with Python

Hacker News2

Kr8s – a Python client library for Kubernetes68%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Kr8s – a Python client library for Kubernetes

Hacker News139

Kubernetes on RPI3 cluster45%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Kubernetes on RPI3 cluster

Hacker News9

Graphite and StatsD Cluster on Kubernetes45%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Graphite and StatsD Cluster on Kubernetes

Hacker News2

Configuring Kubernetes with Solvent53%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Configuring Kubernetes with Solvent

Hacker News2

EKG – Healthchecks in a Sidecar on Kubernetes Deployments50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

EKG – Healthchecks in a Sidecar on Kubernetes Deployments

Hacker News2

Clojure on Kubernetes Quickstart47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Clojure on Kubernetes Quickstart

Hacker News3

Kustomize, customization of kubernetes YAML configurations58%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Kustomize, customization of kubernetes YAML configurations

Hacker News2

Gravity – Kubernetes snapshots for on-premise deployments42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Gravity – Kubernetes snapshots for on-premise deployments

Hacker News70

Browse all products Analyze your launch