nbsnapshot – Snapshot testing for Jupyter notebooks

Hacker News

I want to share a project I've been working on to facilitate Jupyter notebook testing (https://github.com/edublancas/nbsnapshot). When analyzing data in a Jupyter notebook, I unconsciously memorize "rules of thumb" to determine if my results are correct. For example, I might print some summary statistics and become skeptical of some outputs if they deviate too much from what I've seen historically. For more complex analysis, I often create diagnostic plots (e.g., a histogram) and check them whenever new data arrives. Since I constantly repeat the same process, I figured I'd code a small library to streamline this process. nbsnapshot benchmarks cell's outputs with historical results and raises an error if the output deviates from an expected range (by default, 3 standard deviations from the mean). To learn more, check out the blog post (https://ploomber.io/blog/snapshot-testing/). I quickly put together this as a proof of concept and would love to learn if this sounds useful for other notebook users so I spend more time working on it. Please share your feedback!

Visit product View on Hacker NewsJul 4, 2022

Share card

Actual performance

2points

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Product HuntOn track for Day 1 leaderboard · Strong signals: user, new, code · Missing: mac, agents, macos

74%74% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Indie HackersFits the IH revenue-focused audience · Missing: supports, reddit linkedin, podcasting

54%54% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

TrustMRRLess likely to generate early MRR · Strong signals: users · Missing: mobile apps, ios, personal

43%43% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

Hacker NewsMay not resonate with HN audience · Strong signals: io · Missing: https docs, excited, just released

34%34% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

AppSumoMay struggle as an AppSumo deal · Strong signals: users · Missing: plus, platform, intuitive

26%26% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Strong signals: arr · Missing: mrr, revenue, profit

13%13% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Treon – Testing Framework for Jupyter Notebooks54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Treon – Testing Framework for Jupyter Notebooks

Hacker News4

Observable Notebooks67%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Observable Notebooks

Hacker News654

ipynb-tex – Jupyter Notebooks and TeX57%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

ipynb-tex – Jupyter Notebooks and TeX

Hacker News4

Euporie, a Tui for Jupyter Notebooks60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Euporie, a Tui for Jupyter Notebooks

Hacker News150

Livebook, code notebooks in Elixir (Phoenix LiveView)80%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Livebook, code notebooks in Elixir (Phoenix LiveView)

Hacker News10

An Alternative to Jupyter Notebooks61%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

An Alternative to Jupyter Notebooks

Hacker News2

Datafied26%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Explore Jupyter notebooks

Indie Hackers1analytics

Ploomber Cloud Notebooks – Share Jupyter notebooks with one click58%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Ploomber Cloud Notebooks – Share Jupyter notebooks with one click

Hacker News5

Jupyter Notebooks to Slides52%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Jupyter Notebooks to Slides

Hacker News2

ChefSpec – RSpec testing for Chef Cookbooks33%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

ChefSpec – RSpec testing for Chef Cookbooks

Hacker News3

Browse all products Analyze your launch