Po

PostgreSQL backup manager with BTRFS block-level deduplication

Hacker News

PostgreSQL backup manager with BTRFS block-level deduplication

I wrote BTRFS block level de-duplication sometime in 2020 as use-case for a patch sent in 2015 https://stackoverflow.com/a/34163236 and now after 6 more years created an use-case for dduper via pgdedup! How it works? Consecutive pg_basebackup snapshots share most of their blocks. Store them uncompressed on BTRFS and let dduper deduplicate it. Interestingly: - gzip completely breaks block-level dedup. Two pg_basebackup -z runs of the same database produce < 1% matching blocks. - Chunk size matters hugely. dduper's default 128KB chunks only found 19% savings. Lowering to 8KB (PostgreSQL's page size) jumped to 68%.

Share card

Actual performance

2points
Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →
Hacker NewsMay not resonate with HN audience · Strong signals: io · Missing: https docs, excited, just released
47%47% predicted probability of success on Hacker News, based on ML models trained on real launch data.
nativeThis product was originally launched on this platform.
TrustMRRLess likely to generate early MRR · Missing: mobile apps, ios, personal
43%43% predicted probability of success on TrustMRR, based on ML models trained on real launch data.
Product HuntUnlikely to reach the leaderboard · Missing: mac, agents, macos
39%39% predicted probability of success on Product Hunt, based on ML models trained on real launch data.
AppSumoMay struggle as an AppSumo deal · Missing: plus, platform, intuitive
36%36% predicted probability of success on AppSumo, based on ML models trained on real launch data.
Indie HackersIH features products with proven revenue · Strong signals: created · Missing: supports, reddit linkedin, podcasting
36%36% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.
Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue
15%15% predicted probability of success on Acquire.com, based on ML models trained on real launch data.
BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto
2%2% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

Da
Databasus – open-source backup tool for PostgreSQL, MySQL and MongoDB50%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Databasus – open-source backup tool for PostgreSQL, MySQL and MongoDB

Hacker News10
Po
PostgreSQL backup tool Databasus moved to PG 17 native physical backups55%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

PostgreSQL backup tool Databasus moved to PG 17 native physical backups

Hacker News1
Po
PostgreSQL backup tool Databasus moved to PG 17 native physical backups59%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

PostgreSQL backup tool Databasus moved to PG 17 native physical backups

Hacker News2
Ka
Kafka FDW for PostgreSQL65%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Kafka FDW for PostgreSQL

Hacker News2
es
es2postgres – ElasticSearch to PostgreSQL Loader71%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

es2postgres – ElasticSearch to PostgreSQL Loader

Hacker News3
Me
Metagration: PostgreSQL Migrator in PostgreSQL56%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Metagration: PostgreSQL Migrator in PostgreSQL

Hacker News1
PR
PRQL in PostgreSQL73%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

PRQL in PostgreSQL

Hacker News267
UpBack
UpBack35%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Secure, automated backup and recovery for MySQL, MariaDB, and PostgreSQL

AppSumo1
Cr
Cronicle, backup archives rotation triggered by cron56%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Cronicle, backup archives rotation triggered by cron

Hacker News1
HN
HN Upvote Backup and JSONify43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

HN Upvote Backup and JSONify

Hacker News3