cunoFS – mount S3/AZ/GCP storage without FUSE, 60x faster than s3fs

Hacker News

cunoFS – mount S3/AZ/GCP storage *without* FUSE, 60x faster than s3fs

Hello HN! We’re Dan and Vaughan, based in Cambridge, UK. We recently launched cunoFS, a filesystem for fast, POSIX object storage access. Yes, we’ve heard that “Object Storage is just not suitable for POSIX workloads” or that “workloads should be rewritten to natively support S3”. But what if it could be? And often much faster than S3-native apps? We’ve worked hard to make this possible, without the shortcomings of other approaches. Summary here: - Run (unmodified) applications with S3/AZ/GCP or “S3 compatible” storage, for example: ls s3:// az:// gs:// ffmpeg -i s3://bkt/vid.mov -c copy s3://bkt/vid.mp4 rsync --inplace -Wav $(pwd) az://myaz/bucket auto fd = open("az://myaz/bucket/file.mp4", O_RDWR); read(fd, buf, 1024); - POSIX-compliant: supports symlinks, hardlinks (emulated), UIDs & GIDs, permissions, random writes, etc. - No additional server or gateway needed. Each object is a file, each file is an object directly accessible on native S3/AZ/GCP. No scrambling of data into a funky backend format. - Bypass FUSE and maximise performance with our ultra-fast syscall interception engine (Dynasaur [2]), or optionally run as a FUSE filesystem - Super fast - for many benchmarks it beats EFS, FSx Lustre or even attached EBS - Benchmarked at 50+ Gbps per EC2 node ⇔ AWS S3, scaling to 10+ Tbps [1] - 60x faster than s3fs in small file benchmark (copying Linux kernel source files) - PyTorch dataset reads boosted up to 13x (with accelerator package installed) - Supports virtual mount points, FUSE mount points, and direct URI access. Pricing: cunoFS is free for personal use. You need to register for a free license after 14 days. For commercial use, we offer a 30-day free eval license. Check out our docs [3], or download now from our website [4]. P.S. Calling for partnerships/collaborations: We’re thinking of opening up Dynasaur, our ultra-fast syscall interception engine [2]. It covers all binaries (dynamic, static and semi-static) and runs in unprivileged containers/serverless. It can virtualise Linux kernel functionality and dynamically augment it with something else, without needing special privileges. Applications include user mode networking, live process migration, memory offloading, virtualisation, analytics, user-mode kernel experimentation, and of course running other FUSE file systems faster, without the FUSE bit. Please let us know if you are interested. Looking forward to your feedback! [1] https://cuno.io/technology/ [2] https://cuno.io/technology-details/#The_problem_with_SHIMs [3] https://cuno-cunofs.readthedocs-hosted.com/en/stable/ [4] https://cuno.io/download/

Visit product View on Hacker NewsMar 8, 2024

Share card

Actual performance

19points

4comments

Made the leaderboard

Launch Intel predictions

Analyze your own launch →

Indie HackersFits the IH revenue-focused audience · Strong signals: supports, compatible · Missing: reddit linkedin, podcasting, created

93%93% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Product HuntOn track for Day 1 leaderboard · Strong signals: apps, user, open · Missing: mac, agents, macos

74%74% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: filesystem, io · Missing: https docs, excited, just released

65%65% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

AppSumoMay struggle as an AppSumo deal · Strong signals: host · Missing: plus, platform, intuitive

41%41% predicted probability of success on AppSumo, based on ML models trained on real launch data.

TrustMRRLess likely to generate early MRR · Strong signals: personal, apps, way · Missing: mobile apps, ios, entrepreneurs

35%35% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Missing: arr, mrr, revenue

17%17% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Correct prediction on native model

Similar products

S3 Storage Addon for Atropim47%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

S3 Storage Addon for Atropim

Hacker News1

Kev – S3 and Redis as Datastores (with Redis Indexing)60%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Kev – S3 and Redis as Datastores (with Redis Indexing)

Hacker News8

Cache for S354%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Cache for S3

Hacker News8

S3Broker – CF Worker library to protect your S3 storage from ransomware48%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

S3Broker – CF Worker library to protect your S3 storage from ransomware

Hacker News1

WeSQL – Agile MySQL with S3-Based Storage43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

WeSQL – Agile MySQL with S3-Based Storage

Hacker News4

WeSQL44%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Agile MySQL with S3-Based Storage

Product Hunt+9

Airbox: S3-Compatible Storage for the Masses. Ready in One Click.51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Airbox: S3-Compatible Storage for the Masses. Ready in One Click.

Hacker News23

Minio – S3 Compatible Object Storage51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Minio – S3 Compatible Object Storage

Hacker News49

Uploadjoy30%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Object storage SaaS alternative to S3.

Indie Hackers1analytics

S3io.com – using Amazon S3 for personal storage54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

S3io.com – using Amazon S3 for personal storage

Hacker News40

Browse all products Analyze your launch