BucketArchiver – A Lean Solution for S3 Bucket to Tarball Workflows
BucketArchiver – A Lean Solution for S3 Bucket to Tarball Workflows
Hi HN, We're the BucketArchiver team and both of us have been working in the field of cloud infra consultancy. Customers frequently asked us to build something that allows them to easily get data out of S3 and so've built something that does exactly that: BucketArchiver. It's basically a workflow along the lines of: (EventBridge scheduler ->) StepFunctions exec -> creates EC2 instance -> reads input bucket -> streams tarball to output bucket -> destroys EC2 instance -> publishes to SNS. Here's why you should consider using it: - makes it simple to maintain archival copies for copying to on-prem or other external to AWS places - does _not_ have any always on EC2 infrastructure that you have to pay for as EC2 instances are spun up/down on demand. - runs within your AWS account and instances have only streaming access to the data on S3 with no local storage. - integrate into existing AWS workflows using StepFunctions and SNS. - Comes with ops tooling such as CloudWatch dashboards and metrics. - Same charge independent of EC2 instance type. - use pigz to compress in parallel to speed things up. - is a AWS marketplace solution delivered as CloudFormation templates. Check it out at https://www.bucketarchiver.com . We have a 14 day trial to check things out first. We're pretty flexible on adding things to BucketArchiver and eager to hear from users. We'd love to hear your thoughts and we're happy to answer any questions you may have.
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
S3-credentials, a tool for creating restricted S3 bucket credentials
S3 Bucket Monitoring – Are your private buckets private?
Stree – tree view of S3 bucket
Vital Lean Keto
S3-OCR: Extract text from PDF files stored in an S3 bucket
Bucketlist, for viewing the file and directory listing of an S3 bucket
Kev – S3 and Redis as Datastores (with Redis Indexing)
Cache for S3
Turn your AWS S3 bucket into an image gallery
Git-s3-push – Deploy your Git repo to an S3 bucket