Que, a Ruby-PostgreSQL job queue with ~20x the throughput of DelayedJob
Que, a Ruby-PostgreSQL job queue with ~20x the throughput of DelayedJob
Hi everyone - I wrote a job queue called Que, which uses Postgres' advisory locks to manage jobs very efficiently. My goal is to make it easy to cover jobs with the same ACID guarantees as the rest of your data. It won't be as fast as a dedicated or Redis-backed queue, but I expect it will be fast enough for many use-cases. https://github.com/chanks/que The 20x figure comes from a benchmark I ran on an AWS c3.8xlarge instance - this number will change depending on your hardware. The code for the benchmark (and some more detailed results) is here: https://github.com/chanks/queue-shootout I'm very much open to thoughts and suggestions - please let me know what you think.
Share cardActual performance
Launch Intel predictions
Analyze your own launch →Incorrect prediction on native model
Similar products
Que, a crazy-fast Ruby-PostgreSQL job queue
PgQueuer – Transform PostgreSQL into a Job Queue
Kafka FDW for PostgreSQL
es2postgres – ElasticSearch to PostgreSQL Loader
Metagration: PostgreSQL Migrator in PostgreSQL
PRQL in PostgreSQL
NoQMS – No Queue Microservices – and a Java Implementation
A queue for Rails
Simple Background Job with PostgreSQL
Micro job queue in nodeJS built on mongo