15k jobs/s is on my macbook pro m1 without batching. i did a bit of benchmarking and optimizing, but there are probably quite a few things that can be done to improve throughput. plainjobs is a bit more feature complete than just a bare-bones queue with atomic pop semantic. it supports scheduled cron jobs and auto re-queueing if a worker dies. the queue has an api that can be used to build a dashboard, which is one of the next things i'm going to do. i extracted plainjobs while working on a SQLite stack for web development in TypeScript, hoping it could be useful for others! |
No comments yet