Show HN: Distributed, sharded in-memory cache and proxy for S3

Show HN: Distributed, sharded in-memory cache and proxy for S3(github.com)

4 points by adrianchifor 5 years ago | 2 comments

sdfhbdf 5 years ago |

That's a very interesting idea.

Is there an example use case this could be useful for? Storing some audio/video media for example?

Am I understanding it correctly that it's kind of Redis with S3 persistance?

adrianchifor 5 years ago | |

The same way you would use redis to cache your expensive dbms queries, you can use this as the 'redis' for S3 blobs.

We use it at my firm to cache frequently accessed ML models and training data. Getting these directly from S3 can take a few seconds per blob, and with the cache it takes that down to milliseconds.