Ingesting 1Gbps of logs into ClickHouse for $180/month

Ingesting 1Gbps of logs into ClickHouse for $180/month(opendata.dev)

18 points by apurvamehta 104 days ago | 3 comments

mannyv 103 days ago |

You don't really need clickhouse in this pipeline. And it's interesting (but obvious once said) that you can replace kafka with s3...at least in the "scalable and reliable destination for lots of data" dimension.

apurvamehta 102 days ago | |

It's a demonstration. Kafka is a very popular input for Clickhouse. So are data lakes. The point is neither need Kafka at all.

mannyv 101 days ago | | |

That's how far s3 has come - it's replacing products that were the pinnacle of scalability back in the day.

I have to look a bit, but it could probably replace Cassandra now as well.