Kafka-on-Pulsar: bring native Kafka protocol support to Apache Pulsar

Kafka-on-Pulsar: bring native Kafka protocol support to Apache Pulsar(streamnative.io)

19 points by lmsp 6 years ago | 7 comments

tiew9Vii 6 years ago |

Does anyone know what is happening with Pulsar since Splunk brought them out?

It looks to of stagnated since the announcement was made.

Architecture wise Pulsar is a far better piece of engineering than Kafka but with Confluent's funding and aggressive marketing it looks like Kafka has cornered the market for better or worse.

adamfeldman 6 years ago | |

Splunk bought a company called Streamlio [1].

StreamNative is the company behind the linked blog post and project.

My (outsider) understanding is that both Streamlio and Splunk employ(ed) active members of the Pulsar community.

[1]: https://www.splunk.com/en_us/blog/leadership/splunk-to-expan...

oweiler 6 years ago | |

I always hear it's better architecture-wise but what are the real life implications of difference?

Also, Kafka has:

* ksql * ksqlDB * Kafka Connect * Kafka Streams

Does Pulsar has something comparable?

thenaturalist 6 years ago | | |

Yes, you can run SQL using Presto [1], and by connecting. Not sure about ksqlDB as I am not familiar with it, but my understanding is Apache Flink would give you analog capabilities. Pulsar has IO capabilities analog to Kafka Connect [2]. Analogous to Kafka Streams, Pulsar offers Functions [3].

[1] http://pulsar.apache.org/docs/en/sql-overview/

[2] http://pulsar.apache.org/docs/en/io-overview/

[3] http://pulsar.apache.org/docs/en/functions-overview/

Anonymitaet 6 years ago |

KoP GitHub repo: https://github.com/streamnative/kop

Anonymitaet 6 years ago |

More details about KoP: https://streamnative.io/blog/tech/2020-03-24-bring-native-ka...

Anonymitaet 6 years ago |

KoP Webinar: https://zoom.us/webinar/register/6515842602644/WN_l_i-3ekDSg...