Notification for another driver for Apache Pulsar (a.k.a magnetar)

[FlorentinDUBOIS]

Hello folks! (poke @BewareMyPower @jiangpengcheng @darinspivey @PookieBuns @chamons)

I wanted you to know that we have open-source another driver for pulsar which name is magnetar (https//github.com/CleverCloud/magnetar).
We did it as we struggle to contribute on pulsar-rs due to the channel logics in pulsar-rs (even though we were the first to introduce it in pulsar-rs at Clever Cloud).

What I am looking for, is for your feedback on the driver itself as we had a different approach of the current pulsar-rs as magnetar use a full sans-io pattern with simulation for every features, we also leveraged a lot AI to close the gap on feature parity with the current java driver which is the reference to me.

I also wrote a blog post at Clever Cloud to help you understand our motivation behind the rewriting https://www.clever.cloud/blog/engineering/2026/07/15/magnetar-rust-apache-pulsar-client-deterministic-simulation/

I hope this will find you well and have a worderful day and week.

PS: I will be glad, if you want to, discuss in real of the driver :)

PPS: It runs on Clever Cloud production already processing thousands of messages per seconds :P

See you!

[FlorentinDUBOIS]

Feel free to close the issue, if you do not think it is pertinent :)

[merlimat]

@FlorentinDUBOIS This looks very interesting. Would you be open to have the new library as part of Apache project? That would be great for the ecosystem. Also, it would be great to have this adopting the scalable topics spec.

[FlorentinDUBOIS]

Hello @merlimat, nice to hear from you! Yes, I will be glad to open it as part of the Apache project, this is also why I want to hear from people of StreamNative and Apache Foundation.

The driver already support the scalable topic spec under a feature flag with a note flagging it as experimental while it is not release officially in a stable Apache Pulsar version.