InterSystems integration with Kafka

Has anyone done any integration with Kafka, especially prior to IRIS? If yes what was your experience such as specific pain points to be overcome.

 

David

  • 0
  • 0
  • 119
  • 0
  • 1

Answers

If you are planning to implement an interface with Kafka, I suggest reading the following:

https://docs.intersystems.com/latest/csp/docbook/DocBook.UI.Page.cls?KEY...
https://community.intersystems.com/post/ensemble-rabbitmq-java-client-qu...

When it comes to specific pain, there are just a lot of pieces to maintain compared to common interfaces, such as HL7, etc.
Also, if you plan to send a large volume of messages, you'll have to do that asynchronously. The problem with that is you may send 100 or even 1000 messages before you realize there is a connection or other problem. You'll have to think of a way to keep track of what messages have been sent successfully and which didn't, and requeue messages that have failed. Of course, if you are not worried about "losing" messages, that's not an issue.