I would like to receive events for certain operations, for example when a file has been closed and uploaded to cos.
It would be great if these events could also be routed to a message hub topic so that they could be consumed more easily outside of streams.
These events can be used to build more sophisticated data pipelines. For example, after streams has uploaded a file to cos, the events get sent to a message topic. I can then have a separate streams application that listens for these events and based on some criteria makes an api call to kick off an IBM Analytics Engine or WDP Sql Service call to perform some post processing of the files.
Why is it useful?
|Who would benefit from this IDEA?||Data engineer|
How should it work?