Analytics (old portal)

This portal has been closed.  You will be redirected to the new portal at https://ibm-data-and-ai.ideas.aha.io

Provide a managed NiFi service for creating and running data pipelines

Nifi is a popular open source tool for building data pipelines.  It would be great if nifi was available as a managed service as part of the WDP. 

The service should ideally have source and target connectors for the following IBM Cloud services (and probably more):

  • Cloud object storage
  • Message Hub
  • IBM Analytics Engine
    • Hive
    • HBase (Phoenix)
  • DB2 Warehouse on Cloud
  • Cloudant
  • Compose Postgresql
  • Compose Mysql
  • Compose ScyllaDB
  • Compose Elasticsearch
  • Watson Knowledge Catalog
  • Watson Discovery

There should also be the ability to upload custom connectors.

See here for an old (but good) 5 minute summary video.

  • Chris Snow
  • Dec 14 2018
  • Will not implement
Who would benefit from this IDEA? Data engineer
Idea Priority High
  • Attach files
  • Arancha Ocaña commented
    14 Dec, 2018 05:58pm

    Even full HDF (SAM, Storm ...)

  • STUART MACLEAN commented
    14 Dec, 2018 05:58pm

    Excellent idea. 

  • Hung Le commented
    14 Dec, 2018 05:58pm

    that's something we always need.

  • JAUME MIRALLES SOLE commented
    14 Dec, 2018 05:58pm

    Don't forget Watson Discovery connector. At the end is a repository of enriched documents.

  • +22