We use BigSql 4.0.1 for 1 year and a half.
Today when we want to plan a maintenance on one of our Hadoop cluster DataNode, we have running BigSql queries that can fail due to node beiing brought down.
I would like the engine to retry the request part on another worker node if the node is no longer reachable.
That way BigSql will be resilient to a single datanode failure.
Remember that datanode failure becomes a fairly normal event if you grow your cluster to 100 or 1000 nodes !!!
Real Scenario + Problem Statement
|Role Summary||Make BigSql Great Again|
|Who would benefit from this IDEA?|
How should it work?
|Geo - Use for OBDR Reporting only|
Why is it useful?
NOTICE TO EU RESIDENTS: per EU Data Protection Policy, if you wish to remove your personal information from the IBM ideas portal, please login to the ideas portal using your previously registered information then change your email to "firstname.lastname@example.org" and first name to "anonymous" and last name to "anonymous". This will ensure that IBM will not send any emails to you about all idea submissions