Hive developer in our organization prefers to create the multiple subdirectories to store the data inside parent directory mentioned in DDL for unpartitioned tables but bigsql only looks up for ORC files in parent directory. It doesnt even bother checking subdirectories. Hive instead read all the sub directories and displays the result.
Example - create table t1 ( c1 int) location hdfs:///tmp stored as orc;
Now the developers have created few sub folders inside the parent /tmp directory in hdfs to store the data.
In this scenario, bigsql only tries to read the data from /tmp directory and display an empty table because it cannot read the data recursively.
|Role Summary||Hadoop Administrator|
NOTICE TO EU RESIDENTS: per EU Data Protection Policy, if you wish to remove your personal information from the IBM ideas portal, please login to the ideas portal using your previously registered information then change your email to "email@example.com" and first name to "anonymous" and last name to "anonymous". This will ensure that IBM will not send any emails to you about all idea submissions