EnvVar MSFT_HADOOP_COMBINER_DLL is not set...

Sep 10, 2013 at 3:04 PM
Edited Sep 10, 2013 at 3:05 PM
in using the constructor below to work with the local installation without having to use a storage account, I get an error...which MFST says is due to a 'bug' that prevents it from working now.

var db = new HiveConnection( new Uri("http://localhost:50111"), "hadoop", ""); var result = db.ExecuteHiveQuery("select * from mytable;");
result.Wait();

however, digging through the sdk source shows that...
EnvVar MSFT_HADOOP_COMBINER_DLL is not set... and likewise for
MSFT_HADOOP_COMBINER_TYPE
MSFT_HADOOP_REDUCER_DLL
MSFT_HADOOP_REDUCER_TYPE
in src\Microsoft.Hadoop.MapReduce\src\MapReduce\Microsoft.Hadoop.MapReduce\Execution\Hadoop\DriverMains\ReducerCombinerMain.cs

my question is: can I manually set up the missing dll paths and type names, and if so, what values should specified?

thank you.
Coordinator
Sep 11, 2013 at 3:23 AM
Not at the moment. Right now HiveConnection requires Azure Storage account parameters otherwise it will fail. You can configure onebox installation of HDINSIGHT to use Azure Storage as described here: http://gettingstarted.hadooponazure.com/releaseNotes.html#asv