How to set additional arguments like ''mapred.map.tasks"

Jul 19, 2013 at 11:58 AM
I would like to config the number of ''mapred.map.tasks".

The input data for the job is quite small, and was stored in a single file. But a process of each line is quite heavy. So I would like to increase the number map tasks and to complete the job in a shorter duration.

I tried to add argments to HadoopJobConfiguration.AdditionalGenericArguments and to HadoopJobConfiguration.AdditionalStreamingArguments, but it seems no differences. And I checked the job configuation details on the web admin page found no changes in the templeton.args.
Coordinator
Jul 19, 2013 at 6:36 PM
Thank you Wen,
This issue is tracked by https://hadoopsdk.codeplex.com/workitem/30
We are working on fixing this.

Maxim