Yes speculative execution will affect your tasks, please read the FAQ to understand the use of OutputCommitters: http://wiki.apache.org/hadoop/FAQ#Can_I_write_create.2BAC8-write-to_hdfs_files_directly_from_map.2BAC8-reduce_tasks.3F
On Thu, May 17, 2012 at 2:02 PM, Abhay Ratnaparkhi <[email protected]> wrote: > I have multiple reducers running simmultaneously. Each reducer is supposed > to output data in different file. > I'm creating a file on HDFS using fs.create() command in each reducer. > Will speculative execution of tasks affects the output as I'm not using any > outputFormat provided? > > ~Abhay -- Harsh J
