Thanks. I wan to remove the sep character from the streaming output, even if the input line contains no sep and hence the whole line is treated as the key. Is there any method?
2011/12/27 Mahadev Konar <[email protected]> > Bccing common-user and ccing mapred-user. Please use the correct > mailing lists for your questions. > > You can use -Dstream.map.output.field.separator= > for specifying the seperator. > > The link below should have more information. > > > http://hadoop.apache.org/common/docs/r0.20.205.0/streaming.html#Customizing+How+Lines+are+Split+into+Key%2FValue+Pairs > > Hope that helps. > > thanks > mahadev > > > On Mon, Dec 26, 2011 at 2:42 AM, devdoer bird <[email protected]> wrote: > > > > HI: > > > > In streming MR program, I use /bin/cat as a mapper and set reducer=NONE, > > but the outputs all end with a tab separator. How do I configure the > > streaming MR program to remove the ending separator? > > > > Thanks. >
