-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thu, 15 Nov 2001, srikrishnan wrote: >I am processing a file which may contain duplicate entries of valid data .. i >have to check whether any entry in the same file gets repeated till EOF is >reached.
man uniq It requires the data to be sorted so that identical entries are on successive lines: sort < datafile | uniq > new_datafile If you need to keep the duplicate data or allow for variations in case, use some of the options described in the man page. Tony - -- Anthony E. Greene <[EMAIL PROTECTED]> <http://www.pobox.com/~agreene/> OpenPGP Key: 0x6C94239D/7B3D BD7D 7D91 1B44 BA26 C484 A42A 60DD 6C94 239D Chat: AOL/Yahoo: TonyG05 Linux. The choice of a GNU Generation. <http://www.linux.org/> -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.0.6 (GNU/Linux) Comment: Anthony E. Greene <[EMAIL PROTECTED]> 0x6C94329D iD8DBQE788QspCpg3WyUI50RAjm4AJ9aMTGkhwPD87KWS47pBgAyRmGlqACeKzPF h0w414qZYG/Th9Ll6Zdx4iM= =KX1V -----END PGP SIGNATURE----- _______________________________________________ Redhat-list mailing list [EMAIL PROTECTED] https://listman.redhat.com/mailman/listinfo/redhat-list