-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Thu, 15 Nov 2001, srikrishnan wrote:
>I am processing a file which may contain duplicate entries of valid data .. i
>have to check whether any entry in the same file gets repeated till EOF is
>reached.

  man uniq

It requires the data to be sorted so that identical entries are on
successive lines:

  sort < datafile | uniq > new_datafile

If you need to keep the duplicate data or allow for variations in case,
use some of the options described in the man page.

Tony
- -- 
Anthony E. Greene <[EMAIL PROTECTED]> <http://www.pobox.com/~agreene/>
OpenPGP Key: 0x6C94239D/7B3D BD7D 7D91 1B44 BA26  C484 A42A 60DD 6C94 239D
Chat:  AOL/Yahoo: TonyG05
Linux. The choice of a GNU Generation. <http://www.linux.org/>
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.0.6 (GNU/Linux)
Comment: Anthony E. Greene <[EMAIL PROTECTED]> 0x6C94329D

iD8DBQE788QspCpg3WyUI50RAjm4AJ9aMTGkhwPD87KWS47pBgAyRmGlqACeKzPF
h0w414qZYG/Th9Ll6Zdx4iM=
=KX1V
-----END PGP SIGNATURE-----




_______________________________________________
Redhat-list mailing list
[EMAIL PROTECTED]
https://listman.redhat.com/mailman/listinfo/redhat-list

Reply via email to