Computer Problems? Computing.Net has over 1,000,000 posts about all things technology related! Over 90% answered within 24 hours! Click here to start participating now! Also, be sure to check out the New User Guide.
Awk duplicate record elimination
Name: Radhe Date: February 21, 2006 at 01:10:54 Pacific OS: HP-UX CPU/Ram: K Product: HP
Comment:
I need to eliminate duplicates in a text file, and I'm thinking to use Awk, but am a little unsure how to proceed. My input file is like this: Line1:data Line2:data ... Line8:data ...
Each 8 lines make up a record (total 3000 records), but there are some duplicates. A unique record is made up of the combination of the data from Line 1 & Line 2. If a record is not unique I must delete the full 8 lines associated. Any suggestions on how to go about it?
Summary: I am trying to identify duplicate records in a file, once the records are identified my program must raise a flag and list out the duplicate records. pavan ...
Summary: Hi, I have a file with duplicate records in it. I want to identify the duplicate records and put them into a separate file. Please let me know how to do it. Please note that each record is 2 lines in ...
Summary: Hi, I am looking for a script/command to identify duplicate records by certain columns in a given file and write them to an other file. Could anybody suggest me a solution? ...
