Security & Virus | Hardware | Windows XP | Windows Vista | PC Gaming

Eliminating Duplicates from File

Comment:

We have a file like the following data. (emplid | exclude type | exclude reason) 01000000010|1|01 01000000010|1|03 01000000080|1|01 01000000080|1|02 01000000090|1|04 01000000100|1|01 01000000100|1|11 We want to sort the data and get one row for each emplid having lowest exclude reason through unix script. The out put should be like this. 01000000010|1|01 01000000080|1|01 01000000090|1|04 01000000100|1|01

Name: nails
Date: May 12, 2008 at 06:57:17 Pacific

Reply:

#!/bin/ksh sort -u -t"|" -k 1,1 myfile.txt

0

Need to know important co...

Simple Unix script

Post Locked

This post is quite old and has been locked from receiving new replies. Please create a new posting instead.

Summary: I have a file (sme.txt) that contains 530,000 records. Sample 5 lines of the file: LBAB1 0000006982 11119026 01224624005 19880421 99991231 (end line) LBAB1 0000006982 11119026 01224626366 19940915 999...

Summary: Hi, I want to read a file in a C shell script and process all the words of each line as a command set. something like this read line from file get the first word from line and assign it to a var...

Summary: Well, I think you could do something like this..( the earlier one will not give the result as the file1 and file2 are not read in order). grep -v "summed" file1 > file3 [removed the first line from fi...