Nails, My file size is approximately about 6823009 Bytes. It is taking such a long time to complete if i run using your script. Please suggest another way to improvise this. Thanks Nimi

0

Nails, Please explain this code to me if [[ -n recset ]] then # get rid of the last pipe recset=$(echo "$recset" |sed 's/|$//g') echo $recset fi Nimi

0

use gawk instead of awk.

0

ghostdog, I replaced gawk instead of awk in your script and i got this a.sh: gawk: not found Please help Nimi

0

well, gensub is a gawk externsion. since you don't have gawk, then have to use gsub:try this [code] awk 'BEGIN {FS = "=";c=0; } NR <=5 { next} /\.set/{ c=c+1 ;next} { array[c] = array[c]$2"|"} END { for (e in array) { gsub(/(\")|(\|$)/,"",array[e]) n = split(array[e],f,"|") printf("%s|%s|" , f[2] , f[3]) for (i=1; i<=n ; i++) { printf("%s|", f[i]) } print "" } }' "file" > "outputfile" [/code]

0

Hi Ghostdog/nails, I still get the same error. Furthermore i just realised that I don't need to take the values following .set. Only take records from BSC_NAME. old row AIA1B10|HAFID11|BSC2|AIA1B10|HAFID11|5|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0 new row should be BSC2|AIA1B10|HAFID11|5|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0 TQ Nimi

0

ok..can you try nawk ? if you are using solaris, another location can be /usr/xpg4/bin/awk. nawk works for me too. if you don't need AIA1B10|HAFID11|, then remove printf("%s|%s|" , f[2] , f[3]) from my code.

0

Hi, Ghostdog, Finally it worked (with nawk) and it was super fast. Thanks for the code. Another help is needed. My eof has the following line [..end] .set SHTI25:ZIGYMR8:SHTI25:ZIGYMR7 BSC_NAME="SHTI25" CELL_NAME="ZIGYMR8" NREL_NAME="ZIGYMR7" AWOFFSET=3 BQOFFSET=3 BQOFFSETAFR=3 CAND="BOTH" CS="YES" HIHYST=5 KHYST=3 KOFFSET=0 LHYST=3 LOHYST=3 LOFFSET=0 OFFSET=0 TRHYST=2 TROFFSET=0 ..end How do i ignore the ..end. I realise that this set of record causes the whole output to go hay wire. RWNG05|KIRAM13|PLT1B17|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| (ok) SHTI25|ZIGYMR8|ZIGYMR7|3|3|3|BOTH|YES|5|3|0|3|3|0|0|2|0|| (not ok) RWNG05|KIRAM13|RIS1U11|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| (ok) Ghostdog, can you explain to me your script. Really interested to pick up awk and how can i be good at it? Nimi

0

if you want to skip lines beginning with ..end, you can use ... /^\.\.end/ { next } ... explanation: FS is field separator. I set it '=' , so that the first field $1 will be BSC_NAME, CELL_NAME etc and second field $2 will "BSC2","ANTAM16" and so on. I set c=0, so that i can store to array. come to that later. NR <=5 { next} : If skip reading the first 5 lines. /\.set/{ c=c+1 ;next} : when awk sees the line with .set, i increment c, so c = 1. and awk read the next record { array[c] = array[c]$2"|"} : this means store into array, array[c] will be "" (null) in the first run. since c is 1, then the value of array[1] will be concatenated with $2 (field 2) and then a "|". the result is a line with all $2 concatenated. END {: means before awk exits after processing every line, it performs the code inside END {} for (e in array) {: going through the array gsub(/(\")|(\|$)/,"",array[e]) : substitue every double quotes or the pipe at the end of the line with "" printf("%s|\n", array[e]) : after substitute, print the results. finally, the final code can be like this: [code] awk 'BEGIN {FS = "=";c=0; } NR <=5 { next} /^\.\.end/ { next } /\.set/{ c=c+1 ;next} { array[c] = array[c]$2"|"} END { for (e in array) { gsub(/(\")|(\|$)/,"",array[e]) printf("%s|\n", array[e]) } }' "file" [/code] As for awk reference, you can google for GNU awk. Then look thru the tutorial at its website. happy awking

0

Thanks Ghostdog. I owe you a treat. :) Nimi

0

Ghostdog, Is it alright if the contents of the file is not in order? This is the actually sequence of the input file BSC2|AIA1B10|HAFID11|5|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0 BSC2|ANTAM16|ANTAM17|3|3|3|BOTH|YES|5|3|0|3|3|0|0|2|0 BSC2|ANTAM16|ANTAM18|3|3|3|BOTH|YES|5|3|0|3|3|0|0|2|0 BSC2|ANTAM16|EESTM18|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0 BSC2|ANTAM16|FOOYM16|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0 BSC2|ANTAM16|HAWPM16|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0 BSC2|ANTAM16|JPN1U11|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0 BSC2|ANTAM16|PIN1U12|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0 BSC2|ANTAM16|TOAHU15|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0 BSC2|ANTAM17|ANTAM16|3|3|3|BOTH|YES|5|3|0|3|3|0|0|2|0 BSC2|ANTAM17|ANTAM18|3|3|3|BOTH|YES|5|3|0|3|3|0|0|2|0 BSC2|ANTAM17|EESTM18|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0 BSC2|ANTAM17|FOOYM16|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0 BSC2|ANTAM17|FOOYM18|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0 BSC2|ANTAM17|GMB1U11|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0 BSC2|ANTAM17|GMB1U12|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0 and the output after running your script BSC2|AIA1B10|HAFID11|5|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| BSC2|ANTAM16|ANTAM17|3|3|3|BOTH|YES|5|3|0|3|3|0|0|2|0| BSC2|ANTAM16|ANTAM18|3|3|3|BOTH|YES|5|3|0|3|3|0|0|2|0| BSC2|ANTAM16|EESTM18|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| BSC2|ANTAM16|FOOYM16|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| BSC2|ANTAM16|HAWPM16|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| BSC2|ANTAM16|JPN1U11|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| BSC2|ANTAM16|PIN1U12|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| BSC2|ANTAM16|TOAHU15|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| BSC2|ANTAM17|ANTAM16|3|3|3|BOTH|YES|5|3|0|3|3|0|0|2|0| BSC2|YOWCM28|KRU1B11|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| BSC2|YOWCM28|NCSBM11|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| BSC2|YOWCM28|NIN1U10|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| BSC2|YOWCM28|PIREB11|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| BSC2|YOWCM28|SEPAU11|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| BSC2|YOWCM28|SQU1B11|3|3|3|BOTH|NO|5|3|0|3|3|0|0|2|0| Nimi

0

can you amend the code to something like below and try again. END { for (e=1;e<=c;e++) { gsub(/(\")|(\|$)/,"",array[e]) printf("%s|\n", array[e]) }

0

Ghostdog. It worked. Explanation please? Nimi

0

With reference to previous: /\.set/{ c=c+1 ;next} { array[c] = array[c]$2"|"} this says the items are stored into array, with indices denoted by the value of c, which are just numbers starting from 1 to whatver. so basically when you want to call the array values, it is like this: array[1], array[2].... however, when we displayed the array elements using this format of the for loop: for (e in array) { }, it list out the items in arbitary order. If you want ordered, then we have to go by indices. fortunately we have the array indices stored as numbers starting from 1, so its easy to call them out using this for loop format: for (e=1;e<=c;e++) { }

0