Computing.Net > Forums > Unix > Comparing two huge files

Computer Problems? Computing.Net has over 1,000,000 posts about all things technology related! Over 90% answered within 24 hours! Click here to start participating now! Also, be sure to check out the New User Guide.

Comparing two huge files

Reply to Message Icon

Name: pyaranoid
Date: September 11, 2008 at 19:47:32 Pacific
OS: UNIX
CPU/Ram: 1GB
Product: IBM
Comment:

Hi,

As per my requirement, I need to take difference between two big files(around 6.5 GB) and get the difference to a output file without any line numbers or '<' or '>' in front of each new line.

As DIFF command wont work for big files, i tried to use BDIFF instead.

I am getting incorrect number of records.

I have done the following test:

I have got a dat file with a few million records in it and to generate a another file i have used sed '1,100d' oldfile > newfile

so i am using Bdiff oldfile newfile | sed -n '/^</p' > DIFF.DAT

The output(DIFF) should be having 100 records in it. But i am getting an output with several records in it.

Could anyone help me out from this situation?

Thanks

Sue



Sponsored Link
Ads by Google

Response Number 1
Name: pyaranoid
Date: September 13, 2008 at 07:17:04 Pacific
Reply:

Any Suggestions please?


0
Reply to Message Icon

Related Posts

See More







Post Locked

This post is quite old and has been locked from receiving new replies. Please create a new posting instead.


Go to Unix Forum Home


Sponsored links

Ads by Google


Results for: Comparing two huge files

Find match in two diff files at tim www.computing.net/answers/unix/find-match-in-two-diff-files-at-tim/8061.html

compare two files and diff file wil www.computing.net/answers/unix/compare-two-files-and-diff-file-wil/7363.html

compare two files field string www.computing.net/answers/unix/compare-two-files-field-string/8078.html