cmandesign/split & grep file in file.md

Last active January 15, 2020 09:04

Star (0) You must be signed in to star a gist
Fork (0) You must be signed in to fork a gist

Select an option

Learn more about clone URLs
Clone this repository at <script src="https://gist.github.com/cmandesign/bb970ee77ac6f973253cc594b5e9420e.js"></script>
Save cmandesign/bb970ee77ac6f973253cc594b5e9420e to your computer and use it in GitHub Desktop.

Download ZIP

Find common records between two large files with grep

Raw

split & grep file in file.md

Here is the command to search records in the first file inside of the second file :

grep -f firstFile.csv SecondFile.csv > FoundRecords.csv

But if there are more thant 100k records on each file, you must split them into 100K line to prevent the command get killed or become not responding. Here is the command to split the file :

split -l 100000 sourceFile.csv sourceFile_part_

cmandesign/split & grep file in file.md

Select an option

No results found

Select an option

No results found