parallel

Run commands on multiple CPU cores. tldr-pages

On several platforms

Several platforms

Gzip several files at once, using all cores

parallel gzip ::: path/to/file1 path/to/file2 ...Identify

Read arguments from stdin, run 4 jobs at once

ls *.txt | parallel --jobs 4 gzipIdentify

Convert JPEG images to PNG using replacement strings

parallel convert {} {.}.png ::: *.jpgIdentify

Run like xargs in parallel, cramming as many arguments as possible onto one command

args | parallel -X commandIdentify

Break stdin into ~1M blocks, feed each block to stdin of new command

cat big_file.txt | parallel --pipe --block 1M commandIdentify

Run on multiple machines via SSH

parallel --sshlogin machine1,machine2 command ::: arg1 arg2Identify

Download 4 files simultaneously from a text file containing links showing progress

parallel --jobs 4 --bar --eta curl --silent --remote-name {} :::: path/to/links.txtIdentify

Print the jobs which parallel is running in stderr

parallel --verbose command ::: argsIdentify