Parallel Pipe

by admin — last modified 2008-11-05 13:57

Tool for executing piped commands in a parallel environment.

http://gforge.cyfronet.pl/projects/parpipe/

Parallel pipe is a program designed to allow commands to be run in a grid/cluster environment. Such environments provide parallel execution of many tasks, so we can distribute our work across many nodes. Therefore our command has a chance to be run much faster than in a normal way. Not to mention that usage of this tool is very simple and intuitive.

For example let's say that we have to execute following command:

cat /etc/passwd | tr a A | sort

If we had a 2-node machine than we would use Parallel Pipe in a following way:

parpipe 'cat /etc/passwd | tr a A | sort'

Which would distribute this command on our nodes:

Document Actions

Baltic Grid Second Phase (BalticGrid-II) project is funded by the EU within the framework of the Seventh Framework Programme, in the 'Research infrastructures' activity area, FP7-INFRA-2007-1.2.3: e-Science Grid infrastructures, contract No 223807.