dgsh ― directed graph shell
The directed graph shell, dgsh , provides an expressive way to construct sophisticated and efficient big data set and stream processing pipelines using existing Unix tools as well as custom-built components. It is a Unix-style shell (based on bash ) allowing the specification of pipelines with non-linear non-uniform operations. These form a directed acyclic process graph, which is typically executed by multiple processor cores, thus increasing the operation's processing throughput.
If you want to get a feeling on how dgsh works in practice, skip right down to thesection.
