The tangled web they weave -- Exploring neural networks with directed topology