There's a theorem that says that a feed-forward neural net with a single hidden layer containing a finite number of neurons can approximate any continuous function on a compact subset of Rn. Here's a Tensorflow implementation of just such a Universal Approximator.
