Aside from https://gym.openai.com/docs :
Consider symbolic arithmetic, 12 + 34 - 56. Feed every digit and operator as a scalar. Get out digits. It’s easy to generate different permutations of inputs and calculate correct outputs.
Can DL or Nupic learn this?