The diffusion over a simple parabolic barrier is exactly solved with a non-Markovian Generalized Langevin Equation. For a short relaxation time, the problem is shown to be similar to a Markovian one, with a smaller effective friction. But for longer relaxation time, the average trajectory starts to oscillate and the system can have a very fast first passage over the barrier. For very long relaxation times, the solution tends to a zero-friction limit