passed means gone by: Many years had passed.
past is the time before the present: In the past, we haven’t allowed that.

Note also the expression “pastime”, meaning a way of passing the time. It should not be written as “passed time”.