In a small bowl, add pumpkin, sugar, heavy cream, egg and spices. Stir until combined. Add a splash of water and cream if mixture is too thick. Place bread in a baking dish and cover with custard mixture. Stir to combine, then let set.
In a small bowl, mix brown sugar, butter and almonds; place on top of bread. Bake at 350 degrees for 6 to 8 minutes. Serve with whipped cream.