If I’m passed, can the person who passed me slow down?

Yes, once a pass is complete the cyclist who completed the pass has right of way and may slow down.