Can the person I am passing speed up during my attempt to pass?

Yes, until you successfully complete a pass (meaning your front wheel has passed their front wheel) they have right of way and may choose to slow down or speed up until you assume right of way by completing your pass.