Can I swim to either side of the swim buoys?

Swimming to either side of a “sight buoy” is allowed but one must always turn on the outside of a “turn buoy” in order to complete the prescribed course.