To deselect an object or group of objects from a selection
Choose the Selection tool () or the Utility tool ().
Hold down the <Shift> key as you fence the objects in the selection you want to deselect.
This deselects the selected objects within and crossing the rectangular area, and selects any objects in the rectangular area not previously selected.