While holding down the Shift key, click the object. Its handles disappear. Handles on the other selected objects will remain.
Overview
Content Tools
While holding down the Shift key, click the object. Its handles disappear. Handles on the other selected objects will remain.