Would anyone know who I have granted consent to be my caregiver? What if I only want to grant consent to a selected few but not all of my caregivers?

The full list of caregivers whom you have granted consent is only viewable and accessible by you. It is up to your own personal discretion on whom you wish to grant consent to.