anv: Drop some unneeded ANV_FROM_HANDLE for physical devices