pan/bi: Ignore swizzle in unwritten component