nir/spirv: Remove unneeded parameters from pointer_to_offset