nir/spirv: Rework the way pointers get dereferenced