panfrost/midgard: Lower source modifiers for ints