pan/midgard: Track pressure when scheduling ld/st