vc4: Avoid flushing when mapping buffers that aren't in the batch.