vk/pipeline: Track VB's that are actually used by the pipeline