vk: Flip back to using memfd for the allocators