build: Don't overlink gallium xlib target