wayland: Handle global_remove event as well