gallium/util: don't depend on implementation defined behavior in listen()