Remove a few spurious assertions (#4294)