swr/rast: Remove unneeded copy of gather mask