Avoid extract set red

Ensure we do not extract when the vector is actually full of the same value. But this can only be done if it is not followed by merge (otherwise the duplicate value will pollute the merge)