Defeats the inherent risk in the system. It'd be too easy to make sure the disadvantages you land are just things that will never matter for your character. Introducing a change like this would also require everyone be given a free mulligan to offset the fact that they weren't picking with this safety in place.