Generally you want to the reference material used to improve that first version to be correct though. Otherwise it’s just swapping one problem for another.

I wouldn’t use a textbook that was 52% incorrect, the same should apply to a chatbot.