If you're about to protest that infinite goodness, by definition, wouldn't allow evil to exist, you're not alone.
Classic non-sequitur.
The key being ''infinite goodness'' - the presence of evil means that goodness is not infinite. The presence of evil means that God is part good, part evil