They say, "If the All Merciful had so willed, we would not have worshipped them." They have no knowledge of that. They are only conjecturing.