It is only those who believe not in Allah and the Last Day and whose hearts are in doubt that ask your leave (to be exempted from Jihad). So in their doubts they waver.