The disbelievers frightened you so much that you almost decided to flee. If it would have happened (as it happened a year later), they would not have stayed in power for a long time (as it took only eight years that Mohammad triumphantly returned to Mecca and after years everyone embraced Islam.)