Antonyms of begin:
cease, end, finish, stop, terminate, desist, discontinue, halt, knock off, lay off, quit, close, complete, abandon, forsake, leave, abolish, demolish, destroy, exterminate, extinguish, phase out, conclude, disappear, dissolve, evaporate, vanish, depart, die, expire, pass away, perish, annihilate, annul, nullify, round, wind up, wrap up, shut.
Examples of usage:
  1. Begin with your family.
    "Godliness", Catherine Booth.
  2. All in to begin?
    "The Black Bar", George Manville Fenn.
  3. Are we to begin from the first?
    "The Three Lieutenants", W.H.G. Kingston.