The former New Haven police chief abruptly retired after admitting he stole money from a fund used to pay confidential informants who help detectives solve crimes, Mayor Justin Elicker said Monday.