A former working men’s club could be replaced with two blocks of flats after bosses rejected an offer from Starbucks.