While you may notice differences in your vagina at any time, these can become more obvious in your 40s and 50s.