You could lose the rewards you’ve earned if you cancel a credit card without a plan — a smarter option is to downgrade the card instead. When you switch to a no-annual-fee card within the same card ...