1 ) If you are being charged by Amazon, that means you have a Professional seller account
Seller Central page: Settings: Your Services
Change it from Professional to Individual This will stop the billing
2 ) once you have done this put your account on Vacation
Settings: Listing Status: Going on Vacation
3 ) Note that you are still liable for all unpaid chargebacks and refunds and any that come in for the next 3 to 6 months EVEN IF you close your store.