If I close my account will the remaining balance be subject to Bank of England Base Rate changes whilst I pay it off?

Your interest rates move in line with the Bank of England Base Rate. However, changes to the Base Rate (up or down) won't affect you if you close your account. You'll just need to continue to pay your balance down at your current interest rate, until it's cleared.