This questions need more details to give accurate answer like - Salary bracket of your husband, Total Tenure of Term loan passed till date etc. However based on certain assumption i am giving you following answer :
Your annual tax benefit in form of Saving is Rs. 40,000/- (Assuming 20% Salary bracket of your husband), in that case your saving from EMI on annual basis will come to Rs. 42,000/-. Also periodically the interest amount will reduce and principle amount will increase in emi so this gap will broaden. So it is advisable to convert this loan into your name and reduce EMI. However if your husband is in the bracket of 30% than it is advisable not to transfer this loan in your sole name atleast for next couple of years where interest payment is higher and than later on you can shift it in your sole name.