Interest and penalties paid to the IRS on Federal taxes are not deductible. For more information, refer to Items You Cannot Deduct in Chapter 25, Interest Expense, in Publication 17, Your Federal Income Tax for Individuals; and Tax Topic 505, Interest Expense.

References:

• Publication 17, Your Federal Income Tax for Individuals
• Tax Topic 505, Interest Expense

Source: www.irs.gov