Should I refinance out of an ARM? While refinancing your ARM has a lot of potential benefits, there are some downsides to consider as well. Upfront costs. ... You may also be able to roll those closing costs into your refinanced loan, but that comes with its own cost in the form of a higher interest rate. Interest rates might not increase by much.