How difficult would it be to refi my FHA into a VA loan?

Just get your COE (certificate of eligability) and run to the bank!!

Strictly an administrative task just like getting any mortgage. What people forget is that both FHA and VA loans are merely government guarantees to the companies that actually loan the money. The VA, like the FHA, has mostly safety requirements the home must meet. I recommend you talk with a loan officer at your bank or mortgage company to compare the advantages and disadvantages of he two programs in your situation. Talking doesn't cost you anything unless you are extended a loan; you can always stand up, say thank you for your time and go home.