From my knowledge, the primary downside is in the event of your death when your trust would terminate. All of the weapons must be transferred out of the trust and tax paid and all the signatures have to be obtained. Depending on your age, this might not be a downside but it would be one day.
Otherwise it's a great way to go.