We will probably give you conflicting advice here as well Oh Noble AG Warrior.
The car your family will live with every day, the AG transport will be less frequent. And I guess you will/want to live with a happy wife every day too. So I would vote for domestic tranquility by getting reliable affordable RAV4 set up for a lightweight trailer use. You can carefully pilot car when towing AG, hopefully wife can learn to be confident towing empty trailer when following you. Besides unsticking a hitch carrier from a ditch may be a lot harder than manhandling a trailer out of trouble. This may be least objectionable compromise.
Now for some conflicting advice from others more knowledgable, let's help Pete get really confused.