While I don't own one personally, I can rattle off 10-15 friends that own various factory built wheel houses. Some bought full RV packages, some just use their wheel house in the summer by adding a window unit A/C. I'll be fishing out of a 22' ice castle of my buddy's this weekend, that one has been to 4 states and canada with zero towing issues.
Some weekends at my cabin, there will be 3-5 ice castles parked there as my friends will bring them up to use as sleeping quarters. Another buddy parks his at a lake here in SD and uses it every weekend in the summer. I know guys that tow theirs out to Sturgis, We-Fest, tow them down south in the winter to camp in for hog hunts and waterfowl hunts, etc. Buy a reputable brand and you shouldn't have any issues with towing long distances.