Mondo,
IR35 legislation made it very difficult for 1 man limited company to operate with a single client. For a while people were (allegedly) going through umbrella companies (paying corporation rather that income tax) but I believe that loophole is long closed.
Being limited company is a bit of a misnomer you end up spending money to save it buying unnecessary stuff just to claim the tax.
In your case it may work? IF the company is prepared to take you back on casually after your nomadic periods you could just work to a point where your company has money in it then off on your travels paying yourself pro-rata until the money is spent.
It's high risk as you are going to lose any benefits you may have had but if you think there's long term on/off possibilities I guess you might be prepared to risk it?
Whatever you decide do some research and get some professional advice you never know you might be one of the few that could gain from the Brexit fiasco?!