Changing Residency

Hey guys,

I currently live in the UK as a British National with my wife and our baby.

We are leaving the UK in April to travel Europe.

My plan was to become resident of Dubai for tax purposes as we're not required to be there for more than 183 days ( I believe we only need to visit twice per year, not staying out of the country for more than 180 days).

As we would be resident in Dubai, and nowhere else, I assume we would have 0% taxes to pay. However, I have concerns... especially as we would visit the UK to see family 2-3 months every tax year, and then if we return to the UK say after 5 or 10 years. I'm concerned that the UK could tax me on everything during this process or if I return?

The new UK UAE Double Taxation Convention also concerns me in relation to the above... though maybe this is more targeted for those already in Dubai applying for the Double Taxation Treaty Convention?

If anyone could help that would be greatly appreciated.