In France you are obliged to declare your personal foreign accounts so that the taxman knows where your money is. Having a bank account in another country doesn’t excuse the need to pay personal taxes in your country of residence, I am based in France and know only too well as an expat that the regs and scrutiny here are heavy compared to say the UK, although some of this may be changing.
The best way around it is generally to form a company in a country with generous deductions and low corporate tax rates (and preferably ‘small business’ accounting rules that reduce your accounts-filing requirements to only the annual totals), then run as many expenses through it as possible (even potentially your home rent) before paying yourself only a nominal salary/fee, thus reducing your tax obligation (in France this would have to be <30.000€).
The UK may not be the best, but it is pretty easy, but also Estonia I have gathered. There is no actual requirement for an incorporated company to have its bank in the same country or even currency. Although which bank will open you a business account is another matter, so you could in fact have a UK company with a French business account, however a TransferWise borderless ‘account’ is probably perfectly adequate.