My opinion: It's largely sensible business practice, and day 1 could be entirely reasonable to deregister.
Here's my reasoning;
A person is liable to register if their business supplies are above the registration limit (Para 1 (1), Sch 1, VAT Act 1994), if we have a transfer of a going concern then that going concerns supplies in the preceding year are taken into account (Para 1(2) of Sch. 1).
If the going concern is not above the limit and there are no other supplies then there is no liabilityto register. However to get TOGC status you need to be registered so you need to establish an entitlement to register.
To be entitled to register you must satisify the commisioners that you make or intend to make taxable supplies (Sch 1, Para 9). That's fine the recipient will presumably continue trading and making taxable supplies (as per Para 4 of the Act a taxable supply is any supply made in the UK other than an exempt one, so it's not necessary to be, or continue to be registered to make taxable supplies).
Having established they can register, the law gives no minimum length of registration, and they are entitled to deregister if they can demonstrate they have no liability to be registered (i.e. turnover below dereg limit (para 1 (3) of sch 1)).
Registration is normally treated as from midnight of the given date, and dereg to midnight of the given date so if you deregister on day 1 you've been registered for a day, and so long as that day is the date of transfer of the business you've met the registration condition.
The fact that you make no taxable supplies during the course of the registration does not change your entitlement to registration. I can find nothing in Para 49 of the Act, Para 6 of the VAT regulations 1995, or the VAT (Special Provisions) Order 1995, which are the main bits of legislation dealing with TOGC, which stops this treatment.
The only caveat is of course that the transfered assets will be assets on hand for declaring on the final (first) retrun subject to the £1000 deminimis amount, and any Capital Goods Scheme liabilities will need accounting for.
And although my memory may be failing me I seem to remember processing at least one deregistration on a registration entered into for this very purpose when I was managing a HMRC dereg section. Also in the end it's no loss to HMRC so not even tax avoidance, if the company didn't transfer and deregistered instead then the effect on HMRC coffers would be exactly the same as if they transfered and the new company deregistered.
Sorry rather a long winded way to say go for it. I started the reply expecting a couple of issues to pop up but as I read the law they didn't and I couldn't be bothered to delete it all and just write 'yes- go for it'