Temporary milk solutions for cups of tea?

I have a question for those of you who are experts in hot drinks. I haven't had caffeine for maybe 13 years and so while I can go through the ritual of making cups of tea for someone else, they aren't the greatest cups of tea. I am a human version of a Nutrimatics Drinks Dispenser from the Hitchhiker's Guide to the Galaxy:

When the 'Drink' button is pressed it makes an instant but highly detailed examination of the subject's taste buds, a spectroscopic analysis of the subject's metabolism, and then sends tiny experimental signals down the neural pathways to the taste centres of the subject's brain to see what is likely to be well received. However, no-one knows quite why it does this because it then invariably delivers a cupful of liquid that is almost, but not quite, entirely unlike tea.

So. in our household where MB is a big tea drinker (something to do with coming from Yorkshire) but neither of us are regular consumers of milk, he is frequently presented with the following choice. Cup of tea with either:
-no milk
-something that used to be milk but is now closer to cheese
-strawberry yoghurt, which was made from milk originally

I recently proposed that a sensible option could be to make some ice cubes from milk, and upon making the tea, drop in a frozen milk cube. Et voila, perfectly fresh milk every time and also a cup of tea at just the right temperature for drinking, rather than burning the tongue. The response: expression on face as if I had suggested going to work in a cardboard dress; words out of mouth 'don't be ridiculous'.

My question is, has anyone tried this? can anyone suggest an alternative that is not UHT? Thank you, from an ignorant non drinker of hot drinks.