Saturday 22 August 2015

I’m not ready for the 4k future.

Ultra HD is a confusing confection of standards, and is getting in the way of watching amazing 4k TV. blog.mindrocketnow.com

I want a new TV. It’s not that my current TV isn’t any good – the pictures are crisp, and the screen is large enough – it’s just that the new sets are even shinier. And the newest of the new TVs have the next super-duper feature – Ultra High Definition. Not just HD, but ULTRA. Sweet.

The problem is that the UHD future is still very uncertain. There are competing and non-interoperable technology decisions that will impact upon which TV I should choose – and getting the decision wrong could mean that I won’t be able to watch the programmes that I want to.

It’s content that drives behaviour that drives technology. This lesson has been applied with variable conviction through 3D, HD, widescreen, and NICAM stereo. In the UK today, Netflix, YouTube and Amazon Instant Video are already streaming content in 4k. BT has announced BT Sport UHD. The new UHD-capable SkyQ box is strongly rumoured to release before Christmas. Sony provides a 4k media hub – essentially a NAS pre-loaded with Sony 4k movies (and the Playstation original Powers) to provide content for your new Sony 4k TV. Samsung uses the same approach, but without its own movies. So the content is starting to emerge, to push the technology.

The first issue for the early-adopting consumer, is that UHD content will be limited and expensive. Netflix 4k needs a £8.99 per month subscription and the catalogue is limited to some flagship content from Netflix (House of Cards), AMC (Breaking Bad) and Sony back catalogue movies (Jerry Maguire). YouTube has a 4k quality setting and some 4k videos uploaded (beautiful pictures, chillout music, but very jerky and makes my laptop crash). Amazon Instant Video has some Amazon originals 4k content included in the prime subscription, and other back catalogue from Sony available to rent at £6.99 or buy at £18.99. You can bet the subscription hike from BT and Sky for 4k will cause a sharp intake of breath.

Once you’ve committed to spending on 4k, the second issue is that it may not play. To understand fully why, we need to unpick what UHD actually is.

UHD bundles together a whole set of advances in TV technologies. This bundling of advances makes UHD such a significant step forward. But because these are all individual steps, with no mandated correlation, there’s no guarantee that UHD means the same thing to all broadcasters and manufacturers.

First is the resolution: UHD is 3840 x 2160 pixels, which is four times the number of pixels as full HD. (Full 4k cinema is 4096 x 2160, which is slightly wider, as is currently the case.) UHD also allows for faster refresh rates, starting at 24 frames per second (current cinema rate), 25 fps (current TV rate), 30, 50, 60 and 120 fps. This promises a level of detail where the eye would have difficulty in seeing individual pixels, with no motion blur – at a cost of 20x current bandwidth.

Next up are the advances in colour reproduction. All current TVs use a mathematical representation of colour based on red-green-blue described by the standard Rec.709. Though this standard brought worldwide agreement on how colours (and white) should be represented, the range of possible colours is less than the range experienced by the human eye. To get close to human experience, UHD mandates the newer Rec.2020 standard.

To be able to describe colour more accurately, UHD allows for spending more bits to describe colour – 10 or 12 bits per sample rather than the current 8 = 1.5x current bandwidth. These are either sampled twice as frequently for brightness (luminance) than for red, and half again for blue (4:2:0), or twice as frequently for brightness than each of red and blue (4:2:2), or same frequency of samples for all three (4:4:4). 4:4:4 requires 2x the bandwidth as 4:2:0.

Brightness is also described more accurately using High Dynamic Resolution (HDR). HDR doesn’t necessarily increase the number of bits used to describe brightness, but how. Instead of the current mathematical Electro-Optical Transfer Function, a Perceptual Quantisation is preferred. This enables describing a wider dynamic range.

TVs currently go from 0.05 cd/m2 at black to 120 cd/m2 for full brightness.
The best-performing OLED TV goes from 0 cd/m2 to 800 cd/m2. HDR enables video to be described to take advantage of this available dynamic range – and more. The leading contender specification for HDR, Dolby Vision, claims an extra 20% bandwidth would be needed for metadata.

So we see that UHD = resolution + frame rate + colour gamut + sample rate + sub-sampling schema + HDR. Total bandwidth uplift would be 72x current bandwidth! Thankfully, there are new codecs that significantly reduce the bandwidth requirements. Both H.265 (HEVC) and Google VP9 promise 40% over current HD codec H.264, which was 40% improvement over MPEG2 as used in SD DTV broadcast. So use of HEVC or VP9 could reduce bandwidth uplift to 4.5x, but that still means bit rates of over 30Mbit/s.

However, the main reason why your content might not play is DRM. Studios are following the same tired old path of maximising the money they wring out of broadcasters and the public by the implementation restrictive DRM. However, there are a few contenders out there. Netflix and BT mandate Microsoft PlayReady. There are also solutions from Verimatrix and Nagra. Each DRM schema must be implemented in hardware (the current market leader is Broadcom with their Sage system-on-a-chip), so each DRM schema requires a different STB or TV.

The Samsung TV that is capable of playing Netflix 4k may not be capable of playing the UHD content from AcmeFutureTV if the DRM is different. And the studios focus heavily on DRM; there’s no guarantee that each studio will choose the same DRM vendors to approve. So different content may need different DRM and therefore a different STB. (I hope I have enough inputs on my TV.) The equation is now: UHD = DRM + codec + resolution + frame rate + colour gamut + sample rate + sub-sampling schema + HDR.

So before I buy my next TV, I should ask myself: is the TV full 4k or UHD1 resolution? Does it have a Broadcom Sage chip? Is it using the right DRM variant of the chip? Will I be connecting to the TV using HDMI 2.0? Does the output of the for the content STB support HDCP 2.2? Does the TV support Rec.2020 colour space? 10-bit/ 12-bit colour depth? 4:2:2 or 4:4:4 chroma sub-sampling schema? Does it have sufficient dynamic range to reproduce HDR? Does it have a frame refresh rate of 60 fps or even 120 fps? Does the player within your STB or smart TV support the HEVC or Google VP9 codec? And now that I’ve answered these questions for the TV, was the movie that I want to watch encoded with the right combination of PlayReady/ Rec.2020/ 12-bit/ 4:4:4/ 120fps/ HEVC?

Why should I, as a consumer care, when all I want to do is to watch a movie?

With all this variability in what makes up UHD, it’s understandable that some broadcasters are being cautious with their investment. They need to ensure that their network infrastructure can cope with additional bandwidth demand, invest in head ends to process content provider feeds into coherence, and invest in STB because Smart TVs are unlikely to be smart enough to cater for their particular combination that makes up UHD.

This caution allows OTT providers to lead the way with 4k. With no network investment to worry about, Netflix, YouTube, Amazon, Sony et al can focus investment on content and hardware. The approach is different in each case: Netflix has bet its farm on its tie-up with Broadcom, hoping that everyone will put the chip in their TV or STB to get Netflix, and it looks to have been a wise bet. Amazon develops its own STB, Sony its Smart TV and Playstation. YouTube does not have studio content licensed for 4k (though GoPro's Adventure of Life in 4k is arguably commercial content but with a free license) and is agnostic on hardware. 


Future-proofing my next TV purchase will probably be impossible. The panels to support Rec.2020 and Dolby Vision just aren’t made yet. However, 4k is gathering commercial momentum, so realising the full UHD1 spec in a TV will be irrelevant if I actually want to watch 4k content. I think it’ll be enough to have a 4k panel, and have lots of HDMI 2.0/ HDCP 2.2 connectors. However, I think I’ll have a cluster of STB around the base of my TV. It seems there’s no getting away from a rat’s nest of cables behind the TV.

Sunday 2 August 2015

Living in the cloud.

Living in the cloud (for free) is possible, if clunky. I wouldn’t do it if I didn’t have to. blog.mindrocketnow.com

I’ve recently been given a new laptop with my new job, and a whole lot of obligations in maintaining security. So that means I can’t use my beloved MacBook any more for work, which means I have to use my work laptop for personal stuff that I can’t avoid doing during the week. And because of the security obligations, I can’t install all of the software that I’ve been used to on my work laptop. All of my music, photos, files are now out of reach.

It turns out that most of my data is already in cloud services like Yahoo! Mail, Dropbox, Google Drive, iTunes Match, even 1Password. And each of these cloud services have web apps, which means I can get to my passwords, music and files without installing anything, just by going to the right URL in my browser. My work laptop is secured because no nefarious files are installed. My privacy is assured because no personal files are copied onto my work laptop. Conceptually, it’s all good.

Practically, there are limitations. Web apps are optimised to run on the latest browsers, which currently are Chrome and Safari (Project Spartan will soon be added to this list when Windows 10 is launched). My work laptop is languishing in the lamentable past of Windows 7 and Explorer 7, so few of the web apps work with all promised functionality.

The worst limitation is with photos. Apple has integrated iPhotos with iCloud, but the cost of storing the full photo library in Apple’s cloud is prohibitively expensive. So I can only see selected photo streams, rather than the whole library.

Now that I’ve strewn my digital life in the digital heavens, I have a whole new problem of overlapping cloud services. To illustrate: I have files in Dropbox, Google Drive, Apple iCloud, box.net, Microsoft OneDrive, Amazon Cloud Drive. How do I know where anything actually is? My MacBook knows, because all (except Amazon) are well-integrated with OSX, so spotlight search surfaces results from each of the cloud services. However, my work laptop doesn’t know, because I can’t install the sync utilities.

The answer is to apply the cardinal rule for cloud-based sanity – only one type of content per cloud service. In my case:
  • ·      Apple iTunes Match hosts all of my music.
  • ·      Amazon Kindle hosts all of my books.
  • ·      Yahoo! hosts all of my personal email.
  • ·      Google Drive hosts all of my personal files.
  • ·      Dropbox hosts all of my gubernatorial files.
  • ·      There are no work files in a public cloud at all, only on work servers.

So if I want to know where anything is, I can identify the right cloud service to search, by content type. This currently works for music and files, but not for anything else. All other file types are hosted in the Drobo, my home NAS.

But then the Drobo died. I’m still hopeful that the files can be recovered, as I think either the power supply or the chassis broke. But whilst I find a fix, I have no access to photos or movies. Which has led me to think – once my files are recovered, should I start paying for a cloud backup service?

Cloud backup is different from cloud services. Even if cloud services are cheap, they’re not free beyond the first 5GB or so, and my backup runs into more than 1TB. Most of it is in photos, music and movies. Curiously, we don’t watch ripped movies any more, as all the content we want is available in streamed services. Music is already available as an alternative. So that leaves photos.

Amazon Prime has recently provided a solution to photos storage. Along with the free next day delivery, free TV subscription, and free music subscription, Prime members can enjoy unlimited storage for photos. I’m going to look at how easy it will be to include Amazon Prime Photos into my workflow.

So with the right range of cloud services, and the right methodology in using them, it is possible to live in the cloud for free. However, with my own computer and NAS, it’s much easier not to.

Friday 10 July 2015

Measuring me.

I’m starting to quantify my life using a fitness tracker. Not sure how it helps, though. blog.mindrocketnow.com

Part of the reason for not getting an Apple Watch was that I had a much cheaper Jawbone Up24 wrist band. I’ve been wearing the band for a while now, and it’s time to write down my impressions.

My main quibble is that I don’t know what it’s for. I know what it does: count steps, discreet alarm, tracks sleep. I just don’t know how all that improves me.

Take step counting: I like that I can measure how active I’ve been during the day. However, counting the steps hasn’t spurred my to make more of them. I still walk as much as I normally do, and work still gets in the way of walking more. Verdict: 6/10.

Tracking sleep is even less useful for me. I’m skilled at sleeping. If only it paid enough, I’d be a bed tester, working from home. Tracking sleep is pointless, because it takes me conscious targeted activity to not fall asleep. Verdict: 3/10.

I do like the discreet alarm function of the wrist band. I no longer have to have the iPhone next to my bed because wristy is my new discrete alarm clock. My 5am alarm to get to the airport now needn’t wake DW (although I make it a point that she knows how grumpy I am at that time). It apparently even goes off at the time just before 5am when I’m at my least grumpy (that bit doesn’t work – I’m still grumpy). I also like the inactivity alarm, which reminds you when you’ve been sitting for too long. Verdict: 10/10.

Finally, I love the battery life. It lasts a week between charges, under normal usage. I don’t have to worry about battery husbandry, it’s always there, always on, doing its thing. That should be true of all gadgets. Verdict: 10/10.


Overall, there’s only one function that really improves my life, and a couple that are meh. My buying decision is therefore based upon how cheap it is, i.e. whether I can immediately mentally amortise its purchase price. I got it for less than £50, which for me is the sweet spot. Overall verdict: 6/10; useful but not indispensible.

Friday 26 June 2015

It's too easy to hold onto our digital rubbish.

Be honest, you're a digital hoarder, aren't you? But by not deleting now, I risk not finding again in the future. blog.mindrocketnow.com 

Hard drive space is cheap, cloud space is free (up to a certain amount), why wouldn't you hang onto it, just in case? My generation still remembers how fragile physical media can be - old photos fade, cassettes stretch, pages in books yellow as the chlorine leaches out - so why take the risk?  We've also experienced hard drive failure, catastrophic loss of data just before the presentation needs to be delivered, needing a weekend of retracing mental footsteps to recreate what was never as good as the original. 

Faced with the consequences of getting it wrong, you can sympathise with why it's easier to decide to store and decide to deal with it later, than to spend the cognitive effort to weed out digital files. 

But why is it difficult to make this decision? Perhaps it's because it's because we can't tell the difference between a digital object and a digital possession. A possession has imbued value, either at the time of first acquisition (primary value) or in the future (secondary value). This value is perceived through the lens of our own values, which is why possessions are fragments of our own identity. The dissonance with digital is that primary value is often low (a single digital selfie has essentially zero incremental cost) whereas the secondary value can be extremely high (who knows if that selfie will be a memory to cherish in years to come)? We would need to work harder to figure out the secondary value of a digital item, so we put it off for later. 

This idea goes some way to understanding why subscription models are more popular than pay-per-use models. Even if a subscription is more expensive than buying individually, e.g. for low usage, they are generally more popular because there's no additional effort required to value the content. At the same time, this unwillingness to value the individual content means that we incorrectly value the digital artefact, which has caused such disruption to the digital media industry, and the rise of freemium. 

Interestingly, though every post to Facebook has the potential to last forever, the Internet is not immune to the forces of entropy. There's a cost to recovering a specific item of data, and the cost increases as time goes on. The moment after you've made that post to MySpace, you'll have to search to find it again. 100 days  later (the average life of a web site), the service will have been bought and sold and databases ported, corrupted, and only partially recovered, links will decay and point to 404. Five years later, operating systems will have changed, and specialist tools will be needed to find that post again. Ten years later, the hardware won't be sold any more and you'll have to go to eBay or a museum to get more blank media. 

This is a good thing. Death is a part of life, and so digital rust should be a part of digital life. The right to be forgotten is as important as the right to be remembered.  

There's also a pleasure to going through our digital possessions. Those digital objects that survive the updates and upgrades naturally acquire the value imbued by the weight of time. I think I'm going to have a look at my old digital photo albums now... 

For more, have a listen to the Digital Human podcast.

Friday 12 June 2015

Apple Pay in the UK.

WWDC quick verdict: WatchOS 2 = what? Music, Maps = Meh. El Capitan, iOS 9 and Pay = yay. blog.mindrocketnow.com 

I couldn't let WWDC go past without making comment. For personal impact, it was a mixed bag. Apple Music is distinctly meh - it's just too expensive. Maybe when DD2 gets into music properly, we'll invest in a family account just to keep her legal, but the sad truth is that we don't listen to enough music to make it valuable. In fact, I'm considering cancelling my iTunes Match subscription 

WatchOS 2 - yawn. There still aren't any compelling watch apps, so still no reason for me to buy one, so I really couldn't care less. 

Apple Maps with transit directions - sigh. Apple is so late to this particular party, that I'm going to stick with Google Waze and Google Maps just to make a point. 

OSX El Capitan is a silly name but is the first of the big announcements that made me pay attention. Under the hood changes may not bring any application changes of meaning, but it does mean that my 7 year-old MacBook will be fit for purpose for another year. I got a new Lenovo laptop with my new job. I prefer my MacBook. That's amazing engineering, and so amazing value from Apple. 

iOS 9 is also revolutionary for the same reason. It'll run on the iPhone 4S up to my 6+, and will realise battery improvements for each. My phone could even gain an extra hour, which means I don't need to charge it overnight any more (it gets charged by the car whilst doing SatNav duty just enough to keep it going until the next commute). DW still needs to have a charger wherever she sits as one of her multiple iDevices will be on red beans. I don't need a single charger in the house. 

Apple Pay makes me most excited, because it's the beginning of much more secure online transactions. It's not the bulging wallet effect that I'm worried about, but the fact that now my credit card will only be known by my bank, Apple, and me. The fewer people that know the secret of my credit card number, the more securely it'll be kept, and the safer my money will be.