Saturday 22 August 2015

I’m not ready for the 4k future.

Ultra HD is a confusing confection of standards, and is getting in the way of watching amazing 4k TV. blog.mindrocketnow.com

I want a new TV. It’s not that my current TV isn’t any good – the pictures are crisp, and the screen is large enough – it’s just that the new sets are even shinier. And the newest of the new TVs have the next super-duper feature – Ultra High Definition. Not just HD, but ULTRA. Sweet.

The problem is that the UHD future is still very uncertain. There are competing and non-interoperable technology decisions that will impact upon which TV I should choose – and getting the decision wrong could mean that I won’t be able to watch the programmes that I want to.

It’s content that drives behaviour that drives technology. This lesson has been applied with variable conviction through 3D, HD, widescreen, and NICAM stereo. In the UK today, Netflix, YouTube and Amazon Instant Video are already streaming content in 4k. BT has announced BT Sport UHD. The new UHD-capable SkyQ box is strongly rumoured to release before Christmas. Sony provides a 4k media hub – essentially a NAS pre-loaded with Sony 4k movies (and the Playstation original Powers) to provide content for your new Sony 4k TV. Samsung uses the same approach, but without its own movies. So the content is starting to emerge, to push the technology.

The first issue for the early-adopting consumer, is that UHD content will be limited and expensive. Netflix 4k needs a £8.99 per month subscription and the catalogue is limited to some flagship content from Netflix (House of Cards), AMC (Breaking Bad) and Sony back catalogue movies (Jerry Maguire). YouTube has a 4k quality setting and some 4k videos uploaded (beautiful pictures, chillout music, but very jerky and makes my laptop crash). Amazon Instant Video has some Amazon originals 4k content included in the prime subscription, and other back catalogue from Sony available to rent at £6.99 or buy at £18.99. You can bet the subscription hike from BT and Sky for 4k will cause a sharp intake of breath.

Once you’ve committed to spending on 4k, the second issue is that it may not play. To understand fully why, we need to unpick what UHD actually is.

UHD bundles together a whole set of advances in TV technologies. This bundling of advances makes UHD such a significant step forward. But because these are all individual steps, with no mandated correlation, there’s no guarantee that UHD means the same thing to all broadcasters and manufacturers.

First is the resolution: UHD is 3840 x 2160 pixels, which is four times the number of pixels as full HD. (Full 4k cinema is 4096 x 2160, which is slightly wider, as is currently the case.) UHD also allows for faster refresh rates, starting at 24 frames per second (current cinema rate), 25 fps (current TV rate), 30, 50, 60 and 120 fps. This promises a level of detail where the eye would have difficulty in seeing individual pixels, with no motion blur – at a cost of 20x current bandwidth.

Next up are the advances in colour reproduction. All current TVs use a mathematical representation of colour based on red-green-blue described by the standard Rec.709. Though this standard brought worldwide agreement on how colours (and white) should be represented, the range of possible colours is less than the range experienced by the human eye. To get close to human experience, UHD mandates the newer Rec.2020 standard.

To be able to describe colour more accurately, UHD allows for spending more bits to describe colour – 10 or 12 bits per sample rather than the current 8 = 1.5x current bandwidth. These are either sampled twice as frequently for brightness (luminance) than for red, and half again for blue (4:2:0), or twice as frequently for brightness than each of red and blue (4:2:2), or same frequency of samples for all three (4:4:4). 4:4:4 requires 2x the bandwidth as 4:2:0.

Brightness is also described more accurately using High Dynamic Resolution (HDR). HDR doesn’t necessarily increase the number of bits used to describe brightness, but how. Instead of the current mathematical Electro-Optical Transfer Function, a Perceptual Quantisation is preferred. This enables describing a wider dynamic range.

TVs currently go from 0.05 cd/m2 at black to 120 cd/m2 for full brightness.
The best-performing OLED TV goes from 0 cd/m2 to 800 cd/m2. HDR enables video to be described to take advantage of this available dynamic range – and more. The leading contender specification for HDR, Dolby Vision, claims an extra 20% bandwidth would be needed for metadata.

So we see that UHD = resolution + frame rate + colour gamut + sample rate + sub-sampling schema + HDR. Total bandwidth uplift would be 72x current bandwidth! Thankfully, there are new codecs that significantly reduce the bandwidth requirements. Both H.265 (HEVC) and Google VP9 promise 40% over current HD codec H.264, which was 40% improvement over MPEG2 as used in SD DTV broadcast. So use of HEVC or VP9 could reduce bandwidth uplift to 4.5x, but that still means bit rates of over 30Mbit/s.

However, the main reason why your content might not play is DRM. Studios are following the same tired old path of maximising the money they wring out of broadcasters and the public by the implementation restrictive DRM. However, there are a few contenders out there. Netflix and BT mandate Microsoft PlayReady. There are also solutions from Verimatrix and Nagra. Each DRM schema must be implemented in hardware (the current market leader is Broadcom with their Sage system-on-a-chip), so each DRM schema requires a different STB or TV.

The Samsung TV that is capable of playing Netflix 4k may not be capable of playing the UHD content from AcmeFutureTV if the DRM is different. And the studios focus heavily on DRM; there’s no guarantee that each studio will choose the same DRM vendors to approve. So different content may need different DRM and therefore a different STB. (I hope I have enough inputs on my TV.) The equation is now: UHD = DRM + codec + resolution + frame rate + colour gamut + sample rate + sub-sampling schema + HDR.

So before I buy my next TV, I should ask myself: is the TV full 4k or UHD1 resolution? Does it have a Broadcom Sage chip? Is it using the right DRM variant of the chip? Will I be connecting to the TV using HDMI 2.0? Does the output of the for the content STB support HDCP 2.2? Does the TV support Rec.2020 colour space? 10-bit/ 12-bit colour depth? 4:2:2 or 4:4:4 chroma sub-sampling schema? Does it have sufficient dynamic range to reproduce HDR? Does it have a frame refresh rate of 60 fps or even 120 fps? Does the player within your STB or smart TV support the HEVC or Google VP9 codec? And now that I’ve answered these questions for the TV, was the movie that I want to watch encoded with the right combination of PlayReady/ Rec.2020/ 12-bit/ 4:4:4/ 120fps/ HEVC?

Why should I, as a consumer care, when all I want to do is to watch a movie?

With all this variability in what makes up UHD, it’s understandable that some broadcasters are being cautious with their investment. They need to ensure that their network infrastructure can cope with additional bandwidth demand, invest in head ends to process content provider feeds into coherence, and invest in STB because Smart TVs are unlikely to be smart enough to cater for their particular combination that makes up UHD.

This caution allows OTT providers to lead the way with 4k. With no network investment to worry about, Netflix, YouTube, Amazon, Sony et al can focus investment on content and hardware. The approach is different in each case: Netflix has bet its farm on its tie-up with Broadcom, hoping that everyone will put the chip in their TV or STB to get Netflix, and it looks to have been a wise bet. Amazon develops its own STB, Sony its Smart TV and Playstation. YouTube does not have studio content licensed for 4k (though GoPro's Adventure of Life in 4k is arguably commercial content but with a free license) and is agnostic on hardware. 


Future-proofing my next TV purchase will probably be impossible. The panels to support Rec.2020 and Dolby Vision just aren’t made yet. However, 4k is gathering commercial momentum, so realising the full UHD1 spec in a TV will be irrelevant if I actually want to watch 4k content. I think it’ll be enough to have a 4k panel, and have lots of HDMI 2.0/ HDCP 2.2 connectors. However, I think I’ll have a cluster of STB around the base of my TV. It seems there’s no getting away from a rat’s nest of cables behind the TV.

Sunday 2 August 2015

Living in the cloud.

Living in the cloud (for free) is possible, if clunky. I wouldn’t do it if I didn’t have to. blog.mindrocketnow.com

I’ve recently been given a new laptop with my new job, and a whole lot of obligations in maintaining security. So that means I can’t use my beloved MacBook any more for work, which means I have to use my work laptop for personal stuff that I can’t avoid doing during the week. And because of the security obligations, I can’t install all of the software that I’ve been used to on my work laptop. All of my music, photos, files are now out of reach.

It turns out that most of my data is already in cloud services like Yahoo! Mail, Dropbox, Google Drive, iTunes Match, even 1Password. And each of these cloud services have web apps, which means I can get to my passwords, music and files without installing anything, just by going to the right URL in my browser. My work laptop is secured because no nefarious files are installed. My privacy is assured because no personal files are copied onto my work laptop. Conceptually, it’s all good.

Practically, there are limitations. Web apps are optimised to run on the latest browsers, which currently are Chrome and Safari (Project Spartan will soon be added to this list when Windows 10 is launched). My work laptop is languishing in the lamentable past of Windows 7 and Explorer 7, so few of the web apps work with all promised functionality.

The worst limitation is with photos. Apple has integrated iPhotos with iCloud, but the cost of storing the full photo library in Apple’s cloud is prohibitively expensive. So I can only see selected photo streams, rather than the whole library.

Now that I’ve strewn my digital life in the digital heavens, I have a whole new problem of overlapping cloud services. To illustrate: I have files in Dropbox, Google Drive, Apple iCloud, box.net, Microsoft OneDrive, Amazon Cloud Drive. How do I know where anything actually is? My MacBook knows, because all (except Amazon) are well-integrated with OSX, so spotlight search surfaces results from each of the cloud services. However, my work laptop doesn’t know, because I can’t install the sync utilities.

The answer is to apply the cardinal rule for cloud-based sanity – only one type of content per cloud service. In my case:
  • ·      Apple iTunes Match hosts all of my music.
  • ·      Amazon Kindle hosts all of my books.
  • ·      Yahoo! hosts all of my personal email.
  • ·      Google Drive hosts all of my personal files.
  • ·      Dropbox hosts all of my gubernatorial files.
  • ·      There are no work files in a public cloud at all, only on work servers.

So if I want to know where anything is, I can identify the right cloud service to search, by content type. This currently works for music and files, but not for anything else. All other file types are hosted in the Drobo, my home NAS.

But then the Drobo died. I’m still hopeful that the files can be recovered, as I think either the power supply or the chassis broke. But whilst I find a fix, I have no access to photos or movies. Which has led me to think – once my files are recovered, should I start paying for a cloud backup service?

Cloud backup is different from cloud services. Even if cloud services are cheap, they’re not free beyond the first 5GB or so, and my backup runs into more than 1TB. Most of it is in photos, music and movies. Curiously, we don’t watch ripped movies any more, as all the content we want is available in streamed services. Music is already available as an alternative. So that leaves photos.

Amazon Prime has recently provided a solution to photos storage. Along with the free next day delivery, free TV subscription, and free music subscription, Prime members can enjoy unlimited storage for photos. I’m going to look at how easy it will be to include Amazon Prime Photos into my workflow.

So with the right range of cloud services, and the right methodology in using them, it is possible to live in the cloud for free. However, with my own computer and NAS, it’s much easier not to.