Moving to the Cloud
Posted on October 6th, 2016 in Technology | No Comments »
Well, hello again.
With my new life as a podcast producer, I seem to have next-to-no time available for blogging, and since the Oscars have been and gone (although they are coming up again soon) and we have no new series of Doctor Who this year, nothing has been drawing me towards the keyboard.
But, here’s a quick update regarding my digital entertainment.
We’re currently doing-up our loft, and planning on moving the TV upstairs and converting the existing TV room into a dining room. This means that there will be much less room for DVDs but of late I have found myself very reluctant to pick a DVD off the shelf, or even to buy a new movie on DVD. Buying on iTunes, or watching on Netflix just seems so much more convenient. Imagine having to get up, find a box, open the box, fish out the disc, open the drawer of the DVD player, put the disc in – Christ, it’s like the dark ages.
Surely, the right thing to do is to convert all of these existing DVDs to digital form and then play them back through the Apple TV…? Well, yeah.
Let’s look at what I wanted to achieve doing this.
- Have copies of movies and TV shows I’ve bought on DVD available on my home network.
- Preserve extra trailers, outtakes, documentaries.
- Preserve commentary tracks, trivia subtitles and other elements in the main feature itself.
- Be able to put all physical DVDs out of sight, out of mind, knowing I have high quality digital versions available on-demand.
Assuming disc space is no object (more on that later) one obvious solution would be to rip complete copies of the DVDs to .ISO files, maybe throwing away features I’m certain I don’t want, but preserving complete copies of the whole disc structure. This would mean that I definitely wasn’t trading down in terms of quality and the handful of discs which use wonky things like seamless branching would be viewable, but I don’t have an easy way of viewing those files with my current set-up.
Some time ago, a lot of my TV-watching was via a Windows Media Centre PC, connected to a NAS drive, and one reason why I didn’t jump to upgrade to an Apple TV was that this device had no ability to move files, even MP4s, from a NAS to the TV without going via a PC running iTunes, which firstly sounded a bit more Rube Goldberg than I wanted and secondly never actually worked whenever I tried it.
Acquiring the new fourth-generation Apple TV, with its emphasis on apps, also meant that much of my TV watching was via iTunes, Netflix or Hulu (since my Apple TV is firmly of the opinion that it is located somewhere in Delaware). So, I only fell back on downloaded files sent to my NAS when I couldn’t find the show or movie available to purchase or on a subscription anywhere. When this situation did arise, having tried a few different options, I settled on an app called Infuse which seemed very adept at not just playing back all sorts of files but downloading artwork and meta data too. However, Infuse is not at all willing to play back .ISO files (and in any case, part of the joy of this virtual library would be freedom from elaborate menus and unskippable copyright warnings) so some other system was going to be necessary.
When I asked Facebook friends what I should do, the most popular answer by far was Synology plus Plex. I had played around with Plex at the same time as I first installed Infuse, but it suffered from the same problem as the old Apple TV. Since my WD NAS drive is a fairly limited device, it can’t run the Plex software itself, which means I have to run Plex on my PC and then hook the Apple TV up to the PC and blah blah blah. Having looked into this further, the Synology plus Plex option does seem like the best choice, but fairly expensive; probably north of £500 (depending on the capacity and RAID option). I wanted to see if I could at least get started with what I had: my WD NAS drive and Infuse.
This brings up the issue of how to rip the DVDs and how to preserve all the features I wanted. Some years ago, when I regularly ripped DVDs to watch on my iPad (instead of downloaded content from iTunes) I remember having to choose exactly which audio and subtitle track I wanted (resulting in “burned-in” subtitles on the ripped file) but these days, it’s much easier to create MKV or MP4 files with multiple audio and subtitle tracks built in, and Infuse has no problem switching between these, so that part seemed covered. The final choice was whether to re-encode or not.
I downloaded Handbrake, which I’d used many times before, but always found it rather cryptic and awkward, and gave it Tim Burton’s Batman to play with. My laptop coughed and whirred for a very long time before eventually spitting out a very watchable 2Gb MP4 file complete with optional commentary track, which Infuse was delighted to display on my Apple TV (or indeed my iPad).
I then tried a much simpler-looking, although no less powerful, product called MakeMKV which has a very simple interface and which seems to chew through DVDs of all makes and stripes without a murmur. It’s worth noting that it doesn’t attempt to re-encode the video data on the DVD, it just pours it into the MKV container (again with whatever audio and subtitle tracks you want or don’t want). This results in a larger file, but also means that with my fairly inexpensive HP Envy laptop with its new USB3 DVD drive (twenty quid off Amazon) can create a movie file in about 20 minutes instead of the two hours it took Handbrake.
And now that Virgin Media have upgraded my equipment, and I have Wi-Fi through the whole flat instead of just within twenty yards of the router, throwing big files across the network is quick-and-easy too. It seems to work much better to rip the movie to my local disc and then copy it to the NAS, but the copying only takes an extra ten minutes and can be done while the next movie is ripping. I make folders on the NAS for each movie and add the special features that I want to the same folder and on Infuse, I can see the movie and the appropriate extra features all on one screen. Nice.
So, the process is underway, with a few caveats. Firstly, the movies I’m ripping are now around 4Gb in size (blu-rays can stay on the shelf for now) and my NAS is only 2Tb. So I may very well run out of space before I run out of movies (I have around 600 DVDs, many of which are box-sets, and that doesn’t include my complete set of Doctor Who DVDs). Buying a second similar NAS would be fine and inexpensive, but I would have to have some sensible way to decide what went on what drive because Infuse will not merge the two libraries.
Secondly, one NAS (or even two) and no RAID means no redundancy and no back-ups. If there’s a drive failure or a flood or a power surge, then all my work could be undone. Of course, I’ll still have the discs, but ripping them all is going to take months, maybe a year – not something I want to do twice. So, the long-term plan has to be some kind of Synology box or similar, but for now I’m just going to see how long it takes me to rip my current collection, while they are still conveniently close to hand.
Finally, ripping without re-encoding has generated a few special features which look nastily interlaced when played back via Infuse, but so far I’ve been able to deal with these by running them through Handbrake and it hasn’t affected any main features yet.
There will no doubt be Oscar reviews and previews soon.
UPDATED TO ADD
At the time of writing, I have got to H but that leaves out a lot of TV show box-sets, all the Disney animations and all the Doctor Who DVDs as well as the ones already downgraded to an overflow shelf, but things are going smoothly. It would be a huge bummer to lose all this work of course, and my new 6Tb WD MyCloud is still not a RAID system, so I currently have no back-ups save the discs themselves. However, in theory Amazon Drive offering literally unlimited cloud storage for £55pa is the answer. I say in theory because in practice, as soon as I began the back-up process, my Virgin router immediately killed my internet connection, even when I was throttling the upload bit-rate to a stupidly low level. The solution eventually became a new router (this one) with the Virgin “Super Hub” demoted to modem only. Now slinging big files around the network is even quicker, with the process of moving the 600Gb or so of files already ripped from one NAS to the other achieved overnight with Windows Explorer (definitely not the fastest way of doing it). And testing the upload to Amazon, it seems stable, but I’m going to focus on ripping for now, and make the uploading a separate (no doubt months-long) project.