Nine Minutes of a Sleeping Puppy (dreaming of organizing gigabytes of video)

An adorable sleeping puppy accompanied with soft piano music. I was testing camera equipment in early 2016 and pointed it at the new dog (Waffles). Pulled out a few fluffy adorable bits and changed out the soundtrack with some piano improvisations I’ve recorded over the years.

This recorded off my old Canon HV20 which was a great HD digital tape camera, but has a full-size HMDI cable out the back which outputs uncompressed HD unlike what it puts on tape, which is compressed and has a shallow color space.

So I bought an Atomos Ninja 2 last year and this was my first test. The Apple ProRes MOV file ended up being huge of course, just 9 minutes of footage added up to over 14 gigabytes. It’s was edited to half its original length and then compressed using two passes at full resolution, ending as a high quality HD mpeg2 file. It is just under a gigabyte in size (that’s about a 7 to 1 compression ratio if you skip the editing part). Quality costs money, time AND space, not counting the rendereing time.

TIP: Prep and even cue these projects to take advantage of what would otherwise be system down time.

At least these were organized in their own folder groups, if not in a structure by year or vendor, or even on the same drive (when you keep running out of room and have to add drives, you don’t have the time to reorganize right then.)

Now I am organizing Project Archives, with subgroups by client or category, and a second folder of disc images (or whatever the final delivery format was) as another copy of the final version, but as the shallow drawer I will need to dig in if I need another copy or maybe a quick conversion of the completed production to some new format.

Once those are organized in one location, I will immediately copy them to at least one other disc, if not two. This should happen almost immediately after the first copy is done.

In turn, one of those should be a removable or external drive that I can keep in another location if I am serious about the things on it.

—–David

P.S. I have another test video shot in an auditorium during setup, a long presentation collection and teardown that I filmed for use as a timelapse, and it’s 193 gigabytes in the original form. I compressed that to 34 gigabytes with no noticeable quality difference and freed up quite a bit of space by deleting the original, which I don’t need (I probably don’t need the back up either, but baby steps!)

Goodnight.

Nine Minutes of a Sleeping Puppy (dreaming of organizing gigabytes of video) was originally published on Creative Uploads

Advertisements

Windows 10 Virtual Driver Damnation Reincarnated

I talked about this lost partition nightmare at the end of the free Windows 10 upgrade offer, and now that computers are finally starting to catch up on the Anniversary update despite repeated attempts to force the download, it struck again last night.

After the update installed my iTunes library couldn’t find things, all things, which live on my M drive (the mapped path I created when I moved off the external drive that held the library to a multi-terabyte hard drive that was so big it required a virtual disk driver for my older BIOS to recognize it.*

Fortunately I take notes when I troubleshoot so I know what works in case I need to help someone. Well, I had to help myself and reinstall the Acronis Virtual Device driver again for Windows 10 too see what was already there. But it took two installation repair tries plus reboots before it worked.

For a few minutes I was concerned that the driver was no longer compatible, but apparently it or its settings were just overwritten or ignored again. Seagate hybrid SSD/HDD 4 Terabyte drive. You’d think a fancy new operating system wouldn’t bork a fancy newer drive. 

Ha. Anyway, it worked. Click here for details from the first time and where to find the fix.

— David

P.S. The computer that didn’t want to upgrade until I disabled the network card can’t get online now either. It did at least install the upgrade. But I think have to find an older network driver, and of course there’s no roll-back driver offered, so I need to sneaker net I guess.

* Keeping the iTunes library location drive letter and the same — and well clear of multiple partition letters forcing it to change — let me regularly upgrade my external drive by cloning the entire iTunes library to new bigger external drives without changing anything else, even network drive mappings! And I can always go back to that if needed on this or another computer, since the library files live in M:\m (for music of course) with all the contents in folders below that.

P.P.S. Sneaker net is what we called carrying a floppy disc between computers that weren’t networked, online or behaving in the years before USB drives even existed. Flash drives are still technically sneaker net whether your wearing sneakers or something else. And if you fight know what a floppy is, look it up on Alta Vista.

Windows 10 Virtual Driver Damnation Reincarnated was originally published on Creative Uploads

Virtually Damn You, Windows 10, Okay Fine

You know the Windows 10 upgrade gave you a bad day when you are typing these searches into Google:

recover unallocated partition windows 10

win 10 deleted my partition

windows 10 set partition to unallocated space

where are my itunes files and torrents and videos and family pictures!!!!! And other stuff I don’t even remember !!!!

#*@& $%0 WINDOWS 10!

I completed the upgrade (another annoying story of repeated downloads) and to try it out had opened iTunes and clicked to play some music first, and there was no sound plus a warning that iTunes couldn’t find the track, or ANY track. And so I opened Windows Explorer to find only my C and D drive, not the drive I called M for music.

(it used to be an external USB drive and I just keep mapping it to the same letter as I upgrade the space.) My  2 terabytes of “M drive” was gone, set to unallocated space in Computer Management.

I actually gasped in horror. Noooo….

Now I know Windows doesn’t lose everything when you delete, that it’s hiding there in the dark and you can usually use any number of programs to recover the files by file and folder and time and copy them back out if you haven’t done anything else to the drive, since newer files start to overwrite them. But why! I started such a program and decided to see if I could recover the partition in total.

I had bad luck trying this when I recently cloned a blank new drive over the one I really wanted to copy. Can’t restore a partition table without a backup… (unless someone knows, I still have the drives…)

So somehow I got to this site:

http://www.tenforums.com/drivers-hardware/11467-hdd-partition-becomes-unallocated-after-windows-10-installation.html

Which had some thread comments that weren’t quite right for me but where  user GALAXOR posted in February 2016:

“I had the exact same problem. running a Seagate HDD with 6TB, 2TB C:/ and 4TB for storage

I spent 2 weeks trying out various recovery programs, popping it into a toaster and seeing if I could pull the data off the unallocated storage onto an external, and even booting into a live USB of Lubuntu but nothing was working.

Then I tried running the seagate tool that came with it and it gave me a flag saying that it needed the Virutal Disk Driver to be installed

I installed the driver, gave the partition a letter and presto, all files and the partition were back good as new!

yup, all that effort for 2 weeks when all that happened was that the upgrade from 7 to 10 deleted a driver.

Here’s to hoping my experience will help others especially since this board was a top result when search for answers!”

Yes!

This led to me to search for info on my Seagate SSD hybrid drive (which I love but have had bad block problems with, possibly because it’s oversized and hot in this PC’s tiny cramped computer case.)

st4000dx001 win10 driver

and just reading the results list and not the details I improved the search as:

seagate virtual disk driver

Which took me here:

http://knowledge.seagate.com/articles/en_US/FAQ/006205en?language=en_US

Titled: DiscWizard Extended Capacity Manager partition is missing after updating to Windows 10

Why, yes it was and it took a terabyte of data with it! But that had a link to the driver:

https://kb.acronis.com/content/38937

“In some Windows system configurations, you need a Virtual Disk driver from Acronis installed to let True Image 2013 successfully operate a 2 TB+ drive.”

I installed that, just like I had in the dim recesses of my memory when I first installed the hard drive on Windows 7.

Well, Windows 10 forgot about it too.

Now it knows who the boss is, and I can listen to my iTunes again.

“Wait for it, wait for it.”

“Why do you assume you’re the smartest in the room? Why do you assume you’re the smartest in the room?”

Oh, Hamilton, you know….

(And you too, internet, thanks!)

               ——-David

P.S. TL;DR If you have a giant drive missing a partition after upgrading to Windows 10, download and install this: https://kb.acronis.com/content/38937

because your older system may not have recognized your drive since it was more than two terabytes (even if you partitioned it to several smaller partition sizes like I had.)

P.P.S. TL;DR means too long, didn’t read. And there used to be a hilarious Tumblr on it.

Virtually Damn You, Windows 10, Okay Fine was originally published on Creative Uploads

I Need More Storage Space

Been off filming a dance recital and ingesting the digital files. I usually film two shows and combine the best numbers in each. This gives me inspirational luck the first time through, and familiarity with dances the next. Plus when someone misses their mark or just plain doesn’t show up for a night I have it covered.

This time I shot part of the third show too, by studio request, since there was a special one-time-only guest for it.

Doing two different nights takes a little more time shooting, but I only do a quick multi-camera edit before deciding which numbers to polish, and even that gets me more familiar with the dances and appropriate pace and style presumably speeding my subsequent edit process. Also it’s fun.

So far it’s been a three-camera shoot but this time I upped it to four for just because I could, all different models for later frustration. (Had a second cameraman for a change but only on one camera.) This let me experiment with shooting event video with a Canon Rebel (wide shots) without the fear I had no backup angle. Also I put my Go Pro up in the air on my tall mic boom pole. I like the aerial but think I prefer my usual front stage floor level shot, because it made the young dancers seem more dramatic and imposing. It will be great for the more fluid lyrical numbers though. I’ll see in the edit. I have a wide angle shot like it used to provide but at a higher, less dramatic angle.

We’ll discuss camera details another time, and I also shot some video comparisons via phone, iPad and my Canon during rehearsal for a quality comparison post.

But in the meantime I have over 500 gigabytes of raw files between the many cameras and audio recorder plugged into the sound board.

It all still fits on my system but I need to decide how to backup my projects when done to make room for more, instead of continually adding larger drives to my system, right?

I was torn between buying plain drives as backup, or drives in enclosures because it seems to me that the cheap deals you want to get are not always the most reliable choices. When both the drive and the enclosure can fail, that’s not good. Besides you don’t know which it is until you try to pull the drive out to test separately. So I think I should go with raw drives, plugged into a SATA bay in my computer for the transfer, or connected via a handy SATA/IDE to USB adapter I picked up ages ago for computer support work. They should also take less space to store than my current box of different branded external drives and their various power supplies and cases.

(Vantec made it, like this one: //ws-na.amazon-adsystem.com/widgets/q?ServiceVersion=20070822&OneJS=1&Operation=GetAdHtml&MarketPlace=US&source=ss&ref=as_ss_li_til&ad_type=product_link&tracking_id=megawatson-20&marketplace=amazon&region=US&placement=B00GRNUKOK&asins=B00GRNUKOK&linkId=bd7efc61a2bbc98ae470b20943eeb5eb&show_border=true&link_opens_in_new_window=true
http://amzn.to/29AwX0v which is USB 3 and may in fact work for some less strenuous editing projects (maybe not four cameras), though I am still using the USB 2 version http://amzn.to/29gbCeI)

But I don’t want to edit on them, I will do that first in a folder named for the year, month, date and event, with subfolders by which (Friday, Saturday etc.), and in those folders by device (camera, audio).

Those are the assets I import into Adobe Premiere, in a project set to the same folder, with the project file saved under the top directory.

Back that project file up to another computer often. And expand your automatic project saves count. Be aware that you will want to use the file with the last date created to recover your project from these auto saves should you need to, not necessarily the incremental number.

I have had good luck with Western Digital drives but everyone has a favorite lucky flavor. I used to love Seagate but had poor luck with their hybrid SSD/HDD throwing out black errors and don’t like that.

You don’t want to use SSD drives for long-term offline storage; they are built for speed but when not active they do not hold data as long as magnetic disc drives according to several studies. So put them in your system, not your storage closet.

But get some drives, and you can easily back up your complete project folders, prep a project and hand it to an editor or collaborator, or just make room on your editing system for the next big thing, or video game or music library….

While you’re at it, maybe throw some important documents on one and store it with a trusted friend or family member. Trade it  with a second regularly. It doesn’t take a lot of time once you make a habit of it. Like multi camera shoots.

— David

P.S. That document backup habit, you can do that with a couple of flash drives if your documents all fit on them.

I Need More Storage Space was originally published on Creative Uploads