IMHO - WHY I DON'T LIKE HDV
HDV is a consumer format. Sony itself has said so. So why have they made so many "prosumer" cameras? Because there is a market for it. But the format is anything BUT professional. Can a guy grab a camera, shoot his friends skateboarding, edit this and throw it up on YouTube or make a DVD? Sure they can. And just because SURVIVORMAN shoots with HDV cameras doesn't mean it is professional.
Bear with me as I rant a bit about this format...
I knew there was a reason I didn't want to work with the HDV format. I read all of the issues on the various forums...GOP format makes rendering take forever, 4:2:0 color sampling, start and stop makes new clips (time code breaks in essence), highly compressed (HD signal on the same tape as DV...wow). Oh, there are people who offer solutions like "capture as ProRes to stay out of the GOP format and get into a better color space when editing." OK...fine, I hear you, But that too has issues.
Here, let me explain what issues I am faced with.
Issue #1: Timecode breaks confuse the crap out of the deck. THE PROFESSIONAL DECK...the HVR-1500. It hits the break, then backs up, then goes forward, then backs up...does this little square dance for a minute or two until it decides that can't find the new in point (who the hell knows WHY? It's right there!) and then it bombs out. This happens all the friggin time. No, we don't shoot time of day. This is just regular INT GEN timecode. It's as if the deck hits the break, tries to capture right from where it left off, but because of the break it can't figure out how to pre-roll properly. Very odd for a "professional" deck. OH, and for the record, we are connected via HD SDI to AJA Kona 3 capture cards with RS-422 deck control. Also tried firewire deck control with similar results.
And it isn't a Final Cut Pro issue. I have researched this issue and it pops up in Avid and FCP forums. I have called people who shoot this format and they have the same issue. It is a format and deck issue. Their solution? Dub the tapes to make one long unbroken code...either to another HDV tape or to another format. Waste of time and resources if you ask me.
ISSUE #2: This company shoots many scene at 8fps. Recording 8fps onto the 29.97 fps tape, so it looks streaky and blurry. This worked for while until TWO TAPES came in that we couldn't play on any of the decks. Plays back black, both out to the monitor and to the FCP capture tool. We could see the image if we fast forward or rewind, but not play. Someone suggested that this is a timecode issue...that somehow the timecode track on the tape is fubar (look it up in the wikipedia). But the tapes weren't damaged, not visibly anyway. So I suggested that we try playing them back in the camera that they were shot with. One tape played fine in the camera, and was dubbed to a new tape, but the second tape doesn't even play back in the camera...nor any HDV camera that we have.
To all those people who say that when you shoot to tape you don't lose footage...I say HA! Sure you can...always could. I have had plenty of experience with tapes that have had issues where they didn't record timecode to the tape (damaged record heads, dirty heads). And anyone who has shot tape knows that dropouts are VERY common.
So...why did we shoot HDV? Well, the typical arguements. "Tape is cheaper than those P2 cards," "I am wary of tapeless formats because you might lose footage (debunked)," "we won't need a field technician for offloading cards, with multiple hard drives," "oh, we can just capture to ProRes to avoid the GOP issue."
OK...let's look at this.
-"Tape is cheaper than those P2 cards."
Initially...sure. But after a while all those tapes add up. P2 you use again and again and again. And you are only assessing this as a PRODUCTION COST...not an overall project cost. Let's factor in a few more things. DECKS. You need to buy or rent decks to capture this footage. With P2, or SxS, no decks required. Direct import into the computer. This not only saves money on decks...but MAN does this save TIME! Now not only can you import on one machine...you can import on MANY machines. You can import on all six edit machines if you need to. Manpower time...saved. Therefore less money is spent on their overtime...or extra time. And P2 imports faster than real time...MORE time is saved.
So with HDV, you saved a little money during production, but then added a lot of money in post...deck rental and cost of paying your employees more for the extra time needed.
And one HUGE headache with tapes...prioritizing. Two projects, tapes came in for both...both are under the gun to work with this new footage. Who gets their footage first? Now you have editing sitting on their thumbs while they wait for more footage...adding a day or two to the editing days...and THAT time is a lot of money.
-"I am wary of tapeless formats because you might lose footage"
This is a ridiculous statement. Raise your hands if you lost a tape full of footage during production. OH, I have. Ever experience tape glitches or dropouts on tape? I sure have. And I have seen digital hits on P2 and SxS too...it happens. Ever have a tape ERASED via a big magnet, or a degaussing machine due to carelessness? I have. Solid state solutions work if you are careful and back up the cards before erasing. Yes, that is an extra step, but if people are paying attention, it works great. Whenever someone ISN'T paying attention, that is when you lose footage. Taped and solid state.
-"we won't need a field technician for offloading cards"
With tape, no you don't True. But the cost of that person during production...that body...cheap compared to the hours you pay one or more assistants in the post process to capture tapes.
-"We can just capture to ProRes to avoid the GOP issue."
This brings up ANOTHER cost issue. HARD DRIVES. DVCPRO HD P2 takes up very little space. Capturing everything as ProRes...in a shared storage environment? Duuuuuude. For one guy that extra firewire drive isn't much. But to go from 12TB to 18-24TB on a SAN? Not cheap. Not by a longshot.
Now, capturing HDV as Offline RT...possible I suppose. Something we are considering. But then we STILL have Issue #1, the deck cha-cha-cha about the timecode.
Sorry about this. This is my first full on HDV project. The one time I was saddled with an HDV project I captured HDV as DVCPRO HD and that made my life EASY. I logged and captured...and since it was a small project I didn't run into too many issues.
HDV gets an even bigger THUMBS DOWN from this editor. A format that is consumer, and should stay consumer. IMHO.



21 comments:
Hear, Hear. Something that I've agreed with since day one. HDV is and has always been a substandard format. Professional work requires professional gear. It is more than just making a shot look good which any competent DP can do with any camera, it's about working in a complex system. My biggest HDV nightmares with HDV timecode are they may not match from offline to online. I remember doing jobs where the timecode was off by upwards of a second in some instances of recapture from the offline. While I believe those issues may have been corrected with newer decks, it still left a horrible taste in my mouth. Nothing quite so fun as having to slide every single shot in a 90 minute documentary by varying frames.
Oh and then there's the issue of top tear broadcasters not accepting more than 5 - 10% of your HD show being shot on it.
HDV good for the web, weddings, skateboarding videos (and who doesn't take sick pleasure in all the broken bones and teeth of the stupid) and not much else.
Sony marketing sold a bill of goods that the actual camera technology could never live up to.
Just in case you haven't figured it out yet, I despise HDV and I don't use that word lightly.
I've had similar problems w/the HVR-1500 trying to capture over SDI. Hook it up via FW and all is good. Hook it up via SDI and it hangs on 'phantom' TC breaks (I say 'phantom' because I'll step thru frame by frame and the TC is unbroken). Recapture is iffy too, but w/the file sizes being so small there's no reason to offline/online w/HDV, IMO.
Even w/all the negatives though I've been working w/HDV successfully for the past couple of years at my current employer and while we'd like to get away from it nothing else fits into our budget and workflow right now.
You don't necessarily need a technician to offload P2 / SxS cards in the field. It depends how much you're shooting per day. On a 64 GB P2 card it's about 2.5 hrs at 720p and just over 1hr at 1080.
If you're shooting less than that per day you could just get a crew member to offload it at the end of the day.
I am with you shane on the hdv format, I've had my fair share of headaches in post dealing with hdv
by the way any timeframe for your completion on your test of the caldigit VR vs the G-raid 3
(waiting anxiously) :)
OH, yeah...sorry. Lemme try to get that out in a couple days. I did all the tests and took them both apart and all that. VERY close, BTW...
I don't understand the 'capture to ProRes' philosophy, unless you never resize, grade or effect your footage. Just capture HDV and render to ProRes (not HQ, unless you really like waiting). This is a robust workflow in FCP, doesn't waste unnecessary disk space and the render times are not onerous.
The points raised about conforming HDV are valid. Which is why we never do it. Might as well capture the original HDV native and work with that right through to the online.
They tried the option you mentioned for the first season of this show...capture as HDV, edit that, then media manage the sequence (make offline) to contain only what is in the sequence with handles. The issue they had there is that the ProRes recaptures were WAY off sync. From 8 frames to 2 seconds. So they had to slip and slide every shot.
We will be testing capturing as Offline RT HD then recapture and see what that does.
Shane, you're on the money.
I'm in a similar boat with AndrewK. But while I wouldn't say "successfully" working with it, we get by. I transcode all my tapeless clips to DNxHD in 1280x720. That works since we don't need anything more than web and DVD and holds up under the limited VFX and color we do.
But I just shot a huge project and the timecode issues are absolutely hideous. I recoded everything in the NLE after I pulled it in and figured out what went where. HUGE time loss.
The HDV workflow SUCKS.
Shane you seem like a Panasonic man at heart, if that's the case what do you think of the panasonic hmc150? In my eyes other than being tapeless it seems to have most of the same major problems with hdv as far as rendering and colour space goes. My understanding is that it too is supposed to be a consumer format, but Panasonic is putting it into prosumer cameras and canon will probably follow suit.
When it came to standard def, I am a Sony man. BetaSP, Digibeta...no arguing that. Yes, I am a Panasonic man, because the DVCPRO HD format is a VERY good format (Plant Earth was shot with that format) and they invented the tapeless HD format.
That being said, the HMC-150, even in their minds, is a PROSUMER format. Not intended for broadcast television. They market that to wedding videographers, corporate, education, government. Because while it is MPEG-4 vs HDVs MPEG-2, it is still a GOP format. Although you import it out of that format and into DNxHD or ProRes and you are immediately in a 4:2:2 color space (for color correction) and in an I-Frame format. You can NOT import this as native (well, Vegas can, but it can't work with it natively)...you can only import as ProRes or AIC...so you have ZERO of the issues of HDV.
There is no tape deck to confuse...no GOP format to need to edit.
There are consumer AVCHD formats, and they go up to like 16mbps maybe? 12mbps? The HMC-150 has a VERY high quality mode...PH mode...that is 35mbps. It produces VERY clear images.
And again...the market is not professional broadcast, but professional corporate, wedding, government, education. They know.
Thank you Shane! It is always great to rally around the pros (and definitely cons) of a format, particularly HDV from the point of view of the editor. One of my clients invested "lots of dollars" into an HDV cam (even after begging him to avoid the format) and we've (predictably) run into pretty much all of what you have covered.
It's not that it can't be done, but at what time/money/quality costs. Your latest post is fuel for the fire again in getting my client to step away from the GOP, just step away from the GOP.
cheers
You know, XDCAM has a lot of the same limitations. Long MPEG2 GOP, 4:2:0 color space. Would you consider that a pro format?
I'm not saying that the issues you raised are not necessarily valid, (though having deck control issues isn't really applicable to the whole format), but I remember hearing this about the following formats when they came out:
DV: Consumer format, hard to edit with, heavy 5:1 compression.
DVCHDPRO: Essentially DV compression on HD material. Not native resolution, stretched.
HDCAM: Crazy 3:1:1 color space, heavy compression.
Etc. Etc.
Long GOP is a very efficient way of compressing video, and it's here to stay. On the whole it produces great image quality for the bitrate.
As a working editor, you can't just dismiss an entire format as "unprofessional" and wash your hands of it. Learn to embrace long GOP and you'll be a happier man.
Love the blog btw!
XDCAM has a higher bit rate...therefore looks better. AND, the XDCAM decks are well proven and do not suffer the same known issues that HDV decks do. XDCAM is a unique format anyway...on BluRay disks and not tape. Yet it is a more robust format.
DV was "tolerated" as a professional format. We used it ONLY as B-roll, and sparingly. DVCAM never had the same deck control issues as HDV. Not at all. It is a great format to work with, it just looks like poop.
DVCPRO HD is DV compression in HD? That is an odd statement. DV is 4:1:1. DVCPRO HD is 4:2:2. I don't see the similarity. Yes, DVCPRO HD is compressed HD. Every format of HD is compressed HD.
Long GOP might be an efficient way to compress video, but it is a nightmare to deal with in post, which is why you get OUT of GOP ASAP. HDV is a CONSUMER version of that format. XDCAM is the professional version.
I will not embrace the HDV format. I will tolerate it when I have to.
Yes, but XDCAM is long format GOP Mpeg2. Just like HDV, only higher bitrate. It's just not on tape. The long GOP issues are the same.
DVCPROHD: Sorry, I should have been more clear, DVCPROHD uses the same TYPE of compression (DCT) as DV, and actually is compressed more (6.7:1) than DV (which you claim looks like poop). It does have more color space, but it is more compressed.
As far as deck control issues, ever try to hook up a Panasonic HD 1400 tape based DVCPROHD deck to FCP? The issues were legendary!
My point is, all these formats look just fine. And they all have their issues to edit with, and HDV just has slightly different issues.
You've got to accept them, deal with them, and work with them just like any other format you come across in your professional life.
Come to the dark side, join us, become an HDV enthusiast, learn to love the Long GOP.
Ah, DVCPRO HD is compressed, but VERY well. FAR better than HDVs GOP. Then if you want to compare XDCAM GOP to something, look at AVCIntra. Both DVCPRO HD and AVCIntra are I-Frame codecs.
DVCPRO HD is a 100megabit codec...GOP tops out at 35mbs.
Planet Earth was shot 95% Varicam...DVCPRO HD...720p, not even 1080. So if you want to know if it is good enough...it is good enough. And it is VERY EASY to work with in post. And the combination of the two is priceless
I have heard of issues with the 1400 deck, but they do not hold a candle to the issues I have with the HVR-1500 deck, nor what I have researced about the deck. The 1400 doesn't bomb out of a capture because it can't find the TC break.
Looking good and not working well in post...HDV's big problem. So it looks good...so what? If I have to waste more man hours dealing with the footage then I consider that a complete waste.
As I write this I am wasting 3/4's of a day recapturing HDV footage as ProRes. 4 times out of 10 the clip captured will not reconnect to the clip due to timecode slippage issues. Between 1 and 4 seconds off! And if I force it to reconnect, then my timing is off. This is a known issue with FCP and HDV. Media Managing an HDV sequence with handles causes this issue to happen.
SO now, a batch capture that should have taken an hour...TWO tops, it taking 6 hours.
Nope...this is more ammo to convince the company to dump the HDV format and move to DVCPRO HD P2. The daily camera rental is less than they paid me to babysit this capture.
Have codec wars been elevated to Mac/PC, Avid/FCP level flamewar status? ;)
Horses for courses, IMO. Unless you have a huge budget there will always be compromises made. Part of the problem w/working w/HDV is how FCP manages media, IMO. If FCP tracked media by reel and TC, as opposed to reel, file size and file name, I think things would run a bit smoother. Walter Biscardi seems to have good results capturing from a lower end HDV deck via component outs, into an analog to SDI box then into his Kona 3. Like Shane, I've had no luck capturing HDV via HD-SDI on the 1500. That's the only reason we bought that deck so it just adds insult to injury...
I'm not sure if there is a max bit rate limit for the MPEG2 GOP codecs, but sometime last year Sony released a variant that is XDCAM HD 4:2:2 50Mbit. I think the AVCHD formats have gotten up to 18 or 25Mbit now, FWIW.
Honestly, I've been working in codec hell for so long it just doesn't phase me anymore I guess. On a daily basis I edit w/at least two or three of the following: DVCPro HD 720p60, DVCPro HD 1080i60, DV 4:3, DV 16:9, HDV1080i60, XDCAM EX 720p60, Cineform (which gets transcoded into something else), and a handful of misc assets that might come on tape (SP, Dbeta, HDV720p60, etc.) or over FTP (WMV, FRAPs, H.264, etc.). Ugh. Before the years out though we are going to try to move everything to ProRes for both HD and SD but only time will tell.
I recently invested in an HDV camcorder after a lot of research. Apparently not enough, however. I'm running into a lot of the post production issues you outline here. Is there a workflow that you'd recommend to make the most of this frustrating format? I'm going to be stuck with it for a while, and at this point I'm tempted to just abandon HD and shoot in DV mode.
Andy
Well, you could capture as ProRes via firewire.
http://library.creativecow.net/articles/poisson_chris/hdv-prores.php
I'm up for a feature as an editor, and to my dismay I was informed that they will probably shoot on the Canon XH-1. Because the Red workflow is a pain.
btw Red is retarded easy!
This is cheap city they want to do everything out of my box. There is a huge difference between capturing Pro-res over FW and SDI right? I don't own a Kona card.
How bad will color correction go?
Well, they shot CRANK 2 with that camera, so take that as you will.
If you are going to work with this as ProRes, I HIGHLY recommend a capture card. Sure, you can capture it as ProRes via firewire, but then if you lost that footage for any reason, such as a dead drive or you need to recapture at a later date...you can't do it accurately. Not without a capture card.
How do you plan on color correcting? Can't color correct HDV nor ProRes without a capture card hooked up to an HD Broadcast monitor. No ifs ands or buts about it. Sorry...cheap don't work with HD all that often. Not when you want to color correct and REALLY see what you are getting. They gotta spend $$.
Post a Comment