Sunday, January 17, 2010

Dropping frames with the Canon 5D mark ii

My wife, Rachel, is a photographer and we happen to own a 5D Mark ii.  I -like every other filmmaker out there- have been very excited about the whole hybrid DSLR revolution.

There are many extraordinary benefits offered by this new breed of camera.  Many blogs have been covering them.  The cost to sensor size ratio is probably the foremost one.  With the 5D mark ii, you're basically shooting with imax depth of field characteristics.  This has advantages and disadvantages.

The advantage of course is that you get a beautiful big picture look.  Focus falls off beautifully (an there's a world of gorgeous lenses available for far less money than quality cine lenses).  Looks very cinematic.

The disadvantage of course is that your depth of field is often SO tight that focus can be VERY hard to nail.  It's certainly impossible to tell focus on the tiny screen, you need a high def monitor etc... etc...  The problem is exacerbated by the fact that the photo lenses are actually designed so the focus ring doesn't have to travel far (faster autofocus, more energy-efficient).  When you're trying to pull focus manually however with great precision this works against you obviously.

I figure the troubles are well worth the look you get.  If a take goes soft (and I use the Small HD monitor to gauge it, with my face about 6-10 inches away from the screen), I can always do another.  Get more coverage.  I can also stop down.

Yes, the other benefit to the huge sensors in vastly increased light sensitivity.  The footage I'm going to post below was shot at 3200 ASA.  Yes, there IS noise visible in the low end, there IS some slight vertical lining noise (which I often see on the RED footage I handle) but it can easily be crushed out.  Also, I'm not completely anti-noise on most shows.  Depends what you're shooting.

Here, we were performing a screen test (of tech, style, and cast) for an edgy experimental film we're working on called ZOO.  It's a gritty thriller set in a warehouse, and so, some noise is not an issue for me.

But 3200 ASA!!!  It's absolutely mindboggling.  Thanks to that level of sensitivity I was stopped down to a 5.6, close to the sweet spot on the lens and the image looks glorious (IMHO).  Obviously, this helps massively with the aforementioned depth of field problem.

Sadly however, I've discovered a serious problem with the camera.  It is dropping frames.  I'd read some reports online about dropped frames but people have been waving them off, saying they're due to the high bit rate of the compression.  Most machines won't play it back smoothly.  Though the high bit rate does make it hard to play back the footage natively, it has nothing to do with the problem at hand.

Here are a couple short clips.

Canon 5D Mk ii dropping frames on a pan
Canon 5D Mk ii dropping frames on actor movement

If you play the footage back you'll see two duplicate frames, then motion catches up.  Always one original and two dupes before it catches up.  The fact that it's always exactly the same number of frames gives me hope that it may be a software problem and firmware fixable.  I have no basis at all to say that, it's just a hope.  Because the camera is great in so many other ways.

A short note about workflow, the footage was transcoded to 1920x1080 ProRes HQ at 30 (not 29.97, same as the native stuff).  When I saw the problem I went back to the native footage (which is choppy to play directly as mentioned before) and saw that the problem is in the original media.  The camera duplicated frames and then 'jumped' back into real time.

This is hard to reproduce which may be why there isn't much chatter about the problem yet on the intertubes.  It appears to happen only when the image is changing substantially (pan or other major movement in the frame), yet it doesn't happen ALL the time.  I read on another blog that people were linking it to a change in aperture but the camera was on full manual (with the latest firmware) and all settings were constant.  I DID have the image stabilization set on the lens but that should not be creating duplicate frames.

My current theory is that the internal processor gets overwhelmed occasionally with new data and this is the result.  This is VERY VERY bad and potentially disqualifies the camera altogether at this point.

But I'm not ready to give up.  Firmware update anyone?  Or any other theories out there.

I'd love to hear back.

UPDATE:
I think the problem is most likely an overheating one.  I've now seen the duplicate/dropping frames problem happen right in the middle of a static shot.  Just not at the beginning of takes.
It is obvious from looking at the camera that it isn't designed for heat dissipation.  RED cameras and SI2K cameras have fans and heat sinks.  The 5D on the other hand is designed to be water and dust resistant, lots of seals, poor heat dissipation.

I wonder if the 1D-Mark iv suffers from the same problem of if their dual DIGIC-processor design solves this problem.  I bet the 7D is just as bad.

In the meantime, there will be more testing.  And if we're shooting, I'll be getting additional coverage.  It does happen quite rarely.

Bummer though.

34 comments:

  1. Hi Jeffery, I just purchased a 5D Mark II for work and found the same problem in one of my clips. 3 repeated frames and then a jump to the resumed action. Happened on a pan. I'm looking through my other test shots to see if the problem repeats.

    ReplyDelete
  2. I'd love to hear more about this from anyone. Theoretically an indicator shows up when you overheat the camera (though I haven't seen it yet).

    It's definitely not a too slow CF-card issue. It's occurred on 233x cards and 300x cards.

    ReplyDelete
  3. I have just bought a 5d having using the 7d with great success and experienced no dropped frames, however the 5d is dropping frames all over the place. So much so I thought the camera was broken, but apparently not. I don't know if this is a fix, but when the camera drops frames it makes a little mechanical noise, rather like a soft clunk, I took the camera out of autofocus and with IS (24-105L) off, and in preliminary testing the problem seems to have gone away... But I struggle to believe it is the camera trying to set focus. Any feedback is greatly appreciated. Great Post Jeffery, the more this problem is written about the more likely Canon are going to fix it! We hope!

    ReplyDelete
  4. Hi - I've been astounded that Canon can release this great new tool with a problem that undermines the very thing it is pioneering. Dropped frames - they happen all the time and also in manual mode if you run fw 2.0.4. i dont know the solution and i don't think its heat. I'm hoping it is just the software. Mostly - it's due to exposure changes but not always. The 'click' mentioned above I think is just the sound of an aperture adjustment. I've spoken with Canon (cust. serv.) and they seem to be aware but not really - after all it is a 'stills camera' - but as people are beginning to really make new footage with this great little tool - it isn't going to stay a 'stills' camera for long. I hope that many people will make canon aware of the problem. Mostly all of the service people I have talked to have been unaware. I get the dropped frames on almost every shot - which means you cant rely on the 5D.

    ReplyDelete
  5. I am in the same boat.

    Thankyou for this wonderful blog. It really explains this phenomenom perfectly, and I will reference it as I am trying to get an answer out of Canon Support.

    Have you heard anything new since your last post??

    Michael

    ReplyDelete
  6. I have this problem 21.02.2009
    But only has now noticed it
    http://www.youtube.com/watch?v=G-BDYpHdhI4

    ReplyDelete
  7. Was hoping to find a solution at the bottom of this comment thread. Maybe someday...

    ReplyDelete
  8. just found this link and I am having the problem too and as confused to the cause as everyone else.
    I think it is in the software and that a firmware update could solve it.
    And maybe Canon will add, audio metering in record mode and break the 4 gig limit too!
    What became of that third party Magic Lantern update?

    ReplyDelete
  9. im having the same problem :(
    http://www.youtube.com/watch?v=7GxGMaLnP58

    ReplyDelete
  10. I had a 7D since Feb. 2010 and used it for video pretty heavily and experienced no dropped frames. I replaced it with a T2i and a 5Dmk2 for its larger sensor. I'm getting several dropped frames with no rhyme or reason with how I set up the camera. I replaced the memory card in hopes that that was the issue but the problem obviously is in the camera. I can see it dropping frames on the LCD while I'm recording footage. Seems like something that could be fixed in firmware. I'm on firmware 2.0.7. Canon... Help!

    ReplyDelete
  11. Not clear from that last comment if your T2i is dropping frames as well. I'd be curious to know.

    So far this problem appears to be specific to the 5DMk2.

    ReplyDelete
  12. To clarify the T2i is not dropping frames nor did the 7D. I'm contacting the regional rep about the 5D's issue. I will point him to this blog and send some personal examples as well. I will post my findings. Thank you for this blog entry.

    ReplyDelete
  13. I contacted one of Canon's product specialist and his response was he is "not aware of any troubles with the camera dropping frames as a result of camera malfunction". He also mentioned that I shouldn't have any problems as long as I'm using UDMA compliant cards. He then added they would be glad to give it a once over at the factory service.

    ReplyDelete
  14. I wrote back to let him know I'm using a 32gb 66MB/s 450x UDMA 6 card and I tried out a 16Gb SanDisk Extreme III today and still have the problem. I also asked if he reviewed this blog. More to come.

    ReplyDelete
  15. In Live View/Movie func. Set.
    Check to see if your camera is set to
    >> Exposure Simulation

    If so change it to

    >> movie display

    I think the click we where hearing and the framedrops are a result of theexposure simulation mode.

    Comment if this solves your problems as well.

    Happy Pictures!!

    ReplyDelete
  16. Uh... no that doesn't fix it for me.

    I've only ever shot with it in movie display.

    Also, I don't have a 'click' issue. Perhaps you were suffering from a different problem.

    ReplyDelete
  17. In Live View >>stills+movie >>exposure simulation - I hear a faint mechanical click sound as it adjust to the proper exposure and it drops frames during that proccess. When I switch Live View to >>movie display - it no longer tries to make that adjustment resulting in no lost frames. I'm able to switch between the two modes and intentionally make it drop frames in exposure simulation whereas I can't get it to drop frames in movie display. This has only worked for me for test at home. I'll let you know how things work out after extended use. Perhaps there is more to the issue.

    ReplyDelete
  18. nope. mine has been on movie mode since day 1. (firmware v. 2.07)
    (60mbs. scandisk cards.) Still drops frames. At first I only thought it was when the card was almost full but that is not the problem. It's worse on pans and moving shots. Not sure if shutter speed or depth of field has an affect on it. I took a gamble in getting a still camera to do video and it looks like I lost. It is an incredible still camera though.

    ReplyDelete
  19. I've done some test shooting with three other cameras since my last post. I was not able to duplicate my findings on the other 5Dmk2s either. So the victory cry came a bit to soon. What I can say is true is that in manual mode with the live view settings I described above my camera operates perfectly. As soon as I switch back to exposure simulation it begins dropping frames like crazy.

    Bottom line for me - after shooting with 3 other cameras that work as they should no matter the settings I'm sending mine in to Canon for repair. This camera is capable of what we purchased them for. My co-worker has been shooting wonderful news promos with one for well over a year and he's never experienced a frame drop. We may have bad apples.

    ReplyDelete
  20. Noticing a dropped frame during testing earlier today, I played with my camera some more to see what I could find. My camera drops frames, but seemingly only during a dramatic change in brightness. I let the camera record while panning left and right and it would go the whole recording (1-2 minutes) without dropping a single frame. When I pointed the camera toward the window and away from the window (dramatic brightness change) it would drop a frame each time, just like clockwork, and I would hear a click sound.

    This doesn't seem like a huge problem to me as a professional quality clip won't have this degree of change in lighting. I hope that everyone else can find a solution to their problem.

    ReplyDelete
  21. Update...

    I've gone back in forth in my findings and my post on this blog, however today I got the camera(FW 2.0.4) at work, that never demonstrated the problem before, to misbehave like many of ours have. What I did different today was used the 50mm 1.8 on both cameras. Previously I used a slower lens on the work camera that didn't have nearly the aperture range.

    Just as with my camera frame drops only happened when the camera attempted to automatically adjust the simulated exposure while recording. If this is not the case with your camera perhaps we are fighting different battles.

    To test this theory give it a try. With live view in exposure simulation mode, take your camera into a space that has drastically different lighting conditions and pan from the bright point in the room to a dark point and back to the bright area. You should hear a faint click and see the image on your LCD drop a frame while recording.

    Once you switch Live view to Movie Display repeat the experiment and see if it still drops frames. Both of the cameras I'm using worked identically.

    Further I spoke with 2 separate Canon Reps and they confirmed these findings. If this is not your problem I advise you call 1-800-OK-CANON and explain your cameras problems to them.

    I sincerely hope this post helps with your problems.

    ReplyDelete
  22. Just to reiterate what HDPROFilms said, I switched to Movie Display mode and manual settings and the camera records flawlessly. Of course, this is mode is more appropriate for professional filming and not convenient for casual use.

    If anyone is still experiencing dropped frames after switching to Movie Display + manual mode and have confirmed that their CF card has a sufficiently high sustained write speed, they may have a defective camera and should continue to contact Canon about the issue.

    ReplyDelete
  23. Nice to see the discussion. I'm now hoping our 5D Mk II is a lemon and will update this blog as my little 5D odyssey continues.

    To clarify, I've never shot video with the camera in 'Exposure Simulation' mode. The manual is clear about shooting in 'Movie Display' mode and that's what I did from the start. The dropped frames I experienced are infrequent and not always noticeable, seemingly occur after prolonged usage.

    This is clearly a different phenomenon from those shooting mistakenly in 'Exposure Simulation' mode.

    I'd be delighted to discover our camera was defective all along. More to come.

    ReplyDelete
  24. Hi.. i had my camera on movie display setting and still seemed to have dropped frames at the beginning of a shoot on a UDMA 6 64gb card. On the previous shoot the camera worked fine. This is a new camera... strange....

    ReplyDelete
  25. I am glad I am not alone on this... I think. I am in day 25 of filming a full length feature film. We have 4 5D MKIIs in use. I noticed the dropped frames today. I pray when everything goes into editing we are able to cut to other camera views to get around this problem. I am going to update to firmware 2.0.8 tonight and see if the problem has been resolved.

    ReplyDelete
  26. "If so change it to
    >> movie display"

    Thanks. My problem is solved. :-)

    ReplyDelete
  27. Yo, the Overseas is speaking.
    Same problem in germany, dropped frames. not too often though, i have firmware 2.0.8.
    supershit this is.
    i hope i can exchange my camera although i allready glued my viewfinder to it.
    in germany noone speaks about that problem.
    scheissekakke

    ReplyDelete
  28. My EOS 60D is having the same problem.
    It has to do with "Auto exposure" mode and is related to the aperture changing as the light condition changes.

    You will hear a soft click sound just before the drop frame occurs.

    Canon Service center says 5Dmk2 has a firmware to deal with it, and my case is the first reported case for 60D.

    Can anyone try the 5Dmk2 latest firmware and see if that resolve the issue ?

    tks

    ReplyDelete
  29. The latest firmware doesn´t resolve the problem :-(
    Have you tried with "movie display" in live view options?

    ReplyDelete
  30. Here from Argentina.
    2.0.8 update. display set at movie display. but still drops frames random. I am using a Promaster CF High speed memory UDMA 8G, same problem with a 16g CF. NTSC 1920 30fps.
    I guess we will never be able to de 60fps if its droping at 30fps.

    ReplyDelete
  31. I am sad to say that I purchased in December 2011, I have been using the camera for many months now but noticed the drop frames on a studio green screen shoot with talent. We reshot the talent and had the same results but drop frames in random places. We shot in "Movie display" and All manual settings. No lighting conditions changed or zooming in the shots. The only thing that changed was the movement of the subject in the tripod shot. Firmware Ver. 2.0.9 I am so disapointed. Please tell me there is a solution. I take this camera on shoots all over the country and I can not afford a mistake.

    ReplyDelete
    Replies
    1. Yeah, sorry to say I never found a solution.

      I've had people tell me I'm wrong, that their camera doesn't drop frames but I think they simply haven't noticed the problem. It can be subtle and only spoils takes in certain circumstances.

      I've had this issue with 7D footage as well.

      The whole thing has put me off of DSLRs completely. They're fine if you don't have the budget I guess but you might want to consider a camcorder instead. Especially now that there are some large chip camcorders out there.

      Delete