Thursday, August 27, 2020

ISO testing of the Canon R5 and R6 (and comparing them to the Canon 1D X MKIII and 5D MKIV)

Whenever Canon comes out with new cameras, one of my most important real-world tests is determining how clean the images look at higher ISOs. I am not testing this for scientific reasons, I am doing this test because I shoot in low light quite often and want the highest quality images for my clients. I also thought that you and the rest of the world might be interested in this as well.

Many people get caught up in the number of megapixels that a camera has on its sensor, thinking that the more the better. What people may not know is that the more megapixels they cram onto a sensor, and the closer that those pixels are to each other, the more heat build-up occurs. This increase in heat can ultimately also increase the digital noise (graininess) in our photos. 

If we all took photos exclusively outdoors and in bright light, this would not be a concern. But in normal times (not during this pandemic), I spend my weekends photographing in dark temples and churches and even darker party venues. This means that my cameras are usually set at a minimum of ISO 2000 and I sometimes have to raise the ISO as high as ISO 10,000.

For this reason, I was anxious to test the new Canon R5 and Canon R6 mirrorless cameras to see how they perform in low light. And to give me even more insight, I decided to put them to the test against the reigning top Canon DSLR bodies, the Canon 1D X MKIII and the Canon 5D MKIV.

In order to try and keep everything as consistent as possible, I put together a plan to use as much of the same hardware as possible. Since I had the RF adaptor in my possession, I decided to use the Canon 70-200mm 2.8 L lens which could then be mounted to my DSLR cameras and the new mirrorless cameras (using the adaptor). I mounted the Canon 70-200mm lens onto my Gitzo tripod, zoomed it to 200mm and pointed the lens at a dark object in my office (which turned out to be a black NFL helmet in my collection). I decided to set each camera to aperture priority mode at f/8 and vary the ISO levels from 100, 800, 1600, 3200, 6400 and 12,800. I chose these ISOs since they most represent what I typically use for my work. I went as high as 12,800 even though I almost never shoot anything above ISO 10,000.

I printed small cards to put in each shot to make it easier to see which camera and ISO level I was shooting in that particular photo. One by one, I would mount each camera, work my way through the different ISO levels and then switch to the next camera body.

Once done with the entire procedure, I came across some really weird results. But before we get to that, let's look at the noise levels for each camera.

I zoomed into each image to approximately the same spot (varying for the different resolutions). Not surprising, each camera delivered great results at ISO 100, with excellent clarity and very little digital noise. 

Canon R5 at ISO 100  (Image lightened in Photoshop)

Canon 1DX MKIII at ISO 100

The good news is that, even at the higher ISOs (like 6400 and 12,800), the results were very good. Regardless of the camera used, the resulting images from those high ISOs would clearly be good enough for most clients.

Canon R6 at ISO 12,800

If we zoom in and look at the photos, we can clearly see that we are losing detail in the image, but unless these images were printed very big, it would be hard to see this. 

But when we zoom in, this is where we see the biggest difference in ISO performance between not only the Canon R5 and Canon R6, but also the Canon 1D X MKIII and Canon 5D MKIV

Canon 1DX MKIII at ISO 12,800

Canon 5D MKIV at ISO 12,800

Canon R5 at ISO 12,800 (Image lightened in Photoshop)

Canon R6 at ISO 12,800 (Image lightened in Photoshop)

Amazingly, the Canon R6 outperformed all the other cameras, and in a very noticeable way. The R6 image not only retained much more detail than the other three cameras, but also showed much less noise in the lighter and darker areas.

Here is a closer look at the digital noise for the R5 and R6:

Canon R5 at ISO 12,800

Canon R6 at ISO 12,800

I figured that the Canon R6 would outperform the Canon R5 in this ISO test, but was not expecting this $2500 camera to best the $6500 Canon 1D X MKIII by such a wide margin. And here is another thing that puzzles me: If the Canon R6 uses the same sensor and same processor as the Canon 1D X MKIII, why are the ISO results so much better in the Canon R6? I have written to my contacts at Canon to get an answer to this. Stay tuned...

I think that the Canon R6 might be my choice for shooting weddings and bar mitzvah. I do not need 45 Megapixels for my clients and I prefer to have 20 Megapixels and the cleanest image possible.  I also know that, with the in-camera stabilization, I may not need to crank up the ISO quite as high with the Canon R5 and Canon R6

I know that, with the smaller images size that you see here in the blog post, you may not be able to see the details I am talking about. For this reason, I created a Dropbox folder for you all, so that you can download the full-res RAW images to see them for yourself.

So...what were the strange results that I mentioned earlier? After shooting all the images and comparing at the metadata, I saw a wide discrepancy in the shutter speeds for each camera. They were all set for the same ISO, same aperture, and pointing at the same subject through the same lens. Why were the shutter speeds so different? Here are the comparisons:


Shooting in AV mode at ISO 100 and an aperture of f/8, here is what I saw for shutter speeds:

Canon 5D MKIV: 3 sec

Canon 1D X MK III: 4 sec

Canon R5: 1.6 sec

Canon R6: 2 sec


Shooting in AV mode at ISO 6400 and an aperture of f/8, here is what I saw for shutter speeds:

Canon 5D MKIV: 1/15 sec

Canon 1D X MK III: 1/15 sec

Canon R5: 1/40 sec

Canon R6: 1/40 sec

I wrote all this down and stared at the results, trying to figure out how the shutter speeds could be vary so much. With the lower ISO, the Canon R5 and Canon R6 had shutter speeds that were nearly twice as fast as the older DSLR cameras! And at a higher ISO, the numbers (now the same for the new mirrorless cameras and the same for the DSLR cameras), the shutter speeds for the mirrorless cameras was still much faster than the DSLR cameras. I know, from previous conversations with the technical people at Canon, that different cameras with different sensors will yield slightly different results. But these showed a lot more variance than I would expect.

It wasn't until I looked more closely at the images that I saw what was happening.

Look at the image above and you can clearly see that the metering for the DSLR cameras (in this case the 1D X) is quite different from the mirrorless cameras (here showing the R5 images). The mirrorless cameras are determining the metering right from the sensor, whereas the DSLR cameras are determining the metering from a separate sensor. The darker images help explain why the shutter speed was faster on the mirrorless cameras. Now, the big question is...which camera was metering the scene more accurately.  I opened the image from the 1D X MKIII in Adobe Photoshop and hit the "Auto" button to see what it would suggest for an optimum histogram, and it wanted to add +.23 of exposure. When doing the same thing to the R5 image, Photoshop wanted to add +.84 of exposure. (It is for this reason that I lightened some of the R5 and R6 images in the examples above.)

That may come across as technical mumbo jumbo, but the fact is this. I am OK with the exposure captured by the mirrorless cameras, since it gives me a slightly faster shutter speed, and therefore a better chance of having a sharp image. I know I can make the adjustments to the exposure later in post production. 

Here is my thought process at this point: I think I would like to shoot events with the Canon R6 and lean towards the Canon R5 for capturing images on my photo tours. The reason for this is simple, when shooting events, I am almost always in dark environments and don't need more than 20MP. When photographing wildlife in Africa, Costa Rica or other locations, we are usually shooting outdoors in bright light, and I would love to have 45MP of data in those images, for those times when I need to crop in to see a far away subject.

As I write this last paragraph, I got an email from B&H Photo that the Canon R6 is now in stock. I placed my order for that camera immediately. If you are going to be buying anything from B&H. please use my link which is HERE. It won't look any different for you, but it does show me as the referring party which is helpful to me.

__________________________________________________________________________
Subscribe to the Jeff Cable Photography Blog by clicking HERE!
__________________________________________________________________________
If you are interested in purchasing ANY equipment, please click here to go to B&H Photo, as I get a referral from them if you enter this way. It does not change the cost to you in any way, but it helps me keep this blog up and running.
__________________________________________________________________________
Check out my upcoming photo tours to amazing places around the world. I have photo tours to Africa, Costa Rica, Europe, Asia, India and more. And Canon will loan you any gear you want for FREE for any of my tours.

__________________________________________________________________________  

6 comments:

  1. Thank you, great post and very interesting results. How do you feel about the the EVF for sports? Would you use either of these for the Olympics? Or would you go back to the 1DX3? I'm curious how you feel the R5 and R6 stack up against the 1DX2/3 in terms of overall performance and specifically shutter lag and EVF vs. optical viewfinder. (Apologies if you've already covered the answers to my questions in another post and I missed that.)

    ReplyDelete
  2. great information and comparison. thanks for sharing the testing raw files with us. great resources. but there are some issues with the set of 1DX mkiii raw files. ISO 100 one is ok, but the rest, focusing shift or camera shake? some variant.
    thanks for sharing. love your work.

    ReplyDelete
  3. Exceptionel nice stills and I am impressed about the R5 and R6 quality. Thanks for the pictures. I will my decision a lot easier. I believe I will go for the R6. I own the D5 MIII and will keep using this body

    ReplyDelete
  4. Jeff,

    Great post!

    Would you be inclined to use either of the mirrorless cameras for Olympics and other sports, or stay with the DSLRs?

    Thanks,
    Doug

    ReplyDelete
  5. Hey Jeff thanks for giving me something fun to do on a Sunday morning. I downloaded all your raw test images and processed them in Lightroom with 0 noise reduction exported them and I gotta say the R5 had the lowest noise with the most details in the shadows. I've got an R5 on order and I'll stick with.

    ReplyDelete
  6. Thank you for the samples. The R5 RAW images appeared washed out compared to those of R6. Would love to know the reason.

    ReplyDelete