Luminous Landscape Forum

Equipment & Techniques => Medium Format / Film / Digital Backs – and Large Sensor Photography => Topic started by: Nick Rains on September 29, 2010, 10:08:11 pm

Title: Real World Dynamic Range
Post by: Nick Rains on September 29, 2010, 10:08:11 pm
I'm looking for some enlightenment by the more technically minded LL folks.

Here's the thing; MFDBs and good DSLRs are generally accepted as having a DR in the 11-13 stops range, depending on how you measure it and so on.

My Leica S2 produces a 16bit file which obviously has the potential for 16 stops but in reality it's much less than this - I understand that much. However, using the theoretical 16bit range it would follow that the top one stop contains 65536 levels and at the 7th stop down, 512 levels.

Now, here's my problem.

I just bought a ND2.1 filter, that's 7 stops. It's a Formatt brand from the UK and seems quite neutral so I'm happy. The meter shows it being 6 stops different but it's close enough for the purposes of this discussion.

So, I thought I'd test it today and shot a ColourChecker Passport at an exposure (without the ND) which gave me an almost perfect exposure where the white patches measured around 250 in ACR. It was 1/500 second at f2.8. I put on the filter and shot the same thing at the same exposure to get a 7 stop underexposed image.

I figured that if the camera has a DR of, let's say, 12 stops, then a 7 stop underexposed image should still capture plenty of tones to examine.

The results were not at all like I expected. The image was almost utterly black with the whitest patch barely registering on my Eizo monitor (it reads about 0,0,5 in PSCS5, 16bit file).

So, if that's 7 stops, how come the camera is supposed to have a 12 stop DR? In this situation it looks more like 6.

What am I missing here?
Title: Re: Real World Dynamic Range
Post by: Sheldon N on September 29, 2010, 10:41:32 pm
I think that most discussions of practical DR involve shooting a RAW file where the range of the scene actually contains 9 or 10 stops of dynamic range. This could be a scene like shooting from an interior looking out a window to a sunlit area.  You set the exposure to just avoid clipping the highlights, or even slightly overexpose them but only to the point where they can be pulled back from a RAW file and still keep acceptable quality/detail. Then look down into the shadows (which will appear black) and attempt to use exposure compensation or a tone curve to bring detail up out of the darkness and see how far down you can go. It takes a spot meter to do this because you need to see what the actual brightness of each area of the photo was at the time you took the photo.

Another good practical way to test this is to use a full spectrum light source (ie flash or daylight) and a scene with both light/white textured items and dark toned items with detail in them. Then shoot a series of overexposed through underexposed images in one stop increments. Play around with the files in your RAW editor of choice, see how far you can push the highlights and how far you can pull the shadows without crossing that subjective line of whether it would make a good final image for you. You can then calculate what the total practical dynamic range for your purposes is. I'm guessing it's probably closer to 9 stops in the real world, depending on where your personal quality threshold is.

A color chart or step wedge isn't really ideal for this kind of thing, because it only contains tones without detail. You want to be able to see the results on a real subject. It's difficult to put a firm number on dynamic range, because it involves the issue of how you process a RAW file and in what software, and making a decision about how much noise in the shadows is too much noise. Basically it's a subjective call about how far you can overexpose and still pull quality information from the highlights combined with how far you can underexpose and still pull quality detail from the shadows without noise becoming too objectionable.

My understanding of the whole 12 bit vs 14 bit vs 16 bit issue is that it only relates to how finely/accurately the camera can separate the tones between one another, not describing how much shadow detail or highlight headroom there is. Think of it as the difference between the number of steps on a staircase as compared to the overall length of the staircase.

Title: Re: Real World Dynamic Range
Post by: Nick Rains on September 29, 2010, 10:42:18 pm
I'll try that - Thanks.

I just tried a different test - a shot of my office which has some opaque glass windows. The difference in light levels between the bright windows and a dark space under a table measures 9 stops according to my spot meter. I set the exposure to place the windows at +2.5 to just clip them.

On the 5D2 using 100 Fill in LR3 I got lots of noise but visible detail in the darkest parts, and on the S2 with 50 Fill I got a quite decent result. That seems to show two things:

1. The S2 is way better in the shadows than the 5D2 (Duh)
2. Underexposing by 7 stops using an ND filter is in some ways different to an image with a wide brightness range. Not sure what the difference is though.
Title: Re: Real World Dynamic Range
Post by: Nick Rains on September 29, 2010, 11:10:07 pm
Cinema cameras are tested with transparent stepper charts. So in a lab test method it works quite well to show what range you get.

A simple example, Zacuto tested the footage from a 5DII to Kodak and Fuji motion films. They used a trans stepper which showed the 5DII had about 8-10 stops (don't remember the specifics) and motion film showed considerably more.

David Muench has made amazing images for decades on large format trans film with maybe 5-6 stops of range. I say make some art and worry less about the tech, it's better for the soul.

LOL.

Yes indeed.

This all stemmed from working on a new workshop talk about RAW and bit depth etc. I realized I was touting the party line and had never actually done the legwork myself. Having the ND2.1 filter arrive spurred me into action.
 
Title: Re: Real World Dynamic Range
Post by: Nick Rains on September 29, 2010, 11:48:37 pm
I think I have a handle on this now - I was comparing my ND image to a normally exposed shot when I should have been seeing how far I could over expose it too, before full detail loss. it's nothing to do with the ND, I just didn't extend UP the range, only down.

Forgetting the ND, if I shoot my Colour Checker using a wide range of full shutter speed steps on the S2 and then look at the sequence of images I can see details in about 12 or 13 different images. That's not to say each is correct, or can even be corrected, but I see some detail, even if it's almost washed out through over exposure, or almost, but not quite, totally black.

This now agrees far better with the 12-13 stop DR quoted by many, esp the manufacturers.
Title: Re: Real World Dynamic Range
Post by: LKaven on September 30, 2010, 01:59:03 am
My understanding of the whole 12 bit vs 14 bit vs 16 bit issue is that it only relates to how finely/accurately the camera can separate the tones between one another, not describing how much shadow detail or highlight headroom there is. Think of it as the difference between the number of steps on a staircase as compared to the overall length of the staircase.
Since the sensor is linear to the best approximation, the RAW numbers are also linear, and one bit ~= one stop.

So the stairs are fixed, until some later stage in the processing where profiling and gamma and white balance and so on come into play.  [If the length of the staircase were fixed somehow, how would the model accommodate variations in dynamic range and what would the length of the staircase be fixed at and by what convention?] 

The reason this confuses people is that the maximum signal level is fixed as a reference level up and down the signal chain.  The extra dynamic range is manifest in the low order bits.  This gives the illusion that the dynamic range is fixed.  Most monitors only use 6-8 bits anyway, though high dynamic range monitors capable of 16 stops of resolution are in development.
Title: Re: Real World Dynamic Range
Post by: bradleygibson on September 30, 2010, 02:24:13 am
Nick,

This area is very complex, partly because once you're looking at a presentable image on-screen all kinds of changes have been made to your original, raw pixel values.

It is non-trivial to back out these changes that every raw processor makes to clear and simple intensity values.

No tool that I've ever come across is simple if you want to look at the raw bits, but you want to dig in a bit further, take a look at dcraw.  It's is a great (and free) way to pull out the raw bits as a TIFF file.  The TIFF file won't be much to look at, but load it up into Photoshop and you'll be able to see the pixel values just as your camera recorded them before your raw converter adjusts for black level/noise floor, channel gain, linearization of your camera's ADC's, gamma, color space, etc. etc. before viewing on-screen.  (It's no wonder the values you were measuring didn't reveal a simple relationship to exposure!)

Ideally, in the linear domain, double the value equals double the light (photons).  The variation of numbers of the number of stops of dynamic range you hear usually come from different people's interpretation of where to start and stop measuring this range.  I do like DxO Mark's definitions for dynamic range (http://www.dxomark.com/index.php/en/Learn-more/Understanding-DxOMark-Database/Measurements/Noise), and while there are other valid ways one could define a useful dynamic range, being able to compare many systems across a single (reasonable) standard is a Good Thing in my book.

Hope that helps,
-Brad
Title: Re: Real World Dynamic Range
Post by: Christoph C. Feldhaim on September 30, 2010, 05:00:42 am
Honestly - I don't understand at all, why bit level and DR should in any way be related.
It simply doesn't make any sense.

You can have 4 bits bit depth and 16 stops dynamic range in the same moment.
It would only be a quite coarse mapping of the input range (light intensities) to the output range (numbers).

Bit depth and dynamic range are in no way related.
But, of course,  you need enough bit depth to have a fine enough mapping for your purpose and to avoid banding.
Title: Re: Real World Dynamic Range
Post by: sojournerphoto on September 30, 2010, 07:17:14 am
"Honestly - I don't understand at all, why bit level and DR should in any way be related.
It simply doesn't make any sense.

You can have 4 bits bit depth and 16 stops dynamic range in the same moment.
It would only be a quite coarse mapping of the input range (light intensities) to the output range (numbers).

Bit depth and dynamic range are in no way related.
But, of course,  you need enough bit depth to have a fine enough mapping for your purpose and to avoid banding."


This is a mistake that has been trumpeted around the forums for too long and by too many people who ought to know better - not referring to Christoph.

Sensors count photons and the output voltage from the sensel is proportional to the number of photons detected - a linear relationship. The voltage is converted into a binary number by the analogue digital converter. This is set to (theoretically - some aren't at some isos) reach it's maximum count at base iso when the sensel has a voltage equivalent to the most photons it can count. The number of bits then determines the number of lower voltages it can count and so each extra bit doubles the number of possible counts (it's binary) and halves the minimum voltage that can be measured - again it's a linear measure. Half the voltage is half the photons is an extra stop of dynamic range.

In practice, noise gets in the way so the camera can't resolve the lowest voltages cleanly and at high isos the count would be more than one per photon, so the full adc based dynamic range is not available.

Mike
Title: Re: Real World Dynamic Range
Post by: Nick Rains on September 30, 2010, 07:28:42 am
Thanks Mike, that makes sense - I was about to agree with Christopher but this clears it up. You are saying that, in the absence of noise, a 16 bit sensor can always record 16 stops (doublings) of light intensities - by definition. The usable DR is then limited by signal noise levels.

Does this sound about right?
Title: Re: Real World Dynamic Range
Post by: Christoph C. Feldhaim on September 30, 2010, 07:50:01 am
Hmm .. I am not sure if I can yet agree, though I'm no tech expert.

If you add 1 bit to an existing sampling scheme the amount of possible discreet values is doubled.

You would use this to make the steps that can be sampled smaller and thus add an additional f-stop at the lower end of exposure, where only few photons are recorded.
The full-well capacity of the sensor would not be changed.

I'd agree, if you were to change the bit depth in a non noise-limited sensor, a perfect sensor.
But since most sensors have a noise to signal ratio which doesn't allow to fully use more of these photons at the lower end, adding a bit in an already well resolving sampling scheme would most likely just record deeper into the noise.

So - practically and if I'm not completely mistaken (which might be so and then please again correct me) in the end the noise to signal ratio determines the usable DR, and not the mathematical resolution / bit depth of the A/D converter. The banding problem of course is not touched by this.

Title: Re: Real World Dynamic Range
Post by: mrenters on September 30, 2010, 08:04:14 am
I think I have a handle on this now - I was comparing my ND image to a normally exposed shot when I should have been seeing how far I could over expose it too, before full detail loss. it's nothing to do with the ND, I just didn't extend UP the range, only down.

Forgetting the ND, if I shoot my Colour Checker using a wide range of full shutter speed steps on the S2 and then look at the sequence of images I can see details in about 12 or 13 different images. That's not to say each is correct, or can even be corrected, but I see some detail, even if it's almost washed out through over exposure, or almost, but not quite, totally black.

This now agrees far better with the 12-13 stop DR quoted by many, esp the manufacturers.

I did a similar experiment to yours a couple of months back, comparing a P65+ to a Canon 5DII.  I used a B+W 10 stop ND filter and photographed a Color Checker and a stepped gray chart. I then used Capture One to process both images and adjusted the Exposure and Highlight/Shadow recovery sliders to see just how much detail was recoverable. I talked to Jeff Schewe about it and he suggested trying it again with some objects that had texture.

Martin
Title: Re: Real World Dynamic Range
Post by: Graeme Nattress on September 30, 2010, 09:20:56 am
Often raw converters use a black level somewhat higher that the sensor's actual black level. This can hide noise near black, but can also drastically reduce dynamic range in a test when you're gaining up a very dark image.

Also, unless you have access to the raw data code values, it can be hard to determine if you're actually clipping or near clipping or not. The tonal development curve in some raw software will intentionally over-expose bright regions, not least to hide funky colour artifacts from differential clipping of the RGB channels.

So - your 250 on the colour picker (98%, 95% when you un-do gamma) could easily be a stop or more below clipping in the raw data.

Graeme
Title: Re: Real World Dynamic Range
Post by: NikoJorj on September 30, 2010, 09:28:32 am
I figured that if the camera has a DR of, let's say, 12 stops, then a 7 stop underexposed image should still capture plenty of tones to examine.
The results were not at all like I expected. The image was almost utterly black with the whitest patch barely registering on my Eizo monitor (it reads about 0,0,5 in PSCS5, 16bit file).
You tested the dynamic range of an entire system : camera, AND (standard) treatment, AND display.
To see what the camera alone can achieve, you'll have to equal things on the treatment and display side, ie to try to make both images look the same on the display. If you can do it, then you're within camera DR.

Forgetting the ND, if I shoot my Colour Checker using a wide range of full shutter speed steps [...] and then look at the sequence of images I can see details in about 12 or 13 different images.
That seems more correct ; try to correct each image (brighten the underexposed ones, and vice-versa) to see where there is still enough detail and tones. As said, textures can help to see when noise starts to drown image content on the underexposure side ; on the other side, try to see when false or washed colors begin to show (note that the raw converter used still plays a role : some handle noise better than others, some others handle overexposure better, etc...).
DR is the difference between these two limits.

I think that most discussions of practical DR involve shooting a RAW file where the range of the scene actually contains 9 or 10 stops of dynamic range. This could be a scene like shooting from an interior looking out a window to a sunlit area.  You set the exposure to just avoid clipping the highlights, or even slightly overexpose them but only to the point where they can be pulled back from a RAW file and still keep acceptable quality/detail. Then look down into the shadows (which will appear black) and attempt to use exposure compensation or a tone curve to bring detail up out of the darkness and see how far down you can go.
You won't get (exactly) the same results with that method, because having the highlights and shadows in the same scene means that the lens will produce some veiling glare, depending on the place and quantity of highlights (and depending of the lens and aperture used of course). This has the double consequence to raise the shadows (remember pre-exposure in the darkroom?), making them easier to record, and to flatten their contrast, making them less legible.
On one hand, it's much more of a real-world experiment, because DR always matter in a unique scene in practice, and I'd thought that with real-world lenses veiling glare can often be the limiting factor.
On the other hand, it throws many more variables in the equation and make results much less repeatable.
Title: Re: Real World Dynamic Range
Post by: bjanes on September 30, 2010, 09:46:20 am
Honestly - I don't understand at all, why bit level and DR should in any way be related.
It simply doesn't make any sense.

You can have 4 bits bit depth and 16 stops dynamic range in the same moment.
It would only be a quite coarse mapping of the input range (light intensities) to the output range (numbers).

Bit depth and dynamic range are in no way related.
But, of course,  you need enough bit depth to have a fine enough mapping for your purpose and to avoid banding.

It depends on how you use the bits. With current digital cameras the sensor is linear and linear encoding is used. The output of the sensor is proportional to the luminance in the scene. With a bit depth of 4, the minimum luminance is than be recorded is 1 and the maximum is 2^4 = 16, which gives a DR of 16:1. Expressed in f/stops the DR is Log base2 of 16 = 4 stops. Using binary recording simplifies the math.

Sensors that have a logarithmic output are widely used in telecommunications. If we assume a log base 10 is used, the minimum output from the sensor would be 1 and the maximum would still be 16. The luminance ratio for these outputs would be 10^16 : 1. You would have a very high DR but very poor gradation. Log output can be used for high DR recording (see Greg Ward (http://www.anyhere.com/gward/hdrenc/hdr_encodings.html)). Another approach is to use floating point representation, which allows the steps to be of variable size.

Title: Re: Real World Dynamic Range
Post by: Graeme Nattress on September 30, 2010, 09:50:31 am
Floating point encoding is just integer encoding with a log curve though, when it comes down to it.
Title: Re: Real World Dynamic Range
Post by: ondebanks on September 30, 2010, 12:01:22 pm
The tonal development curve in some raw software will intentionally over-expose bright regions, not least to hide funky colour artifacts from differential clipping of the RGB channels.


Graeme has mentioned an important point. To do the DR test right, one must only look at one colour (R, G, or B) within the Bayer matrix. I use dcraw and imagemagick to pull out the colour planes into FITS format, and IRAF to analyse them properly - no footling around with non-scientific formats or software.

Ray
Title: Re: Real World Dynamic Range
Post by: Graeme Nattress on September 30, 2010, 12:07:56 pm
Yes - unless you're intimately aware with the raw software and what it's doing, you have to get access to the raw data to know exactly what's going on. Even then, raw converters are generally built as tools to make images, rather than tools to take measurements. You can certainly use a raw tool to get an indication of what's going on, but it's not going to be the definitive answer.

Graeme
Title: Re: Real World Dynamic Range
Post by: sojournerphoto on September 30, 2010, 12:35:04 pm
Thanks Mike, that makes sense - I was about to agree with Christopher but this clears it up. You are saying that, in the absence of noise, a 16 bit sensor can always record 16 stops (doublings) of light intensities - by definition. The usable DR is then limited by signal noise levels.

Does this sound about right?


Yes, that's correct...

up to the point that the count is 1 count per photon detected. At higher isos (gain) the count will be more than 1 per photon so DR falls by one stop per stop increase in iso gain - for example if the well capacity is around 60,000 (very approximately 2^16=65536) electrons then a 14 bit ADC will count 1 for every 4 electrons stored at 'base iso. If the gain is turned up to increase iso by 2 stops then the count will be one for every electron stored (unity gain). If the gain is turned up further then the count will be more than 1 for each electron and so it is not possible to benefit from finer gradation. These numbers are there or thereabouts for a Canon 1Ds3 at 100 or 400iso and above.

Noise is obviously the fly inthe ointment.

Mike
Title: Re: Real World Dynamic Range
Post by: sojournerphoto on September 30, 2010, 12:37:40 pm
If you add 1 bit to an existing sampling scheme the amount of possible discreet values is doubled.

You would use this to make the steps that can be sampled smaller and thus add an additional f-stop at the lower end of exposure, where only few photons are recorded.
The full-well capacity of the sensor would not be changed.

I'd agree, if you were to change the bit depth in a non noise-limited sensor, a perfect sensor.
But since most sensors have a noise to signal ratio which doesn't allow to fully use more of these photons at the lower end, adding a bit in an already well resolving sampling scheme would most likely just record deeper into the noise.

So - practically and if I'm not completely mistaken (which might be so and then please again correct me) in the end the noise to signal ratio determines the usable DR, and not the mathematical resolution / bit depth of the A/D converter. The banding problem of course is not touched by this.




Exactly. Also, the signal itself is noisy - search for shot noise:)

Mike
Title: Re: Real World Dynamic Range
Post by: NikoJorj on September 30, 2010, 01:48:00 pm
Time to insert a link about noise, bit depth, dynamic range and S/N ratio...
http://theory.uchicago.edu/~ejm/pix/20d/tests/noise/noise-p3.html
Don't forget to read the 2 previous pages about noise.
Title: Re: Real World Dynamic Range
Post by: ErikKaffehr on September 30, 2010, 02:41:47 pm
Hi,

Yes, Emil's article is a very good read. I would just add a couple of observations.

Mark Dubovoy mentioned the term "full texture" in connection with dynamic range. It was suggested on another discussion that MTF may have to do with it. The way I see it, dynamic range on it's own is pretty useless. What we often want to see is some resolved detail. Now, if we have the same field of view, any detail will be like twice the size on MF compared to FX (full frame 135). So if we compare MTF curves we should compare MTF at 80 lp/mm for FX with MTF for 40 lp/mm on MF. There is no question that MF will be able to transfer much more contrast on tiny details than FX.

Another observation I may have is that I compared well shot raw images from the Leica S2 with equally well shot images from a Nikon D3X. The Leica images were sharper, no doubt about that, but the Nikon did in my view surpass the Leica S2 regarding DR. Check the end of this article: http://echophoto.dnsalias.net/ekr/index.php/photoarticles/38-observations-on-leica-s2-raw-images

On the other hand I also have downloaded a couple of comparison images shot by Phase One P65+ and Canon 1DsIII from Phase One website. In this case the Phase images were much cleaner at low ISO. That later test did indicate a significant advantage of the P65+ over Canon 1DsIII.

One of the issues I see is that Phase One is also developing Capture One. Capture One may utilize information not available to other software vendors like very exact calibration data embedded in the images. I don't think this is an unfair advantage for Phase users, but I could say that they are fortunate to have very good backs with very good software and access to proprietary data.

Best regards
Erik


Time to insert a link about noise, bit depth, dynamic range and S/N ratio...
http://theory.uchicago.edu/~ejm/pix/20d/tests/noise/noise-p3.html
Don't forget to read the 2 previous pages about noise.
Title: Re: Real World Dynamic Range
Post by: Doug Peterson on September 30, 2010, 03:38:39 pm
The way I see it, dynamic range on it's own is pretty useless. What we often want to see is some resolved detail.

+1

The engineering/scientific definition(s) of dynamic range are never my concern. My question is always how do the shadows/highlights LOOK, especially when pushed/pulled. Are tonal transitions smooth or choppy? If there is noise is it random and pleasing grain or it is clumpy and broken up and ugly? Are the colors accurate especially when the same subject has a shadow and highlight on it does the color remain consistent even after a push or pull into the deep shadows or hot highlights? What happens at the breaking point? Is there a hard edge where there is no more data or does it fade away gently into nothingness?

Which transitions into the second point:

One of the issues I see is that Phase One is also developing Capture One. Capture One may utilize information not available to other software vendors like very exact calibration data embedded in the images. I don't think this is an unfair advantage for Phase users, but I could say that they are fortunate to have very good backs with very good software and access to proprietary data.

That's the value of a system. The software development team and the hardware development team at the Denmark headquarters of Phase One are about 50 meters apart and not only work together but drink together, hang out together, and share the same passion for making the best possible product. They've also been working on eeking the most out of the system of hardware/firmware/software since 1997. In that regard I'm always surprised when people ignore the value of having a dedicated raw developer. These guys obsess about how they can make the SYSTEM perform best in photographic terms.

Doug Peterson (e-mail Me) ("[email protected]")
__________________
Head of Technical Services, Capture Integration
Phase One, Leaf, Cambo, Canon, Apple, Profoto, Eizo & More
National: 877.217.9870  |  Cell: 740.707.2183
Newsletter: Read Latest or Sign Up (http://"http://www.captureintegration.com/our-company/newsletters/")
RSS Feed: Subscribe (http://"http://www.captureintegration.com/2008/08/11/rss-feeds/")
Buy Capture One at 10% off (http://"http://www.captureintegration.com/phase-one/buy-capture-one/")
Personal Work (http://"http://www.doug-peterson.com/")
Title: Re: Real World Dynamic Range
Post by: Nick Rains on September 30, 2010, 07:06:13 pm
Erik

I have done the S2 vs D3X test myself and almost agree with your findings. I found the D3X had subtly better DR but the deepest shadows had a lack of texture that I put down to some NR going on in the camera - on the NEF. I coud be wrong, but I do see a slight smudgy plastic look in the deep tones that looks very much like NR. The S2 is also slightly cleaner when you really push the tones around.

One a pixel level I'd call it a draw, both have 6um pixel pitch and appear to resolve the same details over the same sensor area. The S2 only leads when you take into account the extra sensor area.

The D3X is a truly amazing camera and those new Nikon lenses are sweet.

I fully agree about the P65+ vs 1Ds MkIII, I'm a Canon user too, and the current top of the line sensor is no match for the D3X or any of the MFDBs. I've not tried the P65+, but I have used the P45+ and that it still quite amazing.

I tried to massively pull out the shadows in my 9 stop 'real world' test yesterday from my 5D2 and there was a world of difference from the S2.

I also agree that DR as it stands is not useful unless there is also contrast between recorded details - that what makes top prints stand out, smooth tones and fine detail all the way from max black to max highlights.
Title: Re: Real World Dynamic Range
Post by: ErikKaffehr on October 01, 2010, 12:53:16 am
Hi,

A couple of issues. A sensel (sensor cell) can hold a certain number of electrons, with each electron representing a captured photon (by and large). A sensel may hold something like 50000 electrons. The electrons will be interpreted as a voltage by the ADC (Analog Digital Converter). Assuming that we would have a Full Well Capacity of 50000 electrons a 16 bit ADC would be able to resolve all possible combinations of electrons, while a 12 bit converter would only be able to resolve 4096 different combinations.

Now, in real life we have noise. That noise is coming from the readout circuitry but also from the distribution of the photons themselves. If we have like 10 electrons of readout noise the number of meaningful combinations of electrons will be around 5000, which is quite close to 12 bits (4096 values).

Aside from that we also have what is known as shot noise, random variations in the number of incident photons. The photons are Poisson distributed which leads to the noise being the square root of the signal. So with 100 photons captured the signal would vary between 90 and 110 electrons.

The final factor is exposure. The full well capacity is only utilized fully if we expose correctly to the right and we don't know if we ever achieve this. The histogram on the camera is only an estimate of what the sensor sees.

To sum it up, 16 bit capture is enough to detect each electron in the sensel of todays sensors, but the last 3-4 bits will essentially just measure noise. Whatever the electronics, some noise will always remain as it is also a characteristic of the discrete nature of light.

Best regards
Erik


Thanks Mike, that makes sense - I was about to agree with Christopher but this clears it up. You are saying that, in the absence of noise, a 16 bit sensor can always record 16 stops (doublings) of light intensities - by definition. The usable DR is then limited by signal noise levels.

Does this sound about right?
Title: Re: Real World Dynamic Range
Post by: ondebanks on October 08, 2010, 05:27:34 am
I found the D3X had subtly better DR but the deepest shadows had a lack of texture that I put down to some NR going on in the camera - on the NEF. I coud be wrong, but I do see a slight smudgy plastic look in the deep tones that looks very much like NR.

Interesting! But that wouldn't surprise me. Nikon already "have form" (m'lud) for screwing around with (filtering) their RAW files in long exposures. NEF most definitely is not a true, straight-off-the-sensor RAW format. Perhaps now they're extending the crime to filtering deep tones in short exposures as well.  >:(
DxOlabs showed conclusively that Sony are also guilty of RAW filtering - at high ISO:
http://dxomark.com/index.php/en/Our-publications/DxOMark-Insights/Half-cooked-RAW/Noise-reduction

Why call it RAW when it isn't? I think the Advertising Standards Authority should prosecute Nikon and Sony for misleading portrayal of their products!

I fully agree about the P65+ vs 1Ds MkIII, I'm a Canon user too, and the current top of the line sensor is no match for the D3X or any of the MFDBs.

Except for long exposures and high ISO, where you would have to drop "or any of the MFDBs" from that sentence. :D

Ray
Title: Re: Real World Dynamic Range
Post by: dudu307 on October 08, 2010, 11:29:12 am
Interesting! But that wouldn't surprise me. Nikon already "have form" (m'lud) for screwing around with (filtering) their RAW files in long exposures. NEF most definitely is not a true, straight-off-the-sensor RAW format. Perhaps now they're extending the crime to filtering deep tones in short exposures as well.  >:(
DxOlabs showed conclusively that Sony are also guilty of RAW filtering - at high ISO:
http://dxomark.com/index.php/en/Our-publications/DxOMark-Insights/Half-cooked-RAW/Noise-reduction

Why call it RAW when it isn't? I think the Advertising Standards Authority should prosecute Nikon and Sony for misleading portrayal of their products!

Except for long exposures and high ISO, where you would have to drop "or any of the MFDBs" from that sentence. :D

Ray


I don't get your point.

First, DXO didn't find filtering in D3x. Second, what's the big deal in offering a true RAW but then force you to use proprietary software that use proprietary calibration files to hide the problems of your sensor.

If you use a more "straight" raw developer (like Raw Photo Processor) D3x files always look great, medium format files sometimes look amazing, sometimes look like crap..... but yes you don't have the great Capture one to hide all the problems....

At the end of the day, I want the best possible raw file, and use my raw converter of choice. I don't want hidden CCD problems, hidden calibration files and hidden fixes in software.
Title: Re: Real World Dynamic Range
Post by: madmanchan on October 08, 2010, 11:54:32 am
It depends on the camera model. Some cameras will apply calibration data and do other processing in the camera, prior to writing out the raw file. Other cameras will leave it to software (i.e., desktop raw conversion software, not in the camera) to apply the calibration data later. So maybe you can think of "raw" terminology in terms of "raw", "rare", "medium rare", etc.    :)
Title: Re: Real World Dynamic Range
Post by: Doug Peterson on October 08, 2010, 01:50:30 pm
First, DXO didn't find filtering in D3x. Second, what's the big deal in offering a true RAW but then force you to use proprietary software that use proprietary calibration files to hide the problems of your sensor.

If you use a more "straight" raw developer (like Raw Photo Processor) D3x files always look great, medium format files sometimes look amazing, sometimes look like crap..... but yes you don't have the great Capture one to hide all the problems....

At the end of the day, I want the best possible raw file, and use my raw converter of choice. I don't want hidden CCD problems, hidden calibration files and hidden fixes in software.

Incorporating the raw processor into the image quality chain means that as math improves you can reprocess any given raw file and get better quality. An H25 (2003 vintage) looked great when it came out, but looks even better now when processed through Capture One 5. Color, noise, dynamic range, tonal smoothness, lens corrections (chromatic aberration, distortion removal) have all improved considerably in that time. The more a company decides to bake the raw file in-the-camera rather than in the software the more you lose that very important advantage. For day to day work it's probably not important, but for the best 20 shots you ever take in your life I would MUCH rather have a completely and utterly naked raw file with any corrective algorithms placed in the software. Just my opinion of course.

But other than wide-angle technical cameras (where LCC is needed) you are not "forced" into using Capture One with a Phase One / Leaf / Mamiya back. The files are supported in ACR (Lightroom/Photoshop), and Irident Raw Developer (great app if you've never used it), and many in Apple Aperture and others, and if you insist on going for compatibility over quality you can also export to DNG and use them with just about anything. It's just that most of our users of high-end digital backs don't want to buy an expensive camera and then use a raw processor that gives them 2nd-best results.

By the way - have you processed a difficult (long exposure, high ISO, mixed lighting, underexposed, etc) Nikon D3X through both LightRoom and Capture One 5.2? You might change your mind about the whole issue :-).



Doug Peterson (e-mail Me) ("[email protected]")
__________________
Head of Technical Services, Capture Integration
Phase One, Leaf, Cambo, Canon, Apple, Profoto, Eizo & More
National: 877.217.9870  |  Cell: 740.707.2183
Newsletter: Read Latest or Sign Up (http://"http://www.captureintegration.com/our-company/newsletters/")
RSS Feed: Subscribe (http://"http://www.captureintegration.com/2008/08/11/rss-feeds/")
Buy Capture One at 10% off (http://"http://www.captureintegration.com/phase-one/buy-capture-one/")
Personal Work (http://"http://www.doug-peterson.com/")