Luminous Landscape Forum

Equipment & Techniques => Digital Cameras & Shooting Techniques => Topic started by: cwood on August 09, 2011, 10:19:05 am

Title: Exposing To The Right
Post by: cwood on August 09, 2011, 10:19:05 am
I've read and understand Michael's argument for exposing to the right. I can't disagree in general but there are some counterarguments including the matter of color shift that can occur when overexposing. I certainly noticed some of that when I owned a 5D2 and I attempted to push exposure a half or full EV. 

There are also some sensors available, including the new 16 meg manufactured by SONY, used in various SONY, Nikon and Pentax models, that are extremely clean in shadow and dark areas, that invite the opposite. Based on my experience with a Pentax K-5 at ISO 80, I can underexpose a full stop and using LR, can bring up fill light, adjust levels, brightness and contrast, and wind up with a far more pleasing image than going the other direction by overexposing.  Although I can't push the underexposure quite as far, I've found I can go - half an EV with my 645D and get a better result than by overexposing a half EV.

I would be interested in learning what others here have found in this regard.
Title: Re: Exposing To The Right
Post by: Scott O. on August 09, 2011, 02:58:10 pm
I always expose to the right and have not noticed any image/color degredation doing this, using Lightroom.  Normally, a little bump of the blacks causes the colors to 'pop'.
Title: Re: Exposing To The Right
Post by: Guillermo Luijk on August 09, 2011, 04:43:32 pm
there are some counterarguments including the matter of color shift that can occur when overexposing. I certainly noticed some of that when I owned a 5D2 and I attempted to push exposure a half or full EV

(http://images.t-nation.com/forum_images/3/6/362c3-44789.this_thread_completely_useless_WITHOUT_IMAGES_1_.jpg)
Title: Re: Exposing To The Right
Post by: Wayne Fox on August 10, 2011, 08:55:27 pm
I've read and understand Michael's argument for exposing to the right. I can't disagree in general but there are some counterarguments including the matter of color shift that can occur when overexposing. I certainly noticed some of that when I owned a 5D2 and I attempted to push exposure a half or full EV. 


By over exposing I assume you mean exposing more than your camera suggests, which is providing you information as though film were in the camera?

EttR is not overexposing.  It is using a different method to determine exposure and then a different method to develop the image.  I have seen no color shift that is do due increasing exposure except in cases where one or more channels were clipped.  I've seen this mentioned a few times, so I assume someone out there is making this claim, but as was pointed out, I haven't seen any actual examples of this happening.

Certainly if there were color shifts, it would most likely something in post processing, not from using EttR to base the exposure on.
Title: Re: Exposing To The Right
Post by: Martin Kristiansen on August 11, 2011, 01:10:43 am
I have not noticed a colour shift on my camera (Aptus 12). What I do notice is much better colour in the shadows. The less noise is a no brainer but the improvements in colour are a great bonus. In the past I was always bothered by the way digital seemed to get monochromatic in the shadows.
Title: Re: Exposing To The Right
Post by: stamper on August 11, 2011, 04:17:25 am
If someone is using ACR then they should ZERO out all of the sliders before making a judgement on the colour shifts. Even having a WB setting Daylight can influence colour. Changing as shot to daylight can produce a clipping warning. I have used Auto WB in my Nikon d700 camera which came up as as shot in ACR and when I changed it to WB daylight a highlight red warning appeared in ACR. A lot is happening in the background after importation to ACR, or Lightroom for that matter.
Title: Re: Exposing To The Right
Post by: NigelC on August 11, 2011, 07:30:09 am
Generally use ETTR in the same way I used to use the zone system, as a guide rather than religious observance, but one problem is I don't entirely trust the accuracy of the histogram on DSLRs. I understand that it's based on the embedded jpeg and I can never be sure if I've clipped the highlights or not.
Title: Re: Exposing To The Right
Post by: theguywitha645d on August 11, 2011, 11:37:11 am
ETTR increases contrast and saturation.
Title: Re: Exposing To The Right
Post by: stamper on August 11, 2011, 11:41:51 am
The lighter an image gets then the opposite - imo - happens. Whether it changes hue is open for debate?
Title: Re: Exposing To The Right
Post by: Guillermo Luijk on August 11, 2011, 12:30:52 pm
ETTR increases contrast and saturation.

Wrong. ETTR just modifies visible noise. Any other image parameter remains unaltered thanks to sensor linearity.

(http://www.guillermoluijk.com/article/ettr3/ruido.jpg)

(http://www.guillermoluijk.com/article/ettr3/ruido2.jpg)
Title: Re: Exposing To The Right
Post by: jeremypayne on August 11, 2011, 01:53:58 pm
I certainly noticed some of that when I owned a 5D2 and I attempted to push exposure a half or full EV. 

Color shifts when you alter exposure by 1/2 stop?  I would very much like to see an example of this.
Title: Re: Exposing To The Right
Post by: digitaldog on August 11, 2011, 02:14:30 pm
Color shifts when you alter exposure by 1/2 stop?  I would very much like to see an example of this.

I seen none in Guillermo‘s examples. And even if there were, seems easy to adjust.

Title: Re: Exposing To The Right
Post by: PeterAit on August 11, 2011, 08:22:20 pm
I think that ETTR is one of those techniques that has a valid theoretical basis but no benefit in the real world. This of course excludes pixel-peeping!
Title: Re: Exposing To The Right
Post by: digitaldog on August 11, 2011, 08:24:25 pm
I think that ETTR is one of those techniques that has a valid theoretical basis but no benefit in the real world. This of course excludes pixel-peeping!

The same thing could be said for incorrectly exposing film, running a snip test then fixing the issue by push processing.
Title: Re: Exposing To The Right
Post by: Schewe on August 11, 2011, 10:02:00 pm
I think that ETTR is one of those techniques that has a valid theoretical basis but no benefit in the real world. This of course excludes pixel-peeping!

Hum...ok.

I guess there's a range of opinions about the importance of image quality. Personally, I leave no stone unturned. If there's something I can do that's not really difficult (and ETTR is pretty easy) I'm happy to do it to get a better quality image.

It's a shame to leave image quality on the table when just a little bit of effort can improve it...so, do you use 8-bit, sRGB as a PS working space?

Just trying to gauge your level of, uh, commitment :~)
Title: Re: Exposing To The Right
Post by: Wayne Fox on August 12, 2011, 02:03:20 am
I think that ETTR is one of those techniques that has a valid theoretical basis but no benefit in the real world. This of course excludes pixel-peeping!
Curious what you are basing that on.  Did you actually try it? Because if you do and do it right, you will see a clear difference with cleaner shadows and better detail in your shadows in prints, especially larger ones where noise becomes much more obvious.

Certainly this only applies some of the time in the right circumstances and probably doesn't help much if you only print 4x6's and put 500px images on the web, but using it really isn't difficult or challenging. 
Title: Re: Exposing To The Right
Post by: Eric Myrvaagnes on August 12, 2011, 09:37:02 am
I think that ETTR is one of those techniques that has a valid theoretical basis but no benefit in the real world. This of course excludes pixel-peeping!
Back in the Dark Ages (i.e., Before Digital) I recall that many photographers said similar things about the Zone System, mainly because you had to do a little work testing your equipment and materials in order to be able to use it effectively. IMHO, the same applies to ETTR.

Eric M.
Title: Re: Exposing To The Right
Post by: Wayne Fox on August 13, 2011, 02:26:52 am
Thought I would add one personal IMHO that I haven't noticed in any of the EttR discussions so far.

In my mind EttR isn't just about moving the data to the right to reduce noise and increase quality.  Personally I think it's the correct way to determine almost all exposures regardless of the contrast range of the scene vs. the dynamic range of the sensor.

Certainly if the scenes contrast range is less the the sensors DR, you maximize the benefits of EttR.

However, if you base your exposure on the highlights just short of clipping, you get the maximum information in your shadows, even if they clip.  Often by opening up the exposure a little, you get enough shadow information to not require HDR, especially with some of today current cameras (with my IQ180, I really haven't found a time where I had to use HDR).  If you let the camera choose a setting that will render a pleasing Jpeg (the goal of the camera makers) you in may block up your shadows too far.

Exposures based on the highlight clipping point is just the logical way of determine a digital exposure because the goal in digital capture is maximizing the data, not creating a pleasing on camera image.
Title: Re: Exposing To The Right
Post by: ErikKaffehr on August 13, 2011, 02:50:06 am
Hi,

Absolutely agree with Wayne.

There are three additional points in the discussion.

1) Never clip important highlights in any channel!

2) The histogram is conservative, as it is not calculated from raw data. So it's possible to push exposure a bit longer, but we don't actually now how far.

3) At least on some sensors, nonlinearity close to saturation may cause color shift according to some very knowledgeable people.

The final question may be how white balance messes up the exposure of each channel?

Best regards
Erik
Thought I would add one personal IMHO that I haven't noticed in any of the EttR discussions so far.

In my mind EttR isn't just about moving the data to the right to reduce noise and increase quality.  Personally I think it's the correct way to determine almost all exposures regardless of the contrast range of the scene vs. the dynamic range of the sensor.

Certainly if the scenes contrast range is less the the sensors DR, you maximize the benefits of EttR.

However, if you base your exposure on the highlights just short of clipping, you get the maximum information in your shadows, even if they clip.  Often by opening up the exposure a little, you get enough shadow information to not require HDR, especially with some of today current cameras (with my IQ180, I really haven't found a time where I had to use HDR).  If you let the camera choose a setting that will render a pleasing Jpeg (the goal of the camera makers) you in may block up your shadows too far.

Exposures based on the highlight clipping point is just the logical way of determine a digital exposure because the goal in digital capture is maximizing the data, not creating a pleasing on camera image.

Title: Re: Exposing To The Right
Post by: Guillermo Luijk on August 13, 2011, 06:05:23 am
if you base your exposure on the highlights just short of clipping, you get the maximum information in your shadows, even if they clip.  Often by opening up the exposure a little, you get enough shadow information to not require HDR, especially with some of today current cameras (with my IQ180, I really haven't found a time where I had to use HDR).  If you let the camera choose a setting that will render a pleasing Jpeg (the goal of the camera makers) you in may block up your shadows too far.

Exposures based on the highlight clipping point is just the logical way of determine a digital exposure because the goal in digital capture is maximizing the data, not creating a pleasing on camera image.

What you are saying here is correct, but I wouldn't use the terms 'clip' or 'block' for the shadows. If the dynamic range of the scene is not a problem (i.e. camera's DR is greater than the scene's), optimal digital exposure is the consequence of the following asymmetry in digital sensors:
- Highlights information is boolean: if they clip you loose everything, if they don't clip you have everything, and you have it with maximum quality
- Shadows information is progressive: they don't clip, they just have a higher or lower SNR (i.e. visible noise once processed)

So the logical reference for digital exposure should be the highlights.


3) At least on some sensors, nonlinearity close to saturation may cause color shift according to some very knowledgeable people.

The final question may be how white balance messes up the exposure of each channel?

I'm still looking for a demonstration of that colour shift.

I reverse engineered a white balance setting in ACR, and although its implementation can be somewhat more sophisticated (matrix operations are involved), it is basically an individual exposure correction for each channel prior to the demosaicing process:

(http://www.guillermoluijk.com/article/acrps/wb_luz_dia_tungsteno_acr.gif)
ACR Daylight to Tungsten WB comparision

Regards
Title: Re: Exposing To The Right
Post by: sandymc on August 13, 2011, 04:58:50 pm
I'm still looking for a demonstration of that colour shift.

Guillermo,

It's just the "usual" Adobe profile-with-hue-twists problem.

Regards,

Sandy
Title: Re: Exposing To The Right
Post by: ejmartin on August 13, 2011, 08:03:29 pm
Some relevant info in a related thread:

http://www.luminous-landscape.com/forum/index.php?topic=56906.msg460680#msg460680

I see two issues:
(1) Does ETTR make any difference in the quality of the raw data; 
(2) if one practices ETTR (or ETTL on cameras such as the D7000, K5, or any CCD sensor'd camera), does your raw converter of choice handle the data properly.

The answer to (1) depends on the camera, as discussed in detail in the post linked above.  As for (2), I think many raw converters don't do a good job of exposure correction; Adobe has the issues with hue twist mentioned by Sandy, and Guillermo has suggested in a parallel thread (http://www.luminous-landscape.com/forum/index.php?topic=56951.0) that DPP doesn't have a true exposure control.  Converters that definitely treat exposure compensation correctly are RPP and RawTherapee.
Title: Re: Exposing To The Right
Post by: bjanes on August 13, 2011, 09:17:23 pm
Some relevant info in a related thread:

http://www.luminous-landscape.com/forum/index.php?topic=56906.msg460680#msg460680

I see two issues:
(1) Does ETTR make any difference in the quality of the raw data; 
(2) if one practices ETTR (or ETTL on cameras such as the D7000, K5, or any CCD sensor'd camera), does your raw converter of choice handle the data properly.

The answer to (1) depends on the camera, as discussed in detail in the post linked above.  As for (2), I think many raw converters don't do a good job of exposure correction; Adobe has the issues with hue twist mentioned by Sandy, and Guillermo has suggested in a parallel thread (http://www.luminous-landscape.com/forum/index.php?topic=56951.0) that DPP doesn't have a true exposure control.  Converters that definitely treat exposure compensation correctly are RPP and RawTherapee.

Hue twists are frequently attributed to ACR, but Eric Chan (http://www.luminous-landscape.com/forum/index.php?topic=56309.msg458159#msg458159) has stated in another thread that if one uses ETTR and normalization of the image is necessary, one should use the exposure slider first to get the tonal values in the proper range before the 3D color table is applied.

Regards,

Bill
Title: Re: Exposing To The Right
Post by: schitti on August 15, 2011, 05:20:56 am
Digitizing week signals is a well known problem in scientific instrumentation including increasing the signal to noise ratio by averaging of repeated signals.

I have worked all me live in the field of Nuclear Magnetic Resonance and optimizing gain for the actual digitizer was automated thirty years ago. Increase the gain as much as possible but do not saturate ( clip ) the digitizer ( and the complete receiving system ). Exactly the same is true for digital cameras.

 Yes, we had laboratory computers to solve this task at that time and I fully agree this feature could be well integrated in modern Cameras.

Werner Schittenhelm
Title: Re: Exposing To The Right
Post by: Wayne Fox on August 16, 2011, 02:09:01 am
Hue twists are frequently attributed to ACR, but Eric Chan (http://www.luminous-landscape.com/forum/index.php?topic=56309.msg458159#msg458159) has stated in another thread that if one uses ETTR and normalization of the image is necessary, one should use the exposure slider first to get the tonal values in the proper range before the 3D color table is applied.

Regards,

Bill
I know this is the "proper" way to do it, but since the exposure slider isn't a true full linear control, I've gotten better results by setting my black point with the black slider first, then setting my white/highlight point with the exposure slider, and finally tweaking the image brightness with the brightness slider.  If I go in that order I almost always get a very pleasing starting point that requires very little tweaking with the recovery and fill light sliders. Sometimes when I set my exposure slider first I have trouble getting my shadows to look right, and my highlights don't look as good after setting the black slider.

Am I crazy?
Title: Re: Exposing To The Right
Post by: sandymc on August 16, 2011, 07:02:25 am
Hue twists are frequently attributed to ACR, but Eric Chan (http://www.luminous-landscape.com/forum/index.php?topic=56309.msg458159#msg458159) has stated in another thread that if one uses ETTR and normalization of the image is necessary, one should use the exposure slider first to get the tonal values in the proper range before the 3D color table is applied.

I don't often disagree with Eric, but that's simply not the case. Adobe color profiles have two color tables, not one - a "LookTable" and a "HueSatDelta" table. One is applied after exposure correction, and the other before. Eric's advice is good in the sense that the process he recommends minimizes the amount of hue change that will occur, and if all the hue twists are in the LookTable there will be no hue changes. But if the profile has a HueSatDelta with hue twists in it, you will still get hue changes.

Sandy
Title: Re: Exposing To The Right
Post by: RFPhotography on August 16, 2011, 09:03:27 am

2) The histogram is conservative, as it is not calculated from raw data. So it's possible to push exposure a bit longer, but we don't actually now how far.

If you do testing with your camera, you can get a very good sense of how far you can push the exposure without clipping any channels.

Title: Re: Exposing To The Right
Post by: ErikKaffehr on August 16, 2011, 03:14:58 pm
Crazy? Not..

But... adjusting the image is an iterative process. The important thing is that "overexposure/ETTR" should be compensated with the exposure slider. Highlight recovery will induce artifacts.

For me, the exposure slide first approach is working well. As a side note, when doing panos I normally "maximize the image" essentially setting black level to zero and even add some fill light. "Normalization" I often do on the merged pano.

As pointed out many times, the order the adjustments are done is not relevant for processing, but has a significant effect on the way you work with the images.

Best regards
Erik

I know this is the "proper" way to do it, but since the exposure slider isn't a true full linear control, I've gotten better results by setting my black point with the black slider first, then setting my white/highlight point with the exposure slider, and finally tweaking the image brightness with the brightness slider.  If I go in that order I almost always get a very pleasing starting point that requires very little tweaking with the recovery and fill light sliders. Sometimes when I set my exposure slider first I have trouble getting my shadows to look right, and my highlights don't look as good after setting the black slider.

Am I crazy?
Title: Re: Exposing To The Right
Post by: madmanchan on August 16, 2011, 10:03:02 pm
No, the Exposure stage in ACR/LR happens before the 3D LookTable, not after.  Same with Blacks.  So if you use these to adjust the image (to compensate for ETTR) you should get the same result.  For example, compare two cases.  For Case A, I take an image at a given exposure. For Case B, I take the same image, but 1 stop underexposed (e.g., halve the shutter time), then set Exposure to +1 in ACR to make up for it.  Aside from shadow clipping due to the default Blacks = 5, the tones and colors in the results should be the same in both cases, even if using a lightness-dependent profile, e.g., Adobe Standard or one of the Camera Matching profiles.

I am also puzzled by the discussions of the non-linearity of ACR's Exposure.  ACR's Exposure in the positive direction is simply a straight multiply with a hard clip, just like digital camera exposure.  In the minus direction, the only difference is that ACR tries to keep clipped whites white (i.e., we did not feel it was photographically useful to let speculars turn into gray blobs, though we still let users accomplish that with the point curve).  Remember, when reducing (software) Exposure, there's nothing "above" the sensor saturation point (very unlike at capture time, where reducing the capture exposure can indeed record additional information), so there is a question of how to treat the whites.
Title: Re: Exposing To The Right
Post by: sandymc on August 17, 2011, 02:22:47 am
No, the Exposure stage in ACR/LR happens before the 3D LookTable, not after.  Same with Blacks.  So if you use these to adjust the image (to compensate for ETTR) you should get the same result.  For example, compare two cases.  For Case A, I take an image at a given exposure. For Case B, I take the same image, but 1 stop underexposed (e.g., halve the shutter time), then set Exposure to +1 in ACR to make up for it.  Aside from shadow clipping due to the default Blacks = 5, the tones and colors in the results should be the same in both cases, even if using a lightness-dependent profile, e.g., Adobe Standard or one of the Camera Matching profiles.

Yes, but there's still the other table (technically, the interpolated combination of ProfileHueSatMapData1 and ProfileHueSatMapData2). That's done before exposure compensation. Or otherwise someone should rewrite the profile spec real quick. And the way ACR and LR work ;D

Or are you saying that for all current Adobe profiles, hue twists are only ever in the LookTable, not the HueSatMap tables?

Regards,

Sandy
Title: Re: Exposing To The Right
Post by: madmanchan on August 17, 2011, 09:44:06 am
Hi Sandy,

You are correct in that the HueSatMap1 and HueSatMap2 tables precede the Exposure & Blacks controls.  However, all Adobe-provided profiles (e.g., Adobe Standard, Camera Standard, Camera Faithful, etc.) only ever put 3D tables (i.e., lightness-dependent) into the LookTable tag. 

We actually discourage (but do not prevent) the use of 3D tables in the HueSatMap* tags for the reasons you mention.  The preferred use of the HueSatMap* tags is a 2.5D table, indexed by hue & sat only, to perform non-linear color corrections.  This can be important with cameras with suboptimal spectral sensitivities or when photographing under difficult illuminants.  Lightness-dependent corrections are not necessary because the input data is in a linear, scene-referred space.  The Chart Wizard feature of the DNG Profile Editor writes into the HueSatMap* tags and writes only 2.5D tables.

Eric
Title: Re: Exposing To The Right
Post by: digitaldog on August 17, 2011, 10:29:24 am
We actually discourage (but do not prevent) the use of 3D tables in the HueSatMap* tags for the reasons you mention.  The preferred use of the HueSatMap* tags is a 2.5D table, indexed by hue & sat only, to perform non-linear color corrections. 

Any comments on what the X-rite DNG generated profiles are doing?
Title: Re: Exposing To The Right
Post by: Peter_DL on August 17, 2011, 12:24:27 pm
I am also puzzled by the discussions of the non-linearity of ACR's Exposure.  ACR's Exposure in the positive direction is simply a straight multiply with a hard clip, just like digital camera exposure.  In the minus direction, the only difference is that ACR tries to keep clipped whites white (i.e., we did not feel it was photographically useful to let speculars turn into gray blobs, though we still let users accomplish that with the point curve)...

So in the minus direction it is really a jump function ?

Clipped white is fixed at RGB 255 while a multiplier < 1 is applied all other values, without any smoothing ?

Hmm

Peter

--
Title: Re: Exposing To The Right
Post by: Guillermo Luijk on August 17, 2011, 12:53:45 pm
I am also puzzled by the discussions of the non-linearity of ACR's Exposure.  ACR's Exposure in the positive direction is simply a straight multiply with a hard clip, just like digital camera exposure.

That is why I don't understand why it appears to be a non-linearity near zero. These are the curves that model a change in Exposure into ACR with respect to the 0.0 setting (I already showed them to you in Dpreview). I just compared (input, output) pairs, I didn't any gamma calculation. And the ouput profile used was Adobe RGB, which is supposed to be a standard gamma profile (strictly applying f^(1/g) along the whole range).

So, what are those non-linearities near 0?

(http://www.guillermoluijk.com/article/acrps/exposicion_acr.gif)

It appears to me that ACR is using a non-standard gamma 2.2 for Adobe RGB, something like sRGB's gamma.

Regards
Title: Re: Exposing To The Right
Post by: Nick Walker on August 17, 2011, 01:27:51 pm
Information for the histogram and RGB readout, Lightroom uses tonal response curve similar to sRGB.
Title: Re: Exposing To The Right
Post by: bjanes on August 17, 2011, 02:31:45 pm
That is why I don't understand why it appears to be a non-linearity near zero. These are the curves that model a change in Exposure into ACR with respect to the 0.0 setting (I already showed them to you in Dpreview). I just compared (input, output) pairs, I didn't any gamma calculation. And the ouput profile used was Adobe RGB, which is supposed to be a standard gamma profile (strictly applying f^(1/g) along the whole range).

So, what are those non-linearities near 0?

(http://www.guillermoluijk.com/article/acrps/exposicion_acr.gif)

It appears to me that ACR is using a non-standard gamma 2.2 for Adobe RGB, something like sRGB's gamma.

Regards


Guillermo,

Adobe RGB has no linear segment near luminances of zero, but the spec allows a slope limit of 1/32 for 8 bit digital images in the range of 1-14. See Annex C of the Adobe RGB spec (http://www.adobe.com/digitalimag/pdfs/AdobeRGB1998.pdf). Eric Chan has confirmed that this linear segment is used in all Adobe applications.

Regards,

Bill
Title: Re: Exposing To The Right
Post by: Guillermo Luijk on August 17, 2011, 03:46:13 pm
Adobe RGB has no linear segment near luminances of zero, but the spec allows a slope limit of 1/32 for 8 bit digital images in the range of 1-14. See Annex C of the Adobe RGB spec (http://www.adobe.com/digitalimag/pdfs/AdobeRGB1998.pdf). Eric Chan has confirmed that this linear segment is used in all Adobe applications.

Thanks Bill. That must be the reason for the non-linearity in the calculated curves (which of course doesn't mean any non-linearity in the way Exposure works in ACR).

So if the gamma slope in Adobe RGB's implementation is limited (i.e. Adobe RGB's gamma lifts the shadows less than a pure gamma), and we open an image encoded with a pure 2.2 gamma assigning it to Adobe RGB, we will be seeing the deep shadows a bit brighter than expected. My concern about this is because I use pure 2.2 gamma images and then assign them in Adobe RGB, but I find OK to have some shadow lifting.

Regards
Title: Re: Exposing To The Right
Post by: sandymc on August 18, 2011, 02:38:37 am
We actually discourage (but do not prevent) the use of 3D tables in the HueSatMap* tags for the reasons you mention.  The preferred use of the HueSatMap* tags is a 2.5D table, indexed by hue & sat only, to perform non-linear color corrections.  This can be important with cameras with suboptimal spectral sensitivities or when photographing under difficult illuminants.  Lightness-dependent corrections are not necessary because the input data is in a linear, scene-referred space.  The Chart Wizard feature of the DNG Profile Editor writes into the HueSatMap* tags and writes only 2.5D tables.

Eric,

Interesting. When I did testing on ETTR about two years ago, using the LR 2.4 (which was current then), there were consistent hue shifts creeping in from somewhere, just by adjusting exposure, significantly more so with LR than with e.g., Capture 1. Mostly in blue. I assumed at the time that it was a combination of profile and tone curve. And no, no channels were saturating. So, if the profile wasn't guilty, the question becomes what was ???

Regards,

Sandy
Title: Re: Exposing To The Right
Post by: sandymc on August 18, 2011, 09:11:32 am
Eric,

Ok, so I can't resist a good (technical) puzzle, so I wasted a few hours trying to track this down. What I did was to create two synthetic DNG images of a GM 24 chart, using an M9 file as template, one at nominal exposure, the other at -2EV, and looked at them in LR 3.4.1

The results were strange:

This is the same for Adobe Standard and the embedded profile - a hue change in the blue channel, which also is the same as I got two years ago with real images from a Canon. It's a small change, hardly visible, but it is there.

Given the exact match when the exposure controls are at zero, I don't think that this can be an issue with the test images, or saturation in any channel. So I can only conclude that LR does have some kind of a hue shift when its exposure controls interact...... :o

Happy to send you the test images if you want.

Regards,

Sandy

Title: Re: Exposing To The Right
Post by: ejmartin on August 18, 2011, 11:00:08 am
Tone controls such as black point (especially), brightness, and contrast work on individual RGB channels so will cause hue shifts.  I would only expect the exposure slider to behave as a true gain in the resulting output with black point set to zero, brightness and contrast neutral, and the tone curve set to linear.
Title: Re: Exposing To The Right
Post by: sandymc on August 18, 2011, 12:28:24 pm
Tone controls such as black point (especially), brightness, and contrast work on individual RGB channels so will cause hue shifts.  I would only expect the exposure slider to behave as a true gain in the resulting output with black point set to zero, brightness and contrast neutral, and the tone curve set to linear.

Well, yes, that's what I thought, and in the ETTR work I did a few years ago, I put the blame for the shifts on a combination of profile and the various controls acting in a non-linear way. But Eric seemed to be saying that ACR will be linear with those controls assuming no saturation ???

Sandy
Title: Re: Exposing To The Right
Post by: Guillermo Luijk on August 18, 2011, 01:01:50 pm
I put the blame for the shifts on a combination of profile and the various controls acting in a non-linear way. But Eric seemed to be saying that ACR will be linear with those controls assuming no saturation ???

Any transformation that means a change in the {R,G,B} relative ratios, means a change in hue/sat, but this is assumed. For instance a simple Bright curve to increase luminance without clipping, will compress the highlights producing desaturation. Even if you work in Lab, and apply the curve over the Luminosity channel, you are changing hue/sat. Lab tries to do it in a perceptually pleasant way, but hue/sat changes happen.

A change in exposure (linear scaling of all three channels) would be the only genuinely linear transformation, keeping the proportions of the RGB values and hence keeping hue/sat. The problem is that pushing exposure will quickly clip some channel so this cannot be the only tool for pp.

I am being simplistic here (for instance with a non standard gamma the above is not 100% true), but basically this is the way exposure works.

Regards

Title: Re: Exposing To The Right
Post by: hjulenissen on August 18, 2011, 01:10:35 pm
Would the solution be for raw converters to separate global tonal processing into two (clearly labeled) sections, one native camera space, and one standardized perceptually relevant space?

Perhaps a raw file pre-processor that multiplies raw sensel values with some value (assuming that clipping is not an issue) before importing it into a standard, nicely organized raw developer (I guess dcraw could easily be hacked into something like that).

-h
Title: Re: Exposing To The Right
Post by: sandymc on August 18, 2011, 01:22:39 pm
Guillermo,

Yes, I'm in agreement with you, but that doesn't seem to be what Eric is saying. A few years ago, I said that correcting for ETTR will cause hue shifts, and specifically that such hue shifts occur in LR/ACR. Eric seemed to be saying above that hue shifts won't occur if you adjust the "basic" exposure controls.

Regards,

Sandy
Title: Re: Exposing To The Right
Post by: Peter_DL on August 18, 2011, 01:29:34 pm

With below image*, and a measuring point set to the non-clipped part of the sky,
minus-ACR-Exposure clearly goes along with a reduction of color saturation.
Hence, there are different scaling factors applied per RGB channel…

* which is a "linear" rendition with relevant all sliders and settings in ACR zeroed out.
Also the Baseline Matrix profile was used in order to avoid any non-linearity from the profile.

Among the various discussions on this subject (see below links), best explanation I've heard is as follows:
Quote
… So if you assume clipped white values are infinite, in order to give a pleasing appearance you basically have to use a curve or non-linear exposure adjustment. This is essentially what Adobe does with ACR and Lightroom exposure. The exposure slider isn't really a true "exposure" adjustment equally applied to all values at least when using negative values.

Peter

--


http://www.luminous-landscape.com/forum/index.php?topic=50915.0
http://www.luminous-landscape.com/forum/index.php?topic=49866.msg413890#msg413890
http://forums.adobe.com/message/1210302#1210302

 
Title: Re: Exposing To The Right
Post by: fdisilvestro on August 18, 2011, 01:50:36 pm

Perhaps a raw file pre-processor that multiplies raw sensel values with some value (assuming that clipping is not an issue) before importing it into a standard, nicely organized raw developer (I guess dcraw could easily be hacked into something like that).

-h

That is exactly the way RawTherapee has implemented it.
Title: Re: Exposing To The Right
Post by: Guillermo Luijk on August 18, 2011, 02:08:32 pm
that doesn't seem to be what Eric is saying. A few years ago, I said that correcting for ETTR will cause hue shifts, and specifically that such hue shifts occur in LR/ACR. Eric seemed to be saying above that hue shifts won't occur if you adjust the "basic" exposure controls.

Changing exposure won't change hue/sat, but any other transformation will. If correcting exposure is done in the first step (and this is the correct procedure), any later non-linear alteration of hue/sat will be the same, no matter how much the original RAW file was exposed, i.e. no matter if ETTR was used or not.

I think this is what Eric meant, that the ACR/LR exposure slider (the one and only you need for ETTR exposure correction) doesn't produce hue shifts. But Eric is the one who has to speak about what Eric said  ;D


With below image*, and a measuring point set to the non-clipped part of the sky, minus-ACR-Exposure clearly goes along with a reduction of color saturation.
Hence, there are different scaling factors applied per RGB channel…

Peter, are you sure your RAW file had no clipping in any channel? if it had, the test is irrelevant. Of course non-linear tricks happen in the highlights when the minus exposure slider is activated in RAW clipping situations. Basically this (look at the minus-EV curves turning in the last minute to reach (255,255)):

(http://www.guillermoluijk.com/article/acrps/exposicion_acr.gif)

But that is the cleverest strategy, otherwhise clipped highlights would turn gray, and they wouldn't have a correct colour anyway.

Regards
Title: Re: Exposing To The Right
Post by: sandymc on August 18, 2011, 02:56:16 pm
the one and only you need for ETTR exposure correction

Ahh well, not in the case in ACR - even if every other control is zero'd, that doesn't quite work. Don't know why.

Sandy
Title: Re: Exposing To The Right
Post by: Peter_DL on August 19, 2011, 03:42:12 am
 
Guillermo,

With the measuring point placed as shown above, there is no indication for channel clipping in ACR. I mean the (ProPhoto) RGB readings in ACR @ Exposure zero are 236, 217, 141. Also, the linear rendition in DPP shows no clipping at this point in the mid of the sky. Otherwise I don’t have the tools to verify this.

Further, the curved roll-off with negative Exposure as shown in your graph could only explain an increase of saturation, not a reduction.

So I’m clueless here about the non-linearity and loss of saturation observed with -Exposure.

Regards,
Peter

--
Title: Re: Exposing To The Right
Post by: Guillermo Luijk on August 19, 2011, 04:13:41 am
With the measuring point placed as shown above, there is no indication for channel clipping in ACR.

Clipping indication in ACR is misleading, ACR is a RAW developer, not a RAW analyzer. So the RAW file could be clipped and ACR will display no clipping (a couple of days ago Ray uploaded a clipped RAW file that ACR with minus exposure said it was OK). If you open your RAW file in Rawnalyze you'll see the actual RAW histograms.

It is not fair assuming ETTR or exposure correction produce hue shifts, when users are not doing proper ETTR but clipping their RAW files. Didn't you find suspicious that the reduction of saturation only happened in the sky?
Title: Re: Exposing To The Right
Post by: Peter_DL on August 19, 2011, 04:37:41 am
If you open your RAW file in Rawnalyze you'll see the actual RAW histograms.

I don't think that DPP does any recovery,
however, Rawnalize does not seem to be available online anymore since the author passed away.

Peter

--
Title: Re: Exposing To The Right
Post by: Guillermo Luijk on August 19, 2011, 05:01:55 am
I don't think that DPP does any recovery,
however, Rawnalize does not seem to be available online anymore since the author passed away.

If you send me your email I can send it to you. Gabor did a great job, it's a hiper compact .exe that doesn't need any installation since it strictly uses OS libraries. Just double click and begin opening RAW files.
Title: Re: Exposing To The Right
Post by: francois on August 19, 2011, 05:23:11 am
I don't think that DPP does any recovery,
however, Rawnalize does not seem to be available online anymore since the author passed away.

Peter

--
You might be able to download it from this site:
http://dave-anderson-photo.com/blog/2010/08/23/gabor-rawnalyze-author-rip/
Title: Re: Exposing To The Right
Post by: Peter_DL on August 19, 2011, 06:32:50 am

Many thanks, francois and Guillermo.

IF I'm using the tool correct (?),
there does not seem to be Raw clipping in the mid part of the sky,
where I had originally placed the measuring point.

Peter

--
Title: Re: Exposing To The Right
Post by: madmanchan on August 19, 2011, 10:32:56 pm
Thanks Bill. That must be the reason for the non-linearity in the calculated curves (which of course doesn't mean any non-linearity in the way Exposure works in ACR).

So if the gamma slope in Adobe RGB's implementation is limited (i.e. Adobe RGB's gamma lifts the shadows less than a pure gamma), and we open an image encoded with a pure 2.2 gamma assigning it to Adobe RGB, we will be seeing the deep shadows a bit brighter than expected. My concern about this is because I use pure 2.2 gamma images and then assign them in Adobe RGB, but I find OK to have some shadow lifting.

Regards


Yes, Guillermo and Bill -- ACR uses a slope-limited initial segment for the deepest shadows.  We do this for both ProPhoto RGB (normally gamma 1.8) and Adobe RGB (normally gamma 2.2).  You can see the exact math we're using in the public DNG SDK, in case you are curious.  The relevant source file is named dng_color_space.cpp.

This accounts for the shadow discrepancies that you are seeing.
Title: Re: Exposing To The Right
Post by: madmanchan on August 19, 2011, 10:34:11 pm
So in the minus direction it is really a jump function ?

Clipped white is fixed at RGB 255 while a multiplier < 1 is applied all other values, without any smoothing ?

Hmm

Peter

--

Peter, no it is not a jump function.  It is a smooth function that maps pure white to the rest of the curve below it.  (If it was a step/jump function you would see horrible artifacts in your highlights and upper midtones!)
Title: Re: Exposing To The Right
Post by: madmanchan on August 19, 2011, 10:39:10 pm
Hi Sandy, thanks for running this test and reporting the results. Emil is right, in that black subtraction (in ACR's case, via Blacks slider) is typically done per-channel so it is expected to result in color changes (including hue). Setting Blacks to 0 will turn off that behavior. Generally speaking, you'll find that a given step/error size will manifest much more strongly in blue than the other colors, because the internal working space of ACR uses the ProPhoto RGB primaries, and the blue primary is pretty far out there ...
Title: Re: Exposing To The Right
Post by: Peter_DL on August 20, 2011, 03:43:29 am
Peter, no it is not a jump function.  It is a smooth function that maps pure white to the rest of the curve below it.  (If it was a step/jump function you would see horrible artifacts in your highlights and upper midtones!)

Eric, many thanks for your comment.

In the example posted above an initial RGB triplet of 236, 217, 141 is mapped to 160, 147, 107 by setting the Exposure slider to -0.75 (see screenshots with post # 44). So the multiplier on the R channel is 160/236= 0.678. The multiplier on the B channel is 107/141= 0.759, which is higher. Hence, the channels are squeezed closer together in terms of R:B, and a corresponding loss of saturation is clearly visible as well. Unlike what I initially thought, this cannot be explained by the smoothened roll-off with negative Exposure.

Again, for this example all other tonal controls were zeroed in ACR, which is supposed to provide a "linear rendition". Point curve linear as well. ProPhoto RGB selected for output, which to my knowledge is what the RGB readings refer to. Further, the baseline matrix profile was used to avoid any related hue twists. Also, Rawnalyze does not seem to provide any indication for Raw clipping in this mid part of the sky.

So I’m still puzzled about this effect.

Peter

--
Title: Re: Exposing To The Right
Post by: sandymc on August 20, 2011, 08:00:20 am
Hi Sandy, thanks for running this test and reporting the results. Emil is right, in that black subtraction (in ACR's case, via Blacks slider) is typically done per-channel so it is expected to result in color changes (including hue). Setting Blacks to 0 will turn off that behavior. Generally speaking, you'll find that a given step/error size will manifest much more strongly in blue than the other colors, because the internal working space of ACR uses the ProPhoto RGB primaries, and the blue primary is pretty far out there ...

Eric,

Thanks for coming back on this. I ran the same checks with black = 0, contrast and brightness at default. Result is 71.5,82.5,34.2 versus 71.7,83.2,31.6.

So the blue deviation is less, but not eliminated, with black set 0. So far as I can tell, it seems to be also related to the brightness control. I mean, it's not a huge deviation in the grand scheme of things, but still.....

Regards,

Sandy
Title: Re: Exposing To The Right
Post by: Guillermo Luijk on August 20, 2011, 08:07:19 am
Rawnalyze does not seem to provide any indication for Raw clipping in this mid part of the sky.

Perhaps ACR's highlight strategy extended beyond the strictly RAW-clipped area. In this thread (http://www.luminous-landscape.com/forum/index.php?topic=56469.msg460340#msg460340) you can see an example.

I think it makes sense to produce a soft and progressive transition between the OK areas and those where some kind of 'recovery' is needed.

Regards
Title: Re: Exposing To The Right
Post by: ejmartin on August 20, 2011, 10:07:49 am
Again, for this example all other tonal controls were zeroed in ACR, which is supposed to provide a "linear rendition". Point curve linear as well. ProPhoto RGB selected for output, which to my knowledge is what the RGB readings refer to. Further, the baseline matrix profile was used to avoid any related hue twists. Also, Rawnalyze does not seem to provide any indication for Raw clipping in this mid part of the sky.

Zero'd tone controls and 'linear' tone curve don't produce a linear output in ACR; gamma is still applied according to the chosen color space.  So lower tones will be amplified more than higher tones, simply because that's the way a gamma curve works.  And there will be hue/saturation shifts as a result.  Only the sort of test Sandy is doing, where one tries to achieve the same output density with shots taken at different ISO, should be independent of the applied gamma, which takes place after the exposure slider is applied in the processing pipeline.
Title: Re: Exposing To The Right
Post by: bjanes on August 20, 2011, 11:27:48 am
Zero'd tone controls and 'linear' tone curve don't produce a linear output in ACR; gamma is still applied according to the chosen color space.  So lower tones will be amplified more than higher tones, simply because that's the way a gamma curve works.  And there will be hue/saturation shifts as a result.  Only the sort of test Sandy is doing, where one tries to achieve the same output density with shots taken at different ISO, should be independent of the applied gamma, which takes place after the exposure slider is applied in the processing pipeline.

Emil is correct about the gamma question. If you want a linear tone curve (scene referred), you can convert from ProPhotoRGB to ISO22028-3_RIMM-RGB-exCR color space as described in this (http://www.color.org/scene-referred.xalter#profiles) ICC paper.

Regards,

Bill
Title: Re: Exposing To The Right
Post by: Peter_DL on August 20, 2011, 12:12:32 pm
Zero'd tone controls and 'linear' tone curve don't produce a linear output in ACR; gamma is still applied according to the chosen color space.  So lower tones will be amplified more than higher tones, simply because that's the way a gamma curve works.  And there will be hue/saturation shifts as a result.

Sorry, that’s a common misunderstanding about gamma.

With a regular gamma, gamma-encoding and linear scaling (multiplication) are commutative operations. Means that the sequence can be exchanged – without changing the result – provided that the absolute value of the factor f can be adapted:

(f x rgb)^(1/gamma) = f^(1/gamma) x rgb^(1/gamma)

= f* x rgb^(1/gamma)

Any linear scaling applied on an RGB triplet which is done in one gamma sphere, can be undone by linear scaling in another gamma sphere. Color Integrity in terms of R:G:B is maintained.


But I’ll be happy to transfer the numerical comparison with the given example and measuring point to any 1.0 gamma space, if needed.

Peter

--

Title: Re: Exposing To The Right
Post by: sandymc on August 20, 2011, 12:24:36 pm
Zero'd tone controls and 'linear' tone curve don't produce a linear output in ACR; gamma is still applied according to the chosen color space.  So lower tones will be amplified more than higher tones, simply because that's the way a gamma curve works.  And there will be hue/saturation shifts as a result.  Only the sort of test Sandy is doing, where one tries to achieve the same output density with shots taken at different ISO, should be independent of the applied gamma, which takes place after the exposure slider is applied in the processing pipeline.

Doubt that this is gamma related - the exposure controls really should be gamma independent, and so far as I am aware LR/ACR operate in a linear light (gamma 1) internal space anyway. But Eric may be able to throw more light on exactly what the mechanism is. Eric's "per channel blacks" response makes sense as regards blacks (although it makes me wonder why the LR default is 5, if that's the way LR/ACR operate - seems like "color offset by default", unless there's compensation somewhere else in the chain), but there seems to be something else also going on in the blue channel.

Sandy
Title: Re: Exposing To The Right
Post by: Guillermo Luijk on August 20, 2011, 01:46:15 pm
I gree with Peter. In fact as Eric Chan explained, ACR doesn't use a standard output gamma in the shadows, but the effect of an exposure change seems to be independent from it.

Title: Re: Exposing To The Right
Post by: ejmartin on August 20, 2011, 02:20:29 pm
Preservation of hue/saturation only holds when gamma is a pure power law, not two different power laws, one for shadows and another for everything else.  Though it seems that Peter's example doesn't range down into the linear part of Adobe's gamma function, so it's still a puzzle.
Title: Re: Exposing To The Right
Post by: madmanchan on August 20, 2011, 07:58:03 pm
Sandy, that does sound unusual. You mentioned earlier that when Blacks, Brightness, and Contrast were all 0 (i.e., no-ops) that the hue shift wasn't there. Now it seems that with Blacks 0, but the other two at defaults, there is a hue shift (due to a blue difference).  I don't have an explanation for that.  But I'd be happy to study your test images (you have my email).

Eric
Title: Re: Exposing To The Right
Post by: sandymc on August 21, 2011, 03:39:35 am
Sandy, that does sound unusual. You mentioned earlier that when Blacks, Brightness, and Contrast were all 0 (i.e., no-ops) that the hue shift wasn't there. Now it seems that with Blacks 0, but the other two at defaults, there is a hue shift (due to a blue difference).  I don't have an explanation for that.  But I'd be happy to study your test images (you have my email).

Eric


Eric, yes, it's odd - each control in isolation seems ok if all others are at zero. But more than one away from zero, and this slight hue shift appears. Anyway, files sent.

Regards,

Sandy
Title: Re: Exposing To The Right
Post by: Peter_DL on August 21, 2011, 03:45:05 am
Perhaps ACR's highlight strategy extended beyond the strictly RAW-clipped area. In this thread (http://www.luminous-landscape.com/forum/index.php?topic=56469.msg460340#msg460340) you can see an example.

Yes, interesting,
I'll go along with this explanation.

Many thanks.
& Best regards, Peter

--
Title: Re: Exposing To The Right
Post by: sandymc on August 23, 2011, 06:32:00 am
Ok, so Eric and I have spent some time on trying to chase down the elusive blue shift. (Thanks Eric!)

After a few blind alleys, I ended up reimporting the images in LR, and the residual blue shift vanished. Reason unclear ???

But, the bottom line is that ACR/LR's basic exposure controls (Exposure, brightness, contrast) don't introduce color shifts IF:

So, if you really have to use ETTR, on ACR or Lightroom: (a) "Blacks" slider to zero, then (b) dial out the ETTR with the "Exposure" slider

Sandy
Title: Re: Exposing To The Right
Post by: stamper on August 23, 2011, 07:04:03 am
In another post I asked why ACR and Lightroom aren't set for zero settings as base and the answer that Eric provided was that most owners who don't know much about the programs wouldn't like that. I am paraphrasing him. For advanced users it is important to know they aren't zerod.
Title: Re: Exposing To The Right
Post by: madmanchan on August 23, 2011, 02:18:49 pm
Put another way, we've found that users prefer that their raw files are tone- and color-rendered by default (i.e., have a film-like S-curve with shoulder and toe applied), rather than a straight scene-referred rendering which usually looks flat.
Title: Re: Exposing To The Right
Post by: stamper on August 27, 2011, 04:05:54 am
Put another way, we've found that users prefer that their raw files are tone- and color-rendered by default (i.e., have a film-like S-curve with shoulder and toe applied), rather than a straight scene-referred rendering which usually looks flat.

Fine .... as long as they know about it. :)