Luminous Landscape Forum

Raw & Post Processing, Printing => Digital Image Processing => Topic started by: thierrylegros396 on January 04, 2013, 05:44:00 am

Title: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: thierrylegros396 on January 04, 2013, 05:44:00 am
What is the best method to recover a completely clipped channel, the 2 others being almost perfect ?!

I've several photos with wonderfull skies, but the red channel only is clipped.

The others are fairly lower, so some areas appears almost uniform.

LR4 sliders don't give good enough results.

Any good ideas are welcome ;)

Thierry
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: Redcrown on January 04, 2013, 03:13:12 pm
Need more info and example to be most helpful (raw?, jpeg?, camera model?).

But if you have raw the first thing I'd try is different profiles. Depending on your camera model, the Adobe profiles (standard, faithful, neutral, etc.) can have a big impact on color rendition, especially in the red channel.

That, and the highlight recovery on raw files can go a long way to restoring clipped channels. The highlight recovery function actually uses data in "good" channels to fix bad channels. The highlight recovery in LR4/PS6 is significanly better than in previous versions. But you say you have "PS5", so you may not have the full power of highlight recovery.

Upload a raw file and I'm sure others will have a go at it.
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: thierrylegros396 on January 04, 2013, 04:05:35 pm
I've restored a lot of clipped photos.

But yellow flowers and reddish skies are among the hardest things to cure.

Yes those are raw files from G15, and I've found ways to improve them, but I want to restore them with the best methods available today.

As often, use of several methods gives even better results.

That's why I ask your help.

Thierry
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: madmanchan on January 04, 2013, 08:14:40 pm
I suggest posting an example raw file.
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: eliedinur on January 05, 2013, 05:13:08 am
If those are Raw files, it is highly improbable that in the original capture the red channel is clipped and the green channel is not. It is the white balancing that is causing the red clipping and there are multiple ways to counteract this - the R-G-B curves editor, HSL panel and Grad Filter/Brush being a few of them.
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: thierrylegros396 on January 05, 2013, 06:52:19 am
If those are Raw files, it is highly improbable that in the original capture the red channel is clipped and the green channel is not. It is the white balancing that is causing the red clipping and there are multiple ways to counteract this - the R-G-B curves editor, HSL panel and Grad Filter/Brush being a few of them.

For the red sky, you are right !

Lowering the WB to 2500K shows no more clipping of the Red Channel.

But for yellow flowers, I will post a RAW file soon as suggested by madmanchan.
Title: Re: Best method to recover 1 or 2 completely clipped channels (LR or PS5) ?!!
Post by: thierrylegros396 on January 05, 2013, 07:40:51 am
The Raw can be found here

https://skydrive.live.com/redir?resid=82750CF68B57F67E!139 (https://skydrive.live.com/redir?resid=82750CF68B57F67E!139)

One or two channels are clipped.
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: Walter Schulz on January 05, 2013, 08:04:38 am
No, they are not. Looks perfectly fine to me and PS CS 5.1 supports my opinion. Same in LR 4.3.
I suppose your LR settings are way off or you picked the wrong picture.

Ciao, Walter
Title: Re: Best method to recover 1 or 2 completely clipped channels (LR or PS5) ?!!
Post by: Bart_van_der_Wolf on January 05, 2013, 08:46:15 am
The Raw can be found here

https://skydrive.live.com/redir?resid=82750CF68B57F67E!139 (https://skydrive.live.com/redir?resid=82750CF68B57F67E!139)

One or two channels are clipped.

Hi Thierry,

A quick look at the file with 'Rawdigger' shows that the file was correctly exposed, slightly more than 1/3rd stop below any clipping. So you could have exposed it a third of a stop more, and still experience no clipping.

Whatever issue you are having, it's not Raw clipping in this file. LR4 also doesn't indicate any clipping. Maybe it's more colorspace/gamut related?

Cheers,
Bart
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: fdisilvestro on January 05, 2013, 08:56:10 am
Hi,

Bart and Walter are correct, here is the Raw histogram from Rawnalize where you can see that you have at least 1/3 stop headroom

Are you using a sRGB monitor?
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: Walter Schulz on January 05, 2013, 09:17:22 am
Are you using a sRGB monitor?

AFIAK this should only be an issue if "Softproof" is used with a monitor profile.

Ciao, Walter
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: fdisilvestro on January 05, 2013, 09:31:22 am
AFIAK this should only be an issue if "Softproof" is used with a monitor profile.

Ciao, Walter

Hi, not necessarilly. You might see Clipped or "textureless" colors with a sRGB monitor in areas that are out of the sRGB gamut, which are fine in the Raw image or in a wider color space. This could give the perception of blown channels.
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: Redcrown on January 05, 2013, 11:49:00 am
Thanks for the raw. I'm not familiar with the Canon G15, but this raw shows the most bizzare Adobe profiles I've ever seen. As I guessed in my original reply, the problem with clippiing on this image is all in the profiles.

True, there is no clipping in the raw, as others have shown with a raw analyzer. Far from it, in fact. But load this raw in LR or ACR and significant clipping shows up under the default settings, which use the "Adobe Standard" profile. But shift to any other profile and the clipping goes away.

The other profiles also give major shifts in color. That's common with the Adobe profiles for most camera models, but the shifts in color AND tone curves for this G15 image are greater than anything I've ever seen. Makes me a bit suspicious about the Adobe profiles for that camera.

In fact, if you shift this image to any other Adobe profile (faithful, camera standard, neutral), you can then increase exposure by 1 to 2 full stops before any clipping occurs.

I converted the cr2 sample to DNG and loaded it in the DNG profile editor to look at the tone curves. The base tone curve for the Adobe Standard profile is huge compared to the others. So it's that tone curve that is driving all the values beyond clipping. Looks like the G15 really, really needs custom profiles.
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: Walter Schulz on January 05, 2013, 12:30:25 pm
But load this raw in LR or ACR and significant clipping shows up under the default settings, which use the "Adobe Standard" profile. But shift to any other profile and the clipping goes away.

I used "Adobe Standard": No highlight clipping in LR or ACR.

Ciao, Walter
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: jrsforums on January 05, 2013, 12:37:19 pm
What is the best method to recover a completely clipped channel, the 2 others being almost perfect ?!

I've several photos with wonderfull skies, but the red channel only is clipped.

The others are fairly lower, so some areas appears almost uniform.

LR4 sliders don't give good enough results.

Any good ideas are welcome ;)

Thierry

What made you think they were clipped in the red?  RAW you submitted had no clipping.  Do you have one which does....that prompted you post in the first place?

BTW...in my experience, opening in LR 4 (adobe Standard profile), all the recoverable channels have been recovered.  If a channel then shows clipped, it cannot be recovered.

John
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: Redcrown on January 05, 2013, 12:44:07 pm
I need to take back a little of what I said above. The Adobe profiles for the G15 are not that bizzare. In fact, they generate results that are very close to the results that Canon's DPP generates. That is what they are claimed to do and they do it well in this case. I had to run this sample cr2 through DPP to remember that.

But it is still the Adobe Standard profile that is causing problems for the OP. It's a mystery to me how Adobe generates the "Adobe Standard" profiles for every camera model they support. But it appears they use the same base tone curve for every one or them. That base tone curve is very strong (gamma 2.2 I think), and is good reason not to use them as this case demonstrates.
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: Walter Schulz on January 05, 2013, 12:51:09 pm
and is good reason not to use them as this case demonstrates.

I cannot follow your jump to conclusion because it is based on poor/incomplete data. Nobody knows what's the thread opener's problem actually is.

Ciao, Walter
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: Redcrown on January 05, 2013, 01:03:14 pm
Walter and jrsforums had me confused for a while. I could not understand why they did not see highlight clipping in the red channel. But then I realized it's also a colorspace issue. If you load the OP's raw in ACR with the ProPhoto colorspace as default, there is no clipping, even under the Adobe Standard profile. But if you use any other colorspace (Adobe98, sRGB, Colormatch) there is clipping. I use Adobe98 as the ACR default. Walter and jrsforums must be using ProPhoto.

I'm not suggesting we re-visit the ProPhoto colorspace debate. But in this case, if the OP converts this raw image under ProPhoto plus Adobe Standard he will avoid clipping UNTIL he converts the image to sRGB for web posting, or tries to print it. Then the clipping will return.
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: Redcrown on January 05, 2013, 01:09:58 pm
Quote
I cannot follow your jump to conclusion because it is based on poor/incomplete data. Nobody knows what's the thread opener's problem actually is.

Well, I have a conclusion but I didn't jump to it. I did a lot of testing to get good, complete data. The OP's problem is clipping (in the red channel) caused by the combination of using the Adobe Standard profile and Adobe98 or sRGB colorspace. Change the profile and the problem goes away. Change the colorspace to ProPhoto and the problem goes away temporairly.
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: Walter Schulz on January 05, 2013, 01:19:56 pm
Yes, this is correct. I use ProPhotoRGB and I'm aware of the clipping issues with aRGB and sRGB (been there, done that).
But the thread opener has a problem in LR, too. And there is no way (known to me, at least ...) *not* to use Melissa RGB in LR. It may be a perception problem as pointed out by Francisco. But we need to wait for more info from the TO.

Ciao, Walter
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: PeterAit on January 05, 2013, 01:39:08 pm
By my understanding, a clipped channel is by definition unrecoverable.
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: thierrylegros396 on January 05, 2013, 01:43:51 pm
AFIAK this should only be an issue if "Softproof" is used with a monitor profile.

Ciao, Walter

I think you are right, it must come from the monitor.

So, I need to use Rawnalyse or Rawdigger, because I've taken some shots with my RX100 which are clipped according to the camera (RGB histogram and white blinking).
After loading them in LR4, I see a headroom of one full stop !!!
Strange because the contrast and saturation of the jpg is set to low.
And today it's a Scottish weather with low contrast and dull colors.
 ???

Will compare with my G15.

Thierry



Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: thierrylegros396 on January 05, 2013, 02:02:10 pm
Thanks for the raw. I'm not familiar with the Canon G15, but this raw shows the most bizzare Adobe profiles I've ever seen. As I guessed in my original reply, the problem with clippiing on this image is all in the profiles.

True, there is no clipping in the raw, as others have shown with a raw analyzer. Far from it, in fact. But load this raw in LR or ACR and significant clipping shows up under the default settings, which use the "Adobe Standard" profile. But shift to any other profile and the clipping goes away.

The other profiles also give major shifts in color. That's common with the Adobe profiles for most camera models, but the shifts in color AND tone curves for this G15 image are greater than anything I've ever seen. Makes me a bit suspicious about the Adobe profiles for that camera.

In fact, if you shift this image to any other Adobe profile (faithful, camera standard, neutral), you can then increase exposure by 1 to 2 full stops before any clipping occurs.

I converted the cr2 sample to DNG and loaded it in the DNG profile editor to look at the tone curves. The base tone curve for the Adobe Standard profile is huge compared to the others. So it's that tone curve that is driving all the values beyond clipping. Looks like the G15 really, really needs custom profiles.

Sorry, I forgot to say that the posted file is a S90 one !!

But lack of texture I see in the screen is certainly due to "out of Gamut" colors as Francisco says !
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: jrsforums on January 05, 2013, 02:13:23 pm
By my understanding, a clipped channel is by definition unrecoverable.

I am not sure your definition of "clipped".

If you mean the actual RAW, as shown in RawDigger for example, it is possible to attempt to recover some of the info/texture by using the other unclipped channels.  This is the "magic" the LR and ACR do. 

If you mean clipping in LR 4, you are correct, because what is shown is after the attempts to recover the info.

Recovery is not necessarily perfect.  This is why it is best to keep the LR brightest tones at ~75% or below.

John
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: Walter Schulz on January 05, 2013, 02:17:54 pm
because I've taken some shots with my RX100 which are clipped according to the camera (RGB histogram and white blinking).
After loading them in LR4, I see a headroom of one full stop !!!

I don't know how Sony computes histograms. Canon doesn't use the RAW data but the embedded JPEG to calculate those and highlight clipping warning is a mixture of all channels put together and this is called "luminosity".
You know there is a JPEG stored in each RAW file?
Because "luminosity" is a weighted function of those RGB channels you might see warnings where no clipping occurs and you may see no warning but clipped channels.
Therefore: Works as designed.

What's up with the CR you choosed? Do you have clipping problems withing LR? Go to "Develop", press "ALT" and left-click on the "Exposure" slider. Pictures will turn black and only clipped areas will be shown. Those are increased if slider is pulled to the right.

Ciao, Walter
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: thierrylegros396 on January 05, 2013, 02:35:44 pm
Thanks John and Walter,

If you mean clipping in LR 4, you are correct, because what is shown is after the attempts to recover the info.
Recovery is not necessarily perfect.  This is why it is best to keep the LR brightest tones at ~75% or below.
John
I completely ignore that, but always keep the brightest tone @80%, thanks for explanation ;)

I don't know how Sony computes histograms. Canon doesn't use the RAW data but the embedded JPEG to calculate those and highlight clipping warning is a mixture of all channels put together and this is called "luminosity".
You know there is a JPEG stored in each RAW file?
Because "luminosity" is a weighted function of those RGB channels you might see warnings where no clipping occurs and you may see no warning but clipped channels.
Therefore: Works as designed.

What's up with the CR you choosed? Do you have clipping problems withing LR? Go to "Develop", press "ALT" and left-click on the "Exposure" slider. Pictures will turn black and only clipped areas will be shown. Those are increased if slider is pulled to the right.

Ciao, Walter

I've texture problems, but it appears to come from "out of Gamut" colors !

So, next buy, a new screen  ;)
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: Walter Schulz on January 05, 2013, 03:15:20 pm
May I ask which monitor type you are using now, type of operating system and monitor profile settings?
Why I'm asking this? Samsung (for example) is known to install horrible profiles unsuitable for photographers.

Ciao, Walter
Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: jrsforums on January 05, 2013, 04:25:08 pm
Thanks John and Walter,
I completely ignore that, but always keep the brightest tone @80%, thanks for explanation ;)

Just to be clear....this is on opening. This relates to the original RAW file.  After opening, for creative purposes, all bets are off....you can increase as desired.

Above 75-80% (on opening) is not "bad". Just risks some loss as recovery is not perfect....but much better than without it.

John

Title: Re: Best method to recover a completely clipped channel (LR or PS5) ?!!
Post by: thierrylegros396 on January 06, 2013, 02:20:37 pm
Just to be clear....this is on opening. This relates to the original RAW file.  After opening, for creative purposes, all bets are off....you can increase as desired.

Above 75-80% (on opening) is not "bad". Just risks some loss as recovery is not perfect....but much better than without it.
John

Thanks for explanation.

May I ask which monitor type you are using now, type of operating system and monitor profile settings?
Why I'm asking this? Samsung (for example) is known to install horrible profiles unsuitable for photographers.
Ciao, Walter

You are right, Samsung (with Win7) has unsuitable profiles, but I've profiled my monitor with a Spider 2.

And I've just installed latest version of Rawdigger, and learned a lot of things !!!

Thierry