Pages: [1] 2   Go Down

Author Topic: Super-resolution, photo-stacking, and improvement in landscape photographs  (Read 10162 times)

David Eckels

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 3526
  • It's just a camera.
    • Website

I posted another image of the same general frame from the North Rim of the Grand Canyon in User Critiques. Wmchauncey asked me a question about photo stacking, which I did not understand. Then he posted a topic here in this area on super-resolution, which I read and got to thinking. Now this may be dangerous, but I thought I would post it for C&C and pose the question as to whether it could be generally applied to landscape photography.

My reading suggested that I'd inadvertently taken an image that would enable me to test this idea: Nine frames, same image, tripod, same exposures, opened as separate files in PS CC, File>Scripts>Statistics>Mean, and I let it crank away. I should add that the nine DNG files had all been reset in LR before opening in PS. The resulting "Mean" image definitely had less noise as might be expected, but to my eye, there was also more detail when compared to one of the single frames or to an image produced by choosing "Median" rather than the average. The image was saved as a TIFF to be processed in parallel with one from a single frame in LR. For comparison, I include two 500 pixel crops from the finished images, one from the "Mean" (left) image, the other from the single frame (right). Mind you, these crops were taken after I processed them in LR and then opened in PS for creative processing and sharpening. The reason I shot the series of nine frames was because the light was changing so very rapidly that I'd hoped to catch one with just the right illumination of the peak. The creation of the TIFF was not difficult or cumbersome as I had written an action to take care of it. I apologize for my ineptness in cropping and guess that the differences in appearances might be due in part to the rapidly changing light condition; it could also be that I screwed up somehow in LR, but I don't think it changes the conclusions. Finishing in PS was the same for each.

Regarding the comments by wmchauncey and the discussion on "super-resolution" I would be curious to see if this might comprise an easy DIY method for obtaining not only lower noise* but also greater detail in images. To wit, select the files in LR, open in PS, run the "Mean" action, and save as TIFF to create the digital "negative." Perhaps others have already discovered this approach.

*Nikon D800E, 28-300 zoom at 28 mm, 1/8 sec, f/16, ISO 100
« Last Edit: September 11, 2016, 07:01:21 pm by David Eckels »
Logged

David Eckels

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 3526
  • It's just a camera.
    • Website
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #1 on: September 11, 2016, 03:20:31 pm »

BTW, the finished product, just as an FYI.

Bart_van_der_Wolf

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 8913
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #2 on: September 11, 2016, 07:05:48 pm »

BTW, the finished product, just as an FYI.

Great image David.

Quote from: David Eckels
Regarding the comments by wmchauncey and the discussion on "super-resolution" I would be curious to see if this might comprise an easy DIY method for obtaining not only lower noise* by also greater detail in images. To wit, select the files in LR, open in PS, run the "Mean" action, and save as TIFF to create the digital "negative." Perhaps others have already discovered this approach.

It will work better if you upsample the files (e.g. to 200%), and then align them before averaging (using Mean will reduce noise, Median will remove movement, while both will increase resolution).

The trick with upsampling before aligning, is that it allows to align, but now at half pixel precision (compared to the original image size). You can then downsample to almost the original size and it will be sharper than it was with an original single capture, or you can leave it at the enlarged size to not lose anything to downsampling, although the larger file will not be pixel sharp but it does have more detail.

Cheers,
Bart
Logged
== If you do what you did, you'll get what you got. ==

wmchauncey

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 793
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #3 on: September 13, 2016, 09:26:07 am »

I gotta thank David for his "real world" depiction of the technique...looks great.

Bart, I now understand the process but, why stop at a 200% upsize...why not 300% or 400% for that matter?
Logged
The things you do for yourself die with

David Eckels

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 3526
  • It's just a camera.
    • Website
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #4 on: September 13, 2016, 10:21:04 am »

Thanks, Bart.
BTW, the images were aligned as part of the Statistics script. Is this sufficient for an upsampled image?
...but, why stop at a 200% upsize...why not 300% or 400% for that matter?
Is it asymptotic (diminishing returns)?

Bart_van_der_Wolf

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 8913
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #5 on: September 13, 2016, 10:28:26 am »

I gotta thank David for his "real world" depiction of the technique...looks great.

Bart, I now understand the process but, why stop at a 200% upsize...why not 300% or 400% for that matter?

No real reason other than requiring many more shots to reach a stable increase.

At a 200% upsizing, we can increase resolution at a virtual quarter pixel precision when compared to the original size. With perfect half pixel pitch monochrome samples, we'd need 4 pixels for which we needed 1, or 16 if we also want to have full colour coverage with a Bayer CFA. But with semi-random sampling we may indeed need something like 20 or more to accidentally also have half pixel luminances and others in between, and probably more like 60 for full colour, coverage.

For a 300% case the required number of images gets unworkable pretty quickly, especially when the stitching alternative is much faster and more accurate.

What 300% does with a low number of semi-random shots, say up to 20 or so, is slightly (hardly visible) increase precision and resolution over the 200% case, just because the samples are slightly more accurately positioned. The file sizes do get to be prohibitively large for registration/alignment and averaging. Slow and large, with a hardly (if at all) a noticeable improvement.

The procedure would be best suited for Raw data, so that Demosaicing can be done on higher resolution data, but doing it with the already Raw converted data still has benefits.

Cheers,
Bart
Logged
== If you do what you did, you'll get what you got. ==

Bart_van_der_Wolf

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 8913
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #6 on: September 13, 2016, 10:50:45 am »

Thanks, Bart.
BTW, the images were aligned as part of the Statistics script. Is this sufficient for an upsampled image?

If the statistics script first does alignment yes, otherwise it's not helping resolution, but only helps with providing noise averaging. Hint: Denoising can be more efficient.

Quote
Is it asymptotic (diminishing returns)?

Diminishing returns and computer memory and storage guzzling. If the randomness of the shot positioning is not random enough then the gain in resolution will also not be very isotropic (uniform in all orientations). So many more random shots are needed to get better uniformity of the improvements.

Cheers,
Bart
Logged
== If you do what you did, you'll get what you got. ==

wmchauncey

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 793
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #7 on: September 14, 2016, 10:46:17 am »

Logged
The things you do for yourself die with

Leszek Piotrowski

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 411
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #8 on: September 14, 2016, 08:46:34 pm »

David--

Your image capture and post work bring "life" to that wonderful canyon landscape. thanks for posting.
Logged
Leszek, G

Alan Klein

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 15850
    • Flicker photos
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #9 on: September 15, 2016, 12:09:12 am »

Nice picture.  But it's the light that does it not the pixels.  This is Luminous Landscape, after all.

Wayne Fox

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 4237
    • waynefox.com
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #10 on: September 16, 2016, 02:10:53 pm »

Nice picture.  But it's the light that does it not the pixels.  This is Luminous Landscape, after all.
agreed, but without the pixels you can’t make a decent size print.
Logged

kers

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 4388
    • Pieter Kers
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #11 on: September 16, 2016, 02:39:44 pm »

I just tried it but i am not impressed; ( maybe i did something wrong)
My lenses already give me a 100% cover on the 36Mp of my sensor and the Mean image over 10 shots is in fact less sharp.
Moiré is still there but a bit less pronounced.
The result is unpredictable. Making it a wast of time and effort.
The only thing i can see is less grain, but i can do that with choosing a lower iso value if things are not moving...
Logged
Pieter Kers
www.beeld.nu/la

Lundberg02

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 379
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #12 on: September 17, 2016, 03:11:37 am »

The OP's two crops are supposed to demonstrate what?  They're both muddy,blurry and they are different colors.
Also, where is the evidence that resolution is improved, in the form of discernible line patterns. I suppose that jitter can overcome some of the estimation involved in demosaicing,but I think that adding images and averaging actually just raises the S/N ratio and over comes the MTF of the lens.
« Last Edit: September 17, 2016, 04:11:07 am by Lundberg02 »
Logged

David Eckels

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 3526
  • It's just a camera.
    • Website
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #13 on: September 21, 2016, 12:35:33 pm »

The OP's two crops are supposed to demonstrate what?  They're both muddy,blurry and they are different colors.
Addressed in the OP. Acknowledged that there are differences in PP, but recognize that they are, in fact, different images with slightly different lighting conditions.
where is the evidence that resolution is improved, in the form of discernible line patterns.
Exactly
I think that adding images and averaging actually just raises the S/N ratio
Obviously is raises S/N. But as to your "just" qualifier, you seem to agree that there is an improvement in discernible line patterns. Is the juice worth the squeeze? That depends on personal preference. For me, there's probably not so much an advantage that a tripod and low ISO wouldn't compensate, as kers points out and raises the question of what is good enough? It was "just" and experiment and not intended to advocate for a general approach.

John Nollendorfs

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 623
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #14 on: September 21, 2016, 01:12:34 pm »

Much talk of IQ on this forum tends to get quite esoteric, but for me the bottom line is not in pixel peeping, but in printing large. The transition back to an analogue print from digital data tends smooth out most of the pixel peeping differences. While I agree, shooting at base ISO should be better, I've found higher ISOs look just fine on my D800E, and the differences in a print I consider to be quite minor. While I love the lightweight carbon Fiber tripod I bought 3 years ago to replace my world traveled Tiltall, I feel quite liberated shooting hand held at higher shutter speeds. And putting together one row stitches of the camera held vertically works just fine.
Logged

David Eckels

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 3526
  • It's just a camera.
    • Website
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #15 on: September 21, 2016, 03:58:56 pm »

Much talk of IQ on this forum tends to get quite esoteric, but for me the bottom line is not in pixel peeping, but in printing large. The transition back to an analogue print from digital data tends smooth out most of the pixel peeping differences. While I agree, shooting at base ISO should be better, I've found higher ISOs look just fine on my D800E, and the differences in a print I consider to be quite minor. While I love the lightweight carbon Fiber tripod I bought 3 years ago to replace my world traveled Tiltall, I feel quite liberated shooting hand held at higher shutter speeds. And putting together one row stitches of the camera held vertically works just fine.
+1

Lundberg02

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 379
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #16 on: September 26, 2016, 05:50:18 am »

I did not agree to anything about line resolution. I would like to SEE actual evidence of improved resolution that is not just better signal to noise.
Logged

TonyW

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 643
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #17 on: September 26, 2016, 12:35:37 pm »

Nice image David

I have not tried the technique but I do think there is enough evidence to suggest an improvement in resolution as well as noise is attainable. 

From the little I understand camera on tripod is not the best way to go as there needs to be a slight movement between shots so for many cameras it is suggested to hand hold and take a bucket load of shots

http://photoncollective.com/enhance-practical-superresolution-in-adobe-photoshop

https://aperture64.wordpress.com/2014/03/19/improving-image-quality-with-stacking-and-super-resolution/

Is it worthwhile I guess only the individual can answer
« Last Edit: September 26, 2016, 12:51:42 pm by TonyW »
Logged

David Eckels

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 3526
  • It's just a camera.
    • Website
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #18 on: October 01, 2016, 11:00:36 am »

From the little I understand camera on tripod is not the best way to go as there needs to be a slight movement between shots so for many cameras it is suggested to hand hold and take a bucket load of shots.
Thanks, Tony. So I have tried this exactly twice and while the OP may arguably show some enhancement of resolution and/or S/N, when I tried it with an 8-shot handheld, I couldn't see any benefit; exactly the opposite of what seems to be reported. Honestly, I don't think the juice is worth the squeeze. It was "just" an experiment ;)

sjprg

  • Full Member
  • ***
  • Offline Offline
  • Posts: 129
Re: Super-resolution, photo-stacking, and improvement in landscape photographs
« Reply #19 on: October 07, 2016, 11:22:30 am »

Hi Bart
I know you have been into deconvolution for several years and were very active on an old forum of the subject which sort of died away.
I have been using a new deconvolution processor "Franzis Sharpen" on my landscapes. The latest version was just updated today. I have been impressed with what they are accomplishing and would like to get your impressions of it. It still has scaling problems with the control icons on a 4K monitor but the image resolution is vastly improved over CaptureOne or PS, and it works very well as a plugin to DXO.
Regards
Paul
Logged
Paul
Pages: [1] 2   Go Up