Luminous Landscape Forum

Raw & Post Processing, Printing => Colour Management => Topic started by: sngraphics on May 13, 2013, 01:47:00 am

Title: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: sngraphics on May 13, 2013, 01:47:00 am
This topic is sort of a continuation from the previous topic: ScannerProfiling: X-Rite's i1Pro & Eye-OneMatch3 VS SilverFast's v.8 IT8 AutoCal.
What I am trying to do is provide the results from different scanner profiling softwares for anyone who is interested to download, review and hopefully post back with any comments, observations and advice.

The link to download the files is:
https://www.dropbox.com/home/Scanner%20Profiling%20Comparisons_i1Profiler1.4.2%20vs%20SilverFast8%20IT8Cal%20vs%20i1Match3

This is a screen shot of what will be included in the download.
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: sngraphics on May 13, 2013, 01:59:35 am
I tried to keep the naming scheme as consistent as possible for all parts of the tests:
1.Test Scans with Profiles Applied,  2.Profiles,  3.ScreenShots,  4.Scans of Targets no Color Management/Profile


Breakdown of Naming scheme for this Batch of tests:
130425_i1P-142 vs SF-IT8 vs i1Ma3_V750_SFv801r20_MONR20081101_CROPCCSG
• 130425 = Date: Year, Month, Day  (more for my purposes to help keep me organized after doing so many tests)
• i1P-142 = i1Profiler, version 1.4.2
• SF-IT8 = SilverFast Ai IT8 Version 8.0.1r20 (Build number: 8688) - IT8 Calibration Feature (Not Auto)
• i1Ma3  = Eye-One Match 3, version 3.6.3
• V750 = Epson Perfection V 750 Pro
• SFv801r20 = Scanning Software used - SilverFast Ai IT8 Version 8.0.1r20 (Build number: 8688)
• MONR20081101 = Target Used for this Batch of tests: IT8.7/2-1993 - MONR2008:11-01 Version2

Breakdown of Naming scheme for the Test Scans with Profiles Applied:
EG. 130425_i1P-142_V750_SFv801r20_MONR20081101_400ppi48bit_AsgnPrfl&toProPho(PERC)inSF_CCSGcropto24
• 130425 = Date: Year, Month, Day
• i1P-142 = i1Profiler version 1.4.2
• V750 = Epson Perfection V 750 Pro
• SilverFast Ai IT8 Version 8.0.1r20 (Build number: 8688)
• MONR20081101 = Target Used: IT8.7/2-1993 - MONR2008:11-01 Version2
• 400ppi48bit = Scanned at 400ppi at Bit Depth of 48
• AsgnPrfl&toProPho(PERC)inSF = Scanner Profile assigned and image converted to ProPhoto in SilverFast using Perceptual Rendering Intent.
• CCSGcropto24 = Target that was used for the test scan. (Tests actually used entire CCSG but had to crop it to make it easier for upload & download.)


The tests performed in this first "Batch" of tests had SilverFast Assigning the profile and converting to ProPhoto.
Below is a screen shot of settings used for all tests.
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: sngraphics on May 13, 2013, 02:20:12 am
Notes.
- From what I've seen, assigning the profile and converting to ProPhoto in SilverFast produces the same results as doing this manually in Photoshop.
(that's why I included a "RAW" scan with no Color Management/Profile so you can try to apply the profile on your own and compare with what SilverFast does)
- Using Eye-One Match 3 & SilverFast IT8 Cal. produces areas that completely jump out of the ProPhoto space. (esp. SF IT8)
Is this correct, useful, detrimental?
- I will be posting more "Batches" of tests using different Targets (Wolf Faust & CCSG) and using Epson Scan instead of SilverFast.
(That's the reason that folder #3 with the screen shots was included. To show comparisons of the results in
i1Profiler and SilverFast IT8 Cal when the profile was created. This is more so to compare the different targets used.)


If anyone has any questions about the naming scheme or has any troubles downloading the files please don't hesitate to post your questions or write to me directly.


Screen shot of settings used in SilverFast when scanning the targets to make the profiles. (with no Color Management)
Also same settings for scan(s) provided in folder "4.Scans of Targets no Color Management/Profile"
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: Mark D Segal on May 13, 2013, 09:20:17 am
This topic is sort of a continuation from the previous topic: ScannerProfiling: X-Rite's i1Pro & Eye-OneMatch3 VS SilverFast's v.8 IT8 AutoCal.
What I am trying to do is provide the results from different scanner profiling softwares for anyone who is interested to download, review and hopefully post back with any comments, observations and advice.

The link to download the files is:
https://www.dropbox.com/home/Scanner%20Profiling%20Comparisons_i1Profiler1.4.2%20vs%20SilverFast8%20IT8Cal%20vs%20i1Match3

This is a screen shot of what will be included in the download.


Thanks, I'd really love to download your material and examine it closely, but when I clicked on that link I got an error message from DropBox saying the folder does not exist. Grateful for your assistance with access.

Mark
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: sngraphics on May 13, 2013, 12:44:59 pm
Thanks, I'd really love to download your material and examine it closely, but when I clicked on that link I got an error message from DropBox saying the folder does not exist. Grateful for your assistance with access.

Mark

Thanks for letting me know about not being able to download.
Apologies for any inconvenience. I am a new DropBox user.

This link (hopefully) should work.
If not I'll try another method of providing the files.

I have get to this right because there will be many more files to come!

The new link is:
https://www.dropbox.com/s/o3qs2k6m3gh4tdv/130425_i1P-142%20vs%20SF-IT8%20vs%20i1Ma3_V750_SFv801r20_MONR20081101_CROPCCSG.zip
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: Scott Martin on May 13, 2013, 01:18:15 pm
It's good to see you've got that CCSG target to test with...
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: Mark D Segal on May 13, 2013, 01:28:31 pm
Thanks for letting me know about not being able to download.
Apologies for any inconvenience. I am a new DropBox user.

This link (hopefully) should work.
If not I'll try another method of providing the files.

I have get to this right because there will be many more files to come!

The new link is:
http://db.tt/2BWKdlL5

You got it - the new link worked. Not via Dropbox as far as I could see, but perhaps in the background. Anyhow, it simply downloaded everything into a zip archive that I was able to unpack in the usual way. (Now to set aside some time to study what you did. It will be a while.)
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: sngraphics on June 03, 2013, 05:51:59 am
This post includes the files for the second set of tests that were done.
https://www.dropbox.com/s/dfx3xdqm9cgmhd8/130426_i1P-142%20vs%20SF-IT8%20vs%20i1Ma3_V750_SFv801r20_R120505W_CCSGcropto24.zip

Everything was done exactly the same way as the first set of tests I posted using the Monaco IT8 Target to produce the profiles.
The only difference in this set of tests is that I used a Wolf Faust IT8 Target.

Breakdown of Naming scheme for this Batch of tests is exactly the same as the first, except for the target used.
130426_i1P-142 vs SF-IT8 vs i1Ma3_V750_SFv801r20_R120505W_CCSGcropto24
•R120505W = Wolf Faust_IT8.7-2-1993 2012;05_Charge:R120505



Again I used the CCSG target as the subject matter for these tests.
The entire CCSG was used for all tests but for upload/download purposes it has been cropped to The ColorChecker 24 Patch Classic target with some extra grays included.

My "reasoning" for doing the exact same tests using a different target was:
1.) to hopefully see the consistent differences between the profiling softwares/solutions
2.) to see the difference in results between the targets (I know not related to the topic of this thread)
3.) because I had the targets, was curious and thought maybe someone else might find it interesting

Throughout all these tests please keep an eye on the "3.ScreenShots" folder.
Especially the results from i1Profiler which displays the various Delta Es.
The next set of tests where I use the CCSG as the target to create the profiles might surprise some of you with the results from i1Profiler. (sure surprised me)

Not sure how many downloads of the files have been done till now because DropBox does not show this info.
So I do hope some of you are finding this interesting enough to download and check out the files.
If anyone has, maybe they can reply here with their thoughts, observations and comments.
(It's actually kind of interesting when you drop the files in Photoshop as layers and turn them on & off)
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: Mark D Segal on June 03, 2013, 08:07:42 am
I have downloaded both sets but won't be able to review them and make comments (if any) for at least the remainder of this month due to workload. Many thanks for doing this work and sharing it - I have confidence whatever they contain will be of interest.
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: Scott Martin on June 03, 2013, 10:07:39 am
And next will you use the CCSG as the target to generate profiles?
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: Ernst Dinkla on June 04, 2013, 06:31:48 am
I have mentioned this before but it suits this thread again:
http://www.image-engineering.de/library-m/test-reports
a PDF called Color Reproduction of Consumer Flatbed scanners
shows the effect for various targets on various flatbeds.

--
Met vriendelijke groet, Ernst

http://www.pigment-print.com/spectralplots/spectrumviz_1.htm
December 2012, 500+ inkjet media white spectral plots.
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: sngraphics on June 09, 2013, 06:16:00 am
I have downloaded both sets but won't be able to review them and make comments (if any) for at least the remainder of this month due to workload. Many thanks for doing this work and sharing it - I have confidence whatever they contain will be of interest.


No problem Marc take your time on this.
I am having the same issue with time and workload.
That's the reason the posts are not coming as fast as I would have liked.
Thank you for the interest and I hope something useful can be taken away from all these tests when they are all finally posted.

Primarily this started off as a comparison of scanner profiling softwares but you can also observe the differences between all the
targets that were used and even the differences between the two different scanning softwares that were used. SilverFast and Epson Scan.

The fun part for me was when all the tests were completed, taking all of them, stacking them as layers in one Photoshop file, setting
up four eye dropper points and just turning the layers on & off to see the difference in numbers along with the visual observations.
Also comparing the profiles in ColorSync.
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: sngraphics on June 09, 2013, 06:32:04 am
And next will you use the CCSG as the target to generate profiles?

Yes Scott.
The next set of tests to be posted will be using the CCSG as the Target that helped create the profiles.
But this set of tests will only be comparing the differences between i1Profiler and i1Match because this target was not compatible with SilverFast's IT8 feature.
(at least I couldn't figure out how to get them to work together)

As I stated in my previous post now you can start to also compare the differences between the targets that were used in these tests.
To be honest I was very surprised with the results from the CCSG as compared to the other targets.
I am specifically referring to the ΔE results in i1Profiler after the profile was created.
I was a little confused why the results were so different as compared to the other 2 targets. (that's why I ran the tests over many times)
Please see the folder "3.ScreenShots" for the final results of each profile made in i1Profiler to see what I mean.
I will be posting the CCSG tests (hopefully) in the next 24hrs.
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: sngraphics on June 10, 2013, 02:30:31 am
I have mentioned this before but it suits this thread again:
http://www.image-engineering.de/library-m/test-reports
a PDF called Color Reproduction of Consumer Flatbed scanners
shows the effect for various targets on various flatbeds.

--
Met vriendelijke groet, Ernst

http://www.pigment-print.com/spectralplots/spectrumviz_1.htm
December 2012, 500+ inkjet media white spectral plots.

Thank you Ernst for these links.
I actually saw them in one of your posts earlier this year.
Very interesting! Especially the one on Consumer flatbed scanners.
Almost convinced me to give up my Epson V750 for one of those HPs.

But what this thread is about and the tests that are being posted here are specifically
about comparing scanner profiling softwares.
The links you provided (from what I read & observed) do not have too much relation
to this post and are a LOT more "scientifically" done than what I have tried here.
But very interesting none the less.
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: Ernst Dinkla on June 11, 2013, 05:06:35 am
The V750 will still do the film scans better and I expect photo scans too. The intention was to show that some scanners are more suited for reflective non-photo originals than others. In that sense it may be a better way to start with a scanner that does that job better and then profile it with CCSG and check whether that improves compared to the OEM profiling before comparing different profile creators. The other route is to start with a scanner that does photo originals best (V750 for example) and then profile with the two IT8s you have and compare again to the OEM profile before you start with comparing the different profile creators. To compare CCSG target results to IT8 target results may only show that the last is better suited for photo originals.

Bought a secondhand HP G4010 yesterday to see what it does. I will compare it to the Epson 3200 though as that one gave me better watercolor etc scans than the V700 I have here. Both straight from the box and Epson profiles. It must have to do with the sensor specification and on what Epson aimed with both.

--
Met vriendelijke groet, Ernst

http://www.pigment-print.com/spectralplots/spectrumviz_1.htm
December 2012, 500+ inkjet media white spectral plots.




Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: sngraphics on June 14, 2013, 03:04:04 am
This post includes the files for the third set of tests that were done.
https://www.dropbox.com/s/0qgi4vx2od6xowe/130426_i1P-142%20vs%20i1Ma3_V750_SFv801r20_ColorCheckerDigitalSG_CCSGcropto24.zip

Everything was done exactly the same way as the first & second sets of tests I posted using the Monaco IT8 Target & the Wolf Faust IT8 Target to produce the profiles.
The only difference in this set of tests is that X-Rite's ColorChecker Digital SG was used to help create the profiles.

Breakdown of Naming scheme for this Batch of tests is exactly the same as the first, except for the target used.
130426_i1P-142 vs i1Ma3_V750_SFv801r20_ColorCheckerDigitalSG_CCSGcropto24
•ColorCheckerDigitalSG = X-Rite's ColorChecker® Digital SG (semi-gloss)

Again I used the CCSG target as the subject matter for these tests.
The entire CCSG was used for all tests but for upload/download purposes it has been cropped to The ColorChecker 24 Patch Classic target with some extra grays included.

As I asked earlier, please see the results (in the "3.ScreenShots" folder) from i1Profiler
which displays the various Delta Es and compare to the results from the 1st & 2nd tests.
Not sure why there was such a difference in numbers.
I asked X-Rite about this. They didn't really get into it.
Just told me that the CCSG was not originally/specifically designed to be used for profiling scanners just cameras.
They also mentioned some changes coming to scanner profiling in i1Profiler in the next update of v1.5!?!?

The next set of tests will use Eye-One Match and the i1 Scan target 1.4.
These will be the last of the reflective tests using SilverFast as the scanning software.

Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: Scott Martin on June 17, 2013, 10:12:52 am
Just told me that the CCSG was not originally/specifically designed to be used for profiling scanners just cameras.

Sure, but that doesn't mean that it's not excellent for scanner profiling. The patches represent a much more saturated sampling of colors than film based targets, and thus help characterize a larger portion of the scanner's gamut.

They also mentioned some changes coming to scanner profiling in i1Profiler in the next update of v1.5!?!?

HutchColor HCT target support would be nice wouldn't it?
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: Schewe on June 17, 2013, 12:19:42 pm
HutchColor HCT target support would be nice wouldn't it?

Pretty sure that will happen...
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: Scott Martin on June 17, 2013, 12:28:15 pm
Pretty sure that will happen...

Those who know for sure can't say but you can read between the lines on my posts. :-]
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: Ernst Dinkla on June 17, 2013, 04:30:03 pm
Sure, but that doesn't mean that it's not excellent for scanner profiling. The patches represent a much more saturated sampling of colors than film based targets, and thus help characterize a larger portion of the scanner's gamut.

HutchColor HCT target support would be nice wouldn't it?

The HutchColor target has a wider gamut as I understand it but relies on the usual 3 photo dyes. The CCSG is based on more pigments/colorants. There is more to it like the white reflectance and neutrality of the base;

http://stephenstuff.wordpress.com/2011/09/30/targets-for-camera-profiling/


--
Met vriendelijke groet, Ernst

http://www.pigment-print.com/spectralplots/spectrumviz_1.htm
December 2012, 500+ inkjet media white spectral plots.

Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: Schewe on June 17, 2013, 06:05:50 pm
The HutchColor target has a wider gamut as I understand it but relies on the usual 3 photo dyes.

Yes, but as they are made on Fuji Velvia the added gamut really helps when making profiles for film scanners. Kodak's old Q60 targets ended up deflating the gamut of the resulting profile.
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: darlingm on June 18, 2013, 02:19:30 am
Those who know for sure can't say but you can read between the lines on my posts. :-]

I still don't get why ProfileMaker has more flexibility.  Think they'd have the source code around still...
Title: Re: Scanner Profiling Comparisons: i1Profiler1.4.2 vs SilverFast8 IT8Cal vs i1Match3
Post by: Ernst Dinkla on June 18, 2013, 06:38:49 am
Yes, but as they are made on Fuji Velvia the added gamut really helps when making profiles for film scanners. Kodak's old Q60 targets ended up deflating the gamut of the resulting profile.

Velvia ..., I got the impression that it was about (Camera) reflection targets, in this thread and in the link I gave for the targets specifications/measured data. There is a difference between the HutchColor Fuji and Kodak IT8 reflective targets, where the gamuts shift a bit to one another, the Fuji has a wider dynamic range and the Kodak has a more neutral base

That the HutchColor target adds in covering the scanner gamut is an advantage, I do not disagree. Both for film and photo scanning but less usable for non-chromogenic dye originals like watercolor - gouache - acrylic paintings etc. So I think that X-rite has a point in their statement that the CCSG target is not for scanners but for cameras given the higher number of pigments used in that target. Though they could have added that they see scanner spectral sensitivity in general aimed at photo scanning (and film) and most scanners are like that. But not all like I showed in another link. If this thread has the intention to show what the best calibration could be for a photo/film scanner then the use of the HutchColor film/photo targets would be an improvement. I am more interested in non-photo reflective scanning.

The other thread about Passport CC dual illumination profiles for camera RAW developers has some analogy with the the dual light system of the HP G4010/G4050 scanner that copes better with non-photo reflective originals. I got the HP G4010 working on an XP system, horrible HP software as usual and compared to the Epson 3200 (Epson driver + its OEM ICC profiles included) it does a better color fidelity job on a variety of silkscreen ink sampling sheets, watercolor art, inkjet prints. Better at separating primrose/golden yellow but slightly worse on the red tonalities, on the rest of the hues better, much better on gold samples, fluorescent colors but failing on silver in another way than the Epson did.  It is very slow though. The theory that the metameric failures between two illumination conditions nail the colors better than with one illumination condition seems to be correct. It would not surprise me if the dual illumination DNG profile has that effect too for similar reasons. Which would raise the question how one could improve upon that with a target with more basic pigments than the passport target has for camera DNG profiles.

Doing a dual illumination DNG profiling job for the G4010 scanner would ask for way more (software and/or hardware) hacking. An extra custom ICC profile on top may or may not improve upon the HP engineer's work done. The G4010 scanner at least activates fluorescents so in that case UV-enabled is sensible. Given the way the G4010 copes with fluorescents I could add samples of them too but the Eye 1 Pro may activate them differently than the two CCFL's of the scanner do. ArgyllCMS allows the creation and use of custom targets with multiple pigments for ICC profiling but it is a lot of work.

--
Met vriendelijke groet, Ernst

http://www.pigment-print.com/spectralplots/spectrumviz_1.htm
December 2012, 500+ inkjet media white spectral plots.