Luminous Landscape Forum

Raw & Post Processing, Printing => Colour Management => Topic started by: rasworth on March 06, 2019, 02:30:43 pm

Title: Comparing printer profiles neutral output
Post by: rasworth on March 06, 2019, 02:30:43 pm
I'm the proud owner of three printer profiles, for the same printer/paper combination, all generated by i1Profiler using the same spectro and parameter settings.  One is a year old, done with an i1Profiler 905 auto generated patch set, the other two were created recently using patch sets from Doug Gray, from his "... Optimal Profile Patch Sets" thread.

Test prints from the three profiles all appear identical to me, paying particular attention to the neutrals.  I came up with the following methodology to wring out some quantitative data without further printing:

1. Use a 33 step R=G=B image, from 0-0-0 to 255-255-255 in equal steps, in the ProPhoto color space.

2. Do an absolute convert in Photoshop for each of the three printer profiles, ending up with RGB triplets representing the raw data input to the printer for each step.

3. Arbitrarily assign the printer profile from the first set to the other two, retaining the RGB values and providing a means of visual comparison.

4. Paste all three images together.

Attached is the result, with the printer profile embedded in the image.  One can download and compare the actual profile outputs to the printer, as long as there is no conversion to another color space.  The colors of the patches have no significance, other than to provide a visual comparison of the RGB values.  In an ideal world I believe the outputs for each horizontal patch set should be equal, obviously they vary.  Without further printing and measurement I can't state which is the most accurate profile.  One conclusion is I'm probably not very good at judging test prints, particularly for the 376 patch profile there are some significant output differences.

The test prints were all done with relative rendering intent and black point compensation turned on - a question for the members is would this tend to hide output differences, or is the absolute output a valid comparison technique for visual results?

Richard Southworth
Title: Re: Comparing printer profiles neutral output
Post by: Mark D Segal on March 06, 2019, 03:41:18 pm
For a rigorous proofing exercise, where you are measuring the accuracy of printed values relative to file values, you should print with Absolute Rendering Intent. For a visual exercise where the objective is to see which solution "looks better", you would want to evaluate it using the same parameters you use for printing regular photos, so if that happens to be Relative Intent with BPC, you would use those settings for printing and viewing these patches.

If the objective is to visualize neutrality (or measure for neutrality), then of course colour matters, because the colour needs to be a*0 b*0 for the patch to look or print neutral. In your sample, the far right (376 patches) is less consistently neutral than the other two and the differences are visible, and confirmed running the Eyedropper down the strips.
Title: Re: Comparing printer profiles neutral output
Post by: Doug Gray on March 06, 2019, 04:08:48 pm
The profile attached to the images has numerous, bad patch reads in the 905 patch profile data. Lot's of black patches where there should be different colors.

Try this. Drag the profile (make sure you use exactly the same one you attached to the image) into the "Measurement" box in I1Profiler. It will populate the display with measured data just like you had finished scanning the targets. Look at the second page. If you make a profile from the data, the gamut plot it shows will have big holes punched in it. Printing any sort of normal color image should produce really awful prints.

Aside from that, the 905 patch profile's neutral axis shows more variation than I see from the Pro1000.

To get meaningful data from assigning a profile to an image in device space, you should use a gold standard profile otherwise you are just adding errors from both the source and destination profiles. Sometimes they cancel, but usually they magnify.

The tone curve seems way off. Convert the image back to ProPhoto and compare the rgb/Lab values. Way off.

Best way to evaluate a profile is to print the patches using Abs. Col. and read them with a I1Pro 2 using "Measure Chart" in I1Profiler. Save the Lab values and compare them to the Lab values you read out from the original ProPhoto image.

Title: Re: Comparing printer profiles neutral output
Post by: rasworth on March 06, 2019, 04:46:57 pm
I obviously did a poor job of explaining what I was trying to accomplish.

Mark,
I was trying to compare the absolute rendering output of the three profiles, the raw printer input rgb values for each patch.  The chart provides a quick visual check of equality across a horizontal set, without having to eyedrop for actual rgb values, otherwise the "colors" are meaningless.  Sorry, won't try that approach again.

Doug,
The profile works well in practice, without numerous black holes in the scanned target data.  Something must have been lost in translation.  I did as you suggested to check.  And I do understand that actual measurements are needed to show accuracy, I was attempting to find a means of comparing profile absolute neutral output variation, nothing more.

The original input image used in the absolute rendering conversion is attached.

Richard Southworth
Title: Re: Comparing printer profiles neutral output
Post by: rasworth on March 06, 2019, 05:05:20 pm
Doug,
Attached are the three profiles I used for the comparison.  Two of them were made with your cgats data.
Richard Southworth
Title: Re: Comparing printer profiles neutral output
Post by: Doug Gray on March 06, 2019, 06:35:19 pm
Doug,
Attached are the three profiles I used for the comparison.  Two of them were made with your cgats data.
Richard Southworth

Looking at the gamuts in PM5, the one from your 905 patch set matches reasonably closely with the two from my RGB sets. But there's something weird about the data in the profile. It's got a bunch of patches that are near black but shouldn't be. You should be able to replicate it by the following.

Open up I1Profiler. Drag the RAS_Pro100_CanonSemiGloss_Qual1_Cut_3-28-18.icc onto the "Measurement" tab. Go to the test chart and set the spacings the same as when you printed the target. Then go back to the measurement tab. Notice all the weird black readings.

The really odd thing is that the spectral data stored in the profile is what's corrupted. The profile appears to be fine. This would likely show up if you used the profile, since it contains the spectral data, to make a new profile with different settings. This is commonly done to try out the various perceptual intents, Contrast, Saturation, Neutralize gray. If you make a new profile from it it will be really bad!  Looks like some obscure bug in I1Profiler but I've never seen this occur and I've made a large number of profiles as well as used saved data in profiles to make new ones to test out the above.

Here's a screen capture of what I see. You should be able to duplicate what I see.

Title: Re: Comparing printer profiles neutral output
Post by: rasworth on March 06, 2019, 08:10:50 pm
Doug,

Mea culpa.  Not only are the invalid patches in the profile metadata, there also in my saved measurement data.  I counted 14 of them, scattered randomly thru the pages (see attachments).  I can only assume I had a bad day.  The profile was created a year earlier, couple of iProfiler versions ago, but I can't think of any mechanism whereby the invalid patches weren't included in the construction.  Perhaps i1Profiler is "smart" enough to discard?  And there is also the question as to why i1Profiler didn't flag the bad measurements during scanning.

I checked the other 20 measurement sets, including the two done with your cgats files, and didn't find another instance.  I'll use your 8/7 890 patch version for future printing.

Thanks for being vigilant,

Richard Southworth
Title: Re: Comparing printer profiles neutral output
Post by: rasworth on March 06, 2019, 08:41:00 pm
The mystery deepens, but I don't feel quite as incompetent.

I stuck the dongle into the pc and ran another profile with the suspect profile measurement data from a year ago.  Bad output, see attached ColorThink screenshot.  The stock profile does not look like this, even though it contains the invalid patches in the metadata.

So how can I have both bad measurement data and bad profile metadata and still have a viable profile?

Richard Southworth
Title: Re: Comparing printer profiles neutral output
Post by: Doug Gray on March 06, 2019, 09:29:51 pm
The mystery deepens, but I don't feel quite as incompetent.

I stuck the dongle into the pc and ran another profile with the suspect profile measurement data from a year ago.  Bad output, see attached ColorThink screenshot.  The stock profile does not look like this, even though it contains the invalid patches in the metadata.

So how can I have both bad measurement data and bad profile metadata and still have a viable profile?

Richard Southworth

I don't see any way this could be something you did Richard. Scanned patch values look fine except for those occasional bad patches and they don't look like operator error or instrumentation issues. They smell like I1Profiler software bugs. The fact that the original profile does not reflect the saved spectral data is a very strong indicator of software problems.

I'm starting to appreciate my workflow more. I scan targets in both forward order and reverse as well. The charts I print have registration bars on both ends of the paper so it can be fed in from the top or bottom. So, for the second pass, I feed the paper in flipped around and go from the last page to the first. This results in a second CGATs file that is, if everything is working, exactly the same except everything is reversed. Then my Matlab script just reverses the latter and averages as well as compares the results for consistency.
Title: Re: Comparing printer profiles neutral output
Post by: Doug Gray on March 07, 2019, 01:49:35 am
I find this image handy for checking neutral tones with a handheld spectro. It's in 16 bit ProPhoto RGB and it has L* steps 0,1,2,3...99. Each row starts at increments of 10. It's in 10mm squares, high precision and the L* values are accurate to well under 0.1, typically less than +/- 0.02. Photoshop throws away the LSB of 16 bit images.

Print it using Absolute Colorimetric. It's best to set the color settings: Edit->Settings->Use Dither otherwise photoshop will round the RGB values to 8 bits when using Windows. However, even with 8 bits the rounding error is small and a* and b*, which are more important perceptually are not affected.

Title: Re: Comparing printer profiles neutral output
Post by: Alan Goldhammer on March 07, 2019, 09:17:44 am
I find this image handy for checking neutral tones with a handheld spectro. It's in 16 bit ProPhoto RGB and it has L* steps 0,1,2,3...99. Each row starts at increments of 10. It's in 10mm squares, high precision and the L* values are accurate to well under 0.1, typically less than +/- 0.02. Photoshop throws away the LSB of 16 bit images.
I'm only using Argyll freeware to do things.  I can print out a 100 step B/W patch set using appropriate commands.  I just checked RGB values in Photoshop for some random patches and they look OK.  Can such a test chart be used in the same manner as you describe for iProfiler?
Title: Re: Comparing printer profiles neutral output
Post by: Doug Gray on March 07, 2019, 10:40:48 am
I'm only using Argyll freeware to do things.  I can print out a 100 step B/W patch set using appropriate commands.  I just checked RGB values in Photoshop for some random patches and they look OK.  Can such a test chart be used in the same manner as you describe for iProfiler?

For neutral tracking, I use a patch set of 95 neutrals, repeated 9 times then randomized. For the highest precision, I've found it necessary to randomize patches as the values have some degree of printed location sensitivity. Repeating each patch 9 times provides much improved statistics, and reduces the standard deviation of the mean by about a factor of 3.

This was all well below anything I could see. At the time I was making specialized charts and was focusing on repeatability.

Unfortunately, while such a chart is great for fine tuning where I needed to add additional, fine grain near neutrals to a target, it is not useful for a visual check.

The 10x10 neutral Lab image is a good, fast, visual check and it can be easily measured with a hand spectro. One can do the whole set or just measure every 5th or 10th value and plot it for faster results. I don't use it that often but it's great for things I don't have a profile for and/or the iSis can't scan like really thick media or canvas..
Title: Re: Comparing printer profiles neutral output
Post by: rasworth on March 07, 2019, 10:41:04 am
Doug,

Downloaded the test chart, printed absolute using profile created with your 8/7 patch set, and drying.

Couple of questions,

1. Is it practical to include patch separation lines?  Hard to distinguish individual patches, particularly in the darker tones.

2. Since I'm lazy, how about in scannable form, patches sized for i1Pro?  Who says beggars can't be choosers.

Thanks again for your help,

Richard Southworth

Added by edit - Just read your last post, I assume the separation lines would mess up the visual check, never mind.
Title: Re: Comparing printer profiles neutral output
Post by: Stephen Ray on March 07, 2019, 11:07:32 am
the iSis can't scan like really thick media or canvas.
I know those who use the iSis to scan canvas often. Can you elaborate?
Title: Re: Comparing printer profiles neutral output
Post by: Doug Gray on March 07, 2019, 11:39:40 am
I know those who use the iSis to scan canvas often. Can you elaborate?
The only canvas I use is rolls on the 9800. I briefly tried running iSis targets for it but found significant errors. Crosstalk from neighboring patches. I use a chart with registration bars on the top and bottom so I can feed the paper in bottom first to make a second data set then compare them for errors. Chalked it up to registration issues due to its stretchiness. Since I wasn't using canvas for high accuracy technical chart work, and found the Epson canned profiles quite good, I didn't pursue it. However, I only tried the 6mm patch size.
Title: Re: Comparing printer profiles neutral output
Post by: Doug Gray on March 07, 2019, 11:44:25 am
Doug,

Downloaded the test chart, printed absolute using profile created with your 8/7 patch set, and drying.

Couple of questions,

1. Is it practical to include patch separation lines?  Hard to distinguish individual patches, particularly in the darker tones.

2. Since I'm lazy, how about in scannable form, patches sized for i1Pro?  Who says beggars can't be choosers.

Thanks again for your help,

Richard Southworth

Added by edit - Just read your last post, I assume the separation lines would mess up the visual check, never mind.

I don't have such charts Richard. I've found it necessary to scramble patches for the I1Pro as it seemed to have a hard time with small changes in adjacent patches. Since I prefer scrambled patches and have the software such that descrambling is automatic, I really haven't pursued it. Been a long time though and it may well be possible with the I1Pro2 and current software.
Title: Re: Comparing printer profiles neutral output
Post by: rasworth on March 07, 2019, 11:56:21 am
Test print (dye inks, Pro 100, Canon semi-gloss) probably hasn't dried long enough for accuracy, but I decided to run a set.  Again the test was using an i1Profiler profile based on Doug's 8/7 890 patch set.

I1Pro uv cut, spot measurements, down the +4 column:
 
L*in            L*        a*         b*

 4            5.35      0.17     -1.67
14          13.57     0.15     -0.55
24          23.02     0.12     -0.41
34          33.00     0.66     -0.45
44          43.69     0.51     -0.33
54          53.94     0.18      0.06
64          64.01     0.09     -0.01
74          74.27     0.29      0.26
84          84.91     0.29     -0.02
94          94.75    -0.07     -0.70

So what is "goodness"?  Visually I don't see any tint.

Richard Southworth

Added by edit - Sheet of same paper under test print during spot measurements.
Title: Re: Comparing printer profiles neutral output
Post by: Mark D Segal on March 07, 2019, 12:34:03 pm
Test print (dye inks, Pro 100, Canon semi-gloss) probably hasn't dried long enough for accuracy, but I decided to run a set.  Again the test was using an i1Profiler profile based on Doug's 8/7 890 patch set.

I1Pro uv cut, spot measurements, down the +4 column:
 
L*in            L*        a*         b*

 4            5.35      0.17     -1.67
14          13.57     0.15     -0.55
24          23.02     0.12     -0.41
34          33.00     0.66     -0.45
44          43.69     0.51     -0.33
54          53.94     0.18      0.06
64          64.01     0.09     -0.01
74          74.27     0.29      0.26
84          84.91     0.29     -0.02
94          94.75    -0.07     -0.70

So what is "goodness"?  Visually I don't see any tint.

Richard Southworth

Added by edit - Sheet of same paper under test print during spot measurements.

From the point of view of "tint" goodness is those numbers you report. This is really good performance. One wouldn't expect to see a tint based on that data.
Title: Re: Comparing printer profiles neutral output
Post by: rasworth on March 07, 2019, 12:52:47 pm
Mark,

Thanks for the input, good to know.

Someday I'll run the 10/9 1764 patch set, 5 letter size sheets with an i1Pro is no fun.  Is there anything between the i1Pro and i1iSis to facilitate this process?  I'd love to have one of the latter, but there's no way I can justify, and its purchase would probably initiate divorce proceedings.

Richard Southworth
Title: Re: Comparing printer profiles neutral output
Post by: Doug Gray on March 07, 2019, 12:55:57 pm
From the point of view of "tint" goodness is those numbers you report. This is really good performance. One wouldn't expect to see a tint based on that data.

Yep, you won't see tint with those numbers. The only place a* and b* get  slightly high are at L=4 and 94. This is normal because you are near the black point and white point. You will get increasing deviations at lower and higher L* but mostly in the L* itself.  Normal and unavoidable. Rel Col doesn't have this at the high end and Re. Col. with BPC doesn't have this across the full range since these track against the paper's white point. IT is, however, harder to get a good metric because spot readings don't directly correlate. You have to scale the readings against paper white.

The numbers are consistent with what I see on the Pro1000 as well.
Title: Re: Comparing printer profiles neutral output
Post by: Mark D Segal on March 07, 2019, 12:59:56 pm
Mark,

Thanks for the input, good to know.

.............  Is there anything between the i1Pro and i1iSis to facilitate this process?  ...............

Richard Southworth

None that I know of.
Title: Re: Comparing printer profiles neutral output
Post by: John Nollendorfs on March 07, 2019, 10:00:25 pm
You can buy a z3200 from B&H for $2499 that has a built-in i1 spectrometer. You get an automated spectrometer and great printer at 1/2 the price of automated i1!!!

Sent from my XT1575 using Tapatalk

Title: Re: Comparing printer profiles neutral output
Post by: howardm on March 08, 2019, 06:48:02 am
Consider 'used'.  I got an iSis for $1k recently (not an XL but I don’t really care about that) on the auction site.

The only issue is that it doesn't like really thick overly textured fineart paper (I forget the specification right now).

What WAS odd is that I still needed to have my i1Pro2 plugged in in order for i1Profiler to be 'licensed' to make/save
the profile.  You woulda thought buying an iSis would 'include' that.


Mark,

Thanks for the input, good to know.

Someday I'll run the 10/9 1764 patch set, 5 letter size sheets with an i1Pro is no fun.  Is there anything between the i1Pro and i1iSis to facilitate this process?  I'd love to have one of the latter, but there's no way I can justify, and its purchase would probably initiate divorce proceedings.

Richard Southworth
Title: Re: Comparing printer profiles neutral output
Post by: Alan Goldhammer on March 08, 2019, 07:16:18 am
For neutral tracking, I use a patch set of 95 neutrals, repeated 9 times then randomized. For the highest precision, I've found it necessary to randomize patches as the values have some degree of printed location sensitivity. Repeating each patch 9 times provides much improved statistics, and reduces the standard deviation of the mean by about a factor of 3.
I don't think Argyll can do repeated patch sets.  Normally when I profile I print out random patch sets and do two readings, reversing the direction of each line reading and then averaging.  This approach gives good consistency.  I could to the same thing with the B/W neutral set but of course that would give only two readings.
Title: Re: Comparing printer profiles neutral output
Post by: Doug Gray on March 08, 2019, 10:09:23 am
The only issue is that it doesn't like really thick overly textured fineart paper (I forget the specification right now).

What WAS odd is that I still needed to have my i1Pro2 plugged in in order for i1Profiler to be 'licensed' to make/save
the profile.  You woulda thought buying an iSis would 'include' that.
Nope, it sure doesn't include I1Profiler! I almost didn't buy the iSis because XRite didn't include an I1Profiler license with it. Further investigation showed that a license for another spectro product was all that's needed.

The iSis comes with an I1Profiler disk you can install (or just download from the website). Without a license you can make charts, print, scan, and save CGATs files which you can then process with Argyll.

But you can also use a prior product's I1Profiler license. I have two. The one from I1Pro 2 Publish and an older one from ProfileMaker 5. The latter is embedded in a dongle and is a full license (including CYMK). The former requires the I1Pro 2 is plugged in and is fully licensed for RGB stuff.

It seems weird to me as well that XRite doesn't automatically include an I1Profiler license with their premier spectro. Possibly it's because the iSis is used with other company's profiling products, perhaps using rips. But who knows!
Title: Re: Comparing printer profiles neutral output
Post by: rasworth on March 08, 2019, 10:17:47 am
Once again I've hijacked my own thread, but I'd like to go a little further on the validating profiles theme.

I printed a synthesized color checker, courtesy of Bruce Lindbloom (embedded Lab profile), thru the Doug Gray 8/7 890 patch set profile, absolute rendering intent.  I then used i1Profiler with my i1Pro uv cut to spot measure the 24 patches and compare against the original image (see attached image).  The results were favorable, although I should calculate delta e's to be rigorous.

Two questions:

1. Are these 24 patches sufficient to validate the profile color accuracy?

2. How can I semi-automate this process?  I do have a working copy of ProfileMaker, as I remember it has additional tools.

Richard Southworth
Title: Re: Comparing printer profiles neutral output
Post by: howardm on March 08, 2019, 10:30:20 am
I think they're just being greedy #$^%&   ;)

The i1Pro1/2 seems like it's more 'supported' in non-XRite products than the iSis.

And the dongle will cease to work on the next MacOSX release, right?
Title: Re: Comparing printer profiles neutral output
Post by: Mark D Segal on March 08, 2019, 11:23:56 am
Once again I've hijacked my own thread, but I'd like to go a little further on the validating profiles theme.

I printed a synthesized color checker, courtesy of Bruce Lindbloom (embedded Lab profile), thru the Doug Gray 8/7 890 patch set profile, absolute rendering intent.  I then used i1Profiler with my i1Pro uv cut to spot measure the 24 patches and compare against the original image (see attached image).  The results were favorable, although I should calculate delta e's to be rigorous.

Two questions:

1. Are these 24 patches sufficient to validate the profile color accuracy?

2. How can I semi-automate this process?  I do have a working copy of ProfileMaker, as I remember it has additional tools.

Richard Southworth

Question 1 is something we'd have a real hard time knowing, because an image could be reproducing a huge number of unique colours (10,000s, 100,000s) and who's to say on the basis of a comparatively small sample size how large a sample is enough to represent the population. We can infer from industry practice and from our own testing how many patches, and at least as important of what values, we believe to be adequate for practical purposes. The 24 colours in the ColorChecker are really very well chosen and this tool has survived over many years; their overall gamut is usable for a large variety of inkjet papers without incurring OOG colours. There are industrial users who consider this target sufficient for various purposes. But the industry standards these days for control strips used in printing press quality/consistency control range from the 48 patches of the Barbieri strip, to the 77 of IdeAlliance. I was curious about the impact on dE readings of using a wider (but still in-) gamut patch set for high quality luster/gloss papers and constructed such sets as demonstrated in my article about Stress Testing the Printer Workflow on this website. I found that the average dE readings were a bit higher compared with the standard ColorChecker set, but not that far off. So again, the number of patches didn't differ, but the "gamut reach" did. I also have unpublished results for a 48 patch set I constructed which show similar outcomes. When you find that you're dealing in average dE outcomes of less than 1.0~1.5 (say dE76 which makes no adjustments for the non-linearity of human visual perception) and the standard deviations around the mean are small, whether these results are a little more or a little less it really doesn't matter much for a good many photographic purposes.

I have no views on your second question - I don't know.
Title: Re: Comparing printer profiles neutral output
Post by: rasworth on March 08, 2019, 04:52:03 pm
Mark,

I read "Stress Testing the Printer Workflow", found it to be very instructive.  I noticed your profiles were constructed using 1877 and 2371 patch sets.  Has your work provided insight into loss of output accuracy vs. decreasing patch set size?  I wonder if accuracy falls off proportionally, or is there some sort of "knee" based on the printer behavior?

Again, thanks for all your help, has aided me in gaining color management knowledge.

Richard Southworth
Title: Re: Comparing printer profiles neutral output
Post by: Mark D Segal on March 08, 2019, 05:05:17 pm
You are welcome Richard.

Between the 1877 and 2371 I found the latter performed slightly better on grayscale neutrality. Otherwise quite similar. I haven't tried correlating patch set size with dE results. Not enough data pairs to make it statistically useful.
Title: Re: Comparing printer profiles neutral output
Post by: GWGill on March 09, 2019, 02:18:03 am
I don't think Argyll can do repeated patch sets.
You could certainly edit together multiple .ti1 files if you really wanted to do this...