Luminous Landscape Forum

Equipment & Techniques => Mirrorless Cameras => Topic started by: kpz on December 10, 2018, 05:09:13 pm

Title: How good is raw conversion for X-trans files these days?
Post by: kpz on December 10, 2018, 05:09:13 pm
[Alternative thread title: "Talk me out of buying an XT-3"]

I'm considering purchasing an XT-3, however the one big holdup I have is the quality of the raw conversion software for X-trans files. This unique design seems hard to process, to the point where I'm not sure it's worth dropping a bunch of money on a camera system if the resulting raw files are inherently compromised. (I don't shoot .jpeg.)

Some Google searching reveals that, at least circa 2016, Lightroom's demosaicing process produced wormy artifacts (e.g. in foliage and bricks) and the application generally did poorly with X-trans files. None of the updates since then seem to have changed anything here, though I'm happy to be corrected on this point.

Other options I've looked at include Capture One and Iridient Developer (or using X-Transformer to convert the raw files to .dng and opening them in LR). I have little experience with these, though if I were certain using them would eliminate any difficulties with artifacts I could be convinced to purchase one. (Why drop thousands of dollars on a camera system and cheap out on post-processing?)

So: have there been any image quality comparisons done with these raw converters recently (say, the last 1-2 years)? I'm particularly interested in comparisons to other 24MP crop Bayer sensor cameras where foliage or other potentially artifact-inducing subjects are present.

(A related question: in LR apparently one cannot remove the lens profile embedded in Fuji raw files, which is limiting for e.g. wide angle lenses and other situations where the distortion/vignetting/additional pixels may be preferred. Is C1 more flexible?)

I'm also open to any suggestions and comments you might have, as I am a relatively novice photographer. I don't do any sports or wildlife, or anything else that would demand long focal lengths or top of the line autofocus. And reviews of the Fuji bodies and lenses seem quite complimentary. I just can't get over my worry about raw conversion. Hence the request for images ("seeing is believing").
Title: Re: How good is raw conversion for X-trans files these days?
Post by: Dan Wells on December 10, 2018, 08:17:10 pm
Excellent - if you use X-Transformer or C1, I think X-Trans is an advantage over Bayer. Even the latest version of Lightroom's native conversion is much improved. It is slower to convert than other formats.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: BAB on December 10, 2018, 08:23:13 pm
Great Question


Most all of your worries are not present any longer, their might be the occasional lighting situation where the wormy as you call it might show up but its more of the look of the file. I have been using Iridient and it cleans the files like magic some use capture one I don't see the need. Iridient to LR to PS and maybe depending of the files Imagenonic for noise at its default. Then Topaz for detail and maybe seldom NIK (because I have other actions in PS that I like better) and you get a really clean image. Rent a X-T3 and the 56mm and go shoot a couple hundred images then you can play with the files ala trial on most platforms.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: kimballistic on December 10, 2018, 10:37:27 pm
X-Trans is a first-class citizen in Capture One and most other raw developers.  Not so much in ACR/Lightroom: Adobe still admits there is a problem and they are "working on it."  I emailed a few public figures at Adobe about their poor demosaic quality of X-Trans in late October and got this response from one of these very public figures:

Quote
"Hi Brian,
 
The product team at Adobe is aware of the issues that you mention below and is working towards a resolution. I am not at liberty however to discuss any announced products. With your permission, I will forward your email to the product team to amplify your concerns and requests."

Attached is the image I sent them, demonstrating the continued problems even with the very latest LR.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: TonyVentourisPhotography on December 10, 2018, 10:54:38 pm
I saw them with the x100f in Lightroom.  Haven’t tried xt3.  Regardless...I’ve stuck to the original Bayer x100. Xt2 had worms in lr.  If I shotvportraits primarily it would be a non issue.  But in landscape and architecture I was getting the issue constantly. 

C1 may be better.  LR hasn’t gotten much better at all.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: JaapD on December 11, 2018, 12:58:03 am
The X-trans array gives you less color artifacts, less moiré. Due to the fact that several green pixels are positioned next to each other (instead of one pixel apart with a Bayer sensor) it results in increased bandwidth. The green channel alone is responsible for 59% of the luminance (detail) content of the image.

Regards,
Jaap.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: kpz on December 11, 2018, 01:53:57 am
The X-trans array gives you less color artifacts, less moiré. Due to the fact that several green pixels are positioned next to each other (instead of one pixel apart with a Bayer sensor) it results in increased bandwidth. The green channel alone is responsible for 59% of the luminance (detail) content of the image.

Regards,
Jaap.

With all due respect, I have not seen any proof of this. It seems like Fuji marketing copy and nothing more. Even if theoretically this is the case, practically speaking the current raw converters cannot realize it and all seem more comfortable with the Bayer array.

You can see for instance some testing here where the X-trans array is essentially equivalent (if anything slightly worse) than the Bayer: https://medium.com/@nevermindhim/x-trans-vs-bayer-fantastic-claims-and-how-to-test-them-475b4f1b7fae

Further, it's subtle, but I still detect slight artifacting in the image on the left, which was done with Iridient:
https://mirrorlesscomparison.com/wp-content/uploads/2018/12/Fuji-xt3-vs-sony-a7iii-sharpness-RAW-2.jpg

(The developer notes that his hands are tied because he has to use certain premade libraries to demosaic X-trans files, or something like that.)
Title: Re: How good is raw conversion for X-trans files these days?
Post by: Paulo Bizarro on December 11, 2018, 06:05:42 am
Back in 2013 I used LR with the XE1 and XPro1, without any problems. I am sure if I had looked hard, say at 200%, I would see some artefacts. But I always had a light touch in sharpening, which seems to be one of the root causes of the complaints?

These days I am back with using Fuji X (XPro2 and XH1), and I continue to have no problems with LR.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: JaapD on December 11, 2018, 07:00:33 am
Hi KPZ,

By no means I’m falling for any kind of marketing copy or whatever. I have sufficient knowledge in sensor design and in the development of sensor based image processing pipelines, doing this for many years.

Some observations to the references you’ve provided:

The Bayer vs X-Trans test is carried out with a “Markesteijn algorithm”. How come we have never heard of this? Maybe because this very unknown algorithm might excel at some point (sharpness?) but performs below average on several other aspects (artifacts, etc).

For completeness I need to say that I read a lot of nonsense in the article such as “noise reduction baked in to the X-Trans demosaicking algorithm”. Noise reduction has absolutely nothing to do with demosaicking. Another thing I read is “false color reduction of FujiFilm’s cameras comes not from the choice of sensor CFA”. False color can ONLY come from the CFA, without the CFA the sensor is monochrome and blind for any color info. There is lot’s of more BS.

In the Iridient example I clearly see resolution differences where the X-Trans appear to be much sharper, when viewing at 100%. Also much better color separation. A find the image a bit oversharpened though, this should not have been necessary without still keeping sufficient detail.

I have much more confidence in the tests carried out by DPreview. Have a look at:
https://www.dpreview.com/reviews/fujifilm-x-t3/7


Let’s get back to some FACTS:
Fact-1: With X-trans the green pixels are positioned near each other. In theory this will give twice the spatial resolution with respect to a Bayer sensor.
Fact-2: The green channel contributes 59% to the luminance channel (Y= 0.30R + 0.59G+ 0.11B).
My conclusion: what comes out of the camera is anyway an image with an increased resolution.

Then it’s up to the RAW converter to utilize this. We all know that previous versions of Adobe RAW Converter were underperforming in this field. I believe this has been solved in the latest releases.
Additionally CaptureOne is doing a great job in getting out all details of Fuji’s RAF file while at the same time keeping aliasing under control.

In the end I do think that Fuji’s X-Trans CFA is a very clever design. For completeness I need to mention that with increasing pixel quantity the additional benefits will get smaller over time, not in the last place because the lens MTF will become the limiting factor, behaving as an optical low pass filter.

Regards,
Jaap.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: TommyWeir on December 11, 2018, 07:29:07 am
There's a wide range of great camera systems you can buy into now.   The X-T3 is certainly among them.

Use Capture One or Iridient Developer.  Both are great, C1 has a decent DAM and great editing/finishing tools, ID's raw interpretation results in slightly sharper images.   Avoid LR, though some say it has improved of late, I'd be surprised if Adobe weren't active here.  DXO software is a non-starter, won't see X-Trans files.

That's pretty well it.  There's tons of reviews out there, I don't see many saying don't buy it.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: TonyVentourisPhotography on December 11, 2018, 10:23:32 am
Also note...this is highly based on your subject matter.  There are plenty of Fuji shooters using Lightroom with no issue.  The artifacts complained about, the most offensive ones are only on specific kinds of patterns usually.  In fact, most of the time on most general subjects the files look great.  And a lot of this comes down to pixel peeping.  You most likely will see none of this in print or outside of 100% mag.  I would rent one and see if it works for you or not. 
Title: Re: How good is raw conversion for X-trans files these days?
Post by: kpz on December 11, 2018, 10:56:52 am
The Bayer vs X-Trans test is carried out with a “Markesteijn algorithm”. How come we have never heard of this? Maybe because this very unknown algorithm might excel at some point (sharpness?) but performs below average on several other aspects (artifacts, etc).

Unfortunately it was not possible to do testing with the proprietary Fuji demosaicing algorithm, as explained in that article. There is some evidence provided (see his link) that the one used is no worse, and perhaps better, than the Fuji algorithm. (I would have liked to see a comparison with Iridient myself, but he gives in a another linked article a comparison of the Markesteijn algorithm with Iridient Developer, and they are virtually equivalent.) Note also that he used a suboptimal Bayer algorithm due to the limitations of DCRaw, so if anything the test contains some bias towards the X-Trans array.

Quote
For completeness I need to say that I read a lot of nonsense in the article such as “noise reduction baked in to the X-Trans demosaicking algorithm”. Noise reduction has absolutely nothing to do with demosaicking.

In the context of that paragraph, it is clear he is talking about the entire Fujifilm in-camera image processing system.

Quote
Another thing I read is “false color reduction of FujiFilm’s cameras comes not from the choice of sensor CFA”. False color can ONLY come from the CFA, without the CFA the sensor is monochrome and blind for any color info. There is lot’s of more BS.

Again, he is clearly discussing in-camera processing.

Quote
In the Iridient example I clearly see resolution differences where the X-Trans appear to be much sharper, when viewing at 100%. Also much better color separation. A find the image a bit oversharpened though, this should not have been necessary without still keeping sufficient detail.

I believe both were converted using the default Iridient Developer settings. My suspicion is that it's a demosaicing issue, not a sharpening issue per se. In any case, if even the best raw developer on the market can't get foliage quite right out of the box, as a matter of practical workflow that is not too encouraging. (Especially given the developer himself admits there are inherent limitations in his ability to demosaic X-Trans files, cf. the comment about libraries earlier.)

Quote
I have much more confidence in the tests carried out by DPreview. Have a look at:
https://www.dpreview.com/reviews/fujifilm-x-t3/7

I see a lot of Adobe samples and then a C1 noise test. We have already established that LR/ACR should not be used with X-trans files, so the Adobe samples are uninformative. And noise is not really my concern. So I am not sure what this link is supposed to show.

Quote
Let’s get back to some FACTS:
Fact-1: With X-trans the green pixels are positioned near each other. In theory this will give twice the spatial resolution with respect to a Bayer sensor.
Fact-2: The green channel contributes 59% to the luminance channel (Y= 0.30R + 0.59G+ 0.11B).
My conclusion: what comes out of the camera is anyway an image with an increased resolution.

Then it’s up to the RAW converter to utilize this. We all know that previous versions of Adobe RAW Converter were underperforming in this field. I believe this has been solved in the latest releases.
Additionally CaptureOne is doing a great job in getting out all details of Fuji’s RAF file while at the same time keeping aliasing under control.

In the end I do think that Fuji’s X-Trans CFA is a very clever design. For completeness I need to mention that with increasing pixel quantity the additional benefits will get smaller over time, not in the last place because the lens MTF will become the limiting factor, behaving as an optical low pass filter.

I agree the X-Trans array is a nice idea. Unfortunately I have not seen these theoretical benefits borne out in practice. And there are very real practical downsides, including not being able to work in LR if optimal image quality is the goal, or if one wishes to disable to the built-in lens corrections.

(I think these *can* actually be removed with some clever software, but I would need to do more work to confirm this.)

That's pretty well it.  There's tons of reviews out there, I don't see many saying don't buy it.

Strangely, none of them really talk about the raw conversion issue in depth, which makes it hard to have faith in them. This seems just as important as the sensor and available lenses from the perspective of image quality.

Also note...this is highly based on your subject matter.  There are plenty of Fuji shooters using Lightroom with no issue.  The artifacts complained about, the most offensive ones are only on specific kinds of patterns usually.  In fact, most of the time on most general subjects the files look great.  And a lot of this comes down to pixel peeping.  You most likely will see none of this in print or outside of 100% mag.  I would rent one and see if it works for you or not. 

Yeah, I am leaning this direction. It may be a compromise I can live with (just like every affordable lens ever...).
Title: Re: How good is raw conversion for X-trans files these days?
Post by: Ken Bennett on December 11, 2018, 11:13:56 am
I've been pretty much all-Fuji since 2013, and have stuck with Lightroom the whole time. 80% of my photos are fine using the Lightroom processing. The rest I send to the Iridient X Transformer from within LR, and they come back as DNG files which I can then process just like any raw file. The Iridient process does a better job with very fine detail as one might find in landscapes.

I've not seen any recent comparisons of raw converters -- LR hasn't changed in years, and I don't expect to see any serious comparisons until Adobe brings out some sort of improvement. Which, ya know, they ought to do at some point.

Title: Re: How good is raw conversion for X-trans files these days?
Post by: Chris Kern on December 11, 2018, 07:29:53 pm
80% of my photos are fine using the Lightroom processing. The rest I send to the Iridient X Transformer from within LR, and they come back as DNG files which I can then process just like any raw file. The Iridient process does a better job with very fine detail as one might find in landscapes.

Almost exactly my experience, using all three generations of X-T camera bodies, although I would guess that I'm probably satisfied 90 percent of the time with the renderings I get from the current rev of Lightroom: i.e., the desktop version, a.k.a. "Classic."  If I think I may want to print large, or crop severely, and the subject is appropriate, I fire up Iridient to coax out the finest detail, although typically the difference is only visible at 1:1 or in a large print.  I have X-Transformer configured to do demosaicing and capture sharpening, and perform other adjustments in Lightroom on the Iridient-emitted DNG.  (Aggressive sharping doesn't seem to be necessary or desirable with X-Trans files.  Assuming the original capture focus is accurate, attempting to add additional edge contrast in post is counterproductive regardless of what software you use—although the particular pathology varies with different software products.  And if the original focus isn't right, I think it's best to move on to another frame.)
Title: Re: How good is raw conversion for X-trans files these days?
Post by: rdonson on December 11, 2018, 09:17:14 pm
I've been Fuji since the X-T1 and now have an X-T2.  After taxes are calculated this year I hope to have enough left to move to the X-T3.

My experiences with the X-T1 and Lightroom weren't bad once I found that sharpening couldn't be performed in the same manner as I could with my Canon cameras.

Once I got the X-T2 I was pretty discouraged by any shot that had a lot of detail in it in Lightroom.  That's when I started looking around and went first with Iridient Developer and then Iridient Transformer for demosaicing the RAW files that required good sharpening.  Adobe worked with Fuji on improving their demosaicing according to reports and its seems better with regards to sharpness but its still doesn't compete with Iridient in my experiences. 

Thomas Fitzgerald has some good ebooks on Iridient and Fuji RAW that helped me get going. 

As usual YMMV
Title: Re: How good is raw conversion for X-trans files these days?
Post by: Kirk_C on December 11, 2018, 11:17:45 pm
[Alternative thread title: "Talk me out of buying an XT-3"]
I'm also open to any suggestions and comments you might have, as I am a relatively novice photographer.

1) Buy the XT-3 and use the included Capture 1.

2) Enjoy yourself.

It's an outstanding camera and well reviewed by every publication for a reason.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: Aram Hăvărneanu on December 12, 2018, 07:53:38 am
I use Iridient X-Transformer to convert my Fuji files to DNGs, which I then use with Adobe Products. Adobe Camera Raw does a very poor by default.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: TommyWeir on December 12, 2018, 08:34:54 am

Strangely, none of them really talk about the raw conversion issue in depth, which makes it hard to have faith in them. This seems just as important as the sensor and available lenses from the perspective of image quality.


Because the issue is largely dealt with a long time ago.  Fuji's IQ is a key selling point.  Maybe you should search older model reviews. 

If you're uncomfortable with what you're reading already, there's some excellent Nikons out there or Sonys if you want mirrorless.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: kirkt on December 12, 2018, 11:29:25 am
You can go here:

https://www.imaging-resource.com/PRODS/fuji-x-t3/fuji-x-t3A7.HTM

and download both raw and JPEG test images for the X-T3 and see how they are rendered by whatever raw converters you currently use or are considering adopting for an X-Trans workflow.  I shoot with an X-H1 and have have best results with CaptureOne and Iridient Developer.

kirk
Title: Re: How good is raw conversion for X-trans files these days?
Post by: faberryman on December 12, 2018, 11:41:36 am
I shoot with an X-H1 and have have best results with CaptureOne and Iridient Developer.
I tried Iridient and found that the results were sharper but otherwise no different than the results from LR. I prefer to control my own sharpening. I shoot a lot of landscapes with an XT2 and have never seen worms. I know that is not in line with internet chatter, but it is my experience.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: JaapD on December 12, 2018, 01:47:44 pm
I find it an incorrect way of working by starting with a lower quality RAW converter, pulling a lower MTF out of the RAW file, and afterwards applying the missing sharpness to correct this. In theory you’ll end with a noisier image as ‘sharpening’ is a high-pass convolution filter.

If you have no problems with your way of working then I have a suggestion for you: don’t invest in high quality glass, since you’re already use a less then optimal RAW converter, and apply all the missing sharpness afterwards.

This may sound a bit harsh and that is by no means my intention. My intention is to get you thinking if you’ve made the right decision for yourself. My honest opinion is to apply the best RAW converter that you can use, maximizing your investment in camera and lenses.

Regards,
Jaap.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: faberryman on December 12, 2018, 04:13:55 pm
This may sound a bit harsh and that is by no means my intention. My intention is to get you thinking if you’ve made the right decision for yourself. My honest opinion is to apply the best RAW converter that you can use, maximizing your investment in camera and lenses.
That seems to be the issue: which is the best RAW converter for Fuji files. Is Iridient really better than LR or does it just add sharpening to it RAW conversion to make it look better in a side by side. I have read some articles about the issue and of course read the internet chatter, but have never seen anything authoritative from an independent source.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: David_Hallett on December 12, 2018, 05:55:00 pm
I am still shooting an X-T10 (X-Trans 2), and experiments processing the same pictures with and without the Iridient plug-in have convinced me that for fine detail, it is definitely a little better than LR.

I don't do any sharpening with X-Transformer, because you can't undo it and I'd rather judge each shot on its merits. I just convert to DNG and do very basic processing in LR before exporting as a Smart Object to PS. which is where any sharpening is done, usually with Smart Sharpen and a mask if needed. For certain textures, such as rough stone, I've found it's possible to get more detail in PS from the files that have been processed with X-Transformer, without having to sharpen them to the point where artefacts start to appear. However, there are not many shots where the difference is important to me. YMMV, of course.

I'm told the difference with X-Trans 3 files is not as pronounced, although I've yet to test that for myself.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: Alan Smallbone on December 12, 2018, 08:23:23 pm
If you want to pixel peep then Iridient X transformer is a good choice, for a full featured editor Capture ONE is the way to go. With the latest release of Capture One, they have an agreement with Fujifilm and helped to improve the conversion and to provide the film simulations. To me that is way to go. I am not a pixel peeper, to me I edit the photo until it conveys the message I am trying to pass one. I like Capture Ones color editing features, they have layers and masks. Like anything a camera is a tool. Does it convey your message and your intent, does your processing tools help convey that message, if so then the image is done. "Best" is subjective and you need to determine what it is that matters to you. They all have trials, rent a camera, spend the time, do your due diligence and see what works for you. Not trying to sound vague but it really comes down to personal preferences.

Alan
Title: Re: How good is raw conversion for X-trans files these days?
Post by: David_Hallett on December 13, 2018, 02:48:45 am
If you want to pixel peep then Iridient X transformer is a good choice

Or if you have an established workflow with LR and PS, and don't want to abandon it, and buy and learn a new piece of software just for small details that probably don't matter much to your creative intent. That too  :)
Title: Re: How good is raw conversion for X-trans files these days?
Post by: TommyWeir on December 13, 2018, 12:20:52 pm
for a full featured editor Capture ONE is the way to go.

Yes to this.  It's fantastic.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: rdonson on December 13, 2018, 12:47:34 pm
Or if you have an established workflow with LR and PS, and don't want to abandon it, and buy and learn a new piece of software just for small details that probably don't matter much to your creative intent. That too  :)

I'm with David's thoughts. 

I use Iridient X-Transformer from within Lr.  I look at my photos and promising ones get get a round trip to X-Transformer using "Edit In"   Then I usually apply some basic Lr edits in the Develop Module and if necessary do an "Edit in" to PS. 

That's what works for me.  Of course, use whatever tools and workflow fit your desires.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: armand on December 17, 2018, 12:10:22 am
Still some issues in LR, most of the times can be minimized to the point that it doesn’t show up in print.
Haven’t had a big need to try again the other converters. I played a little with the free version of CO, it requires a steeper learning curve than I might be able to put up with.

PS. getting the colors close to the Fuji profiles used to be an issue, I think CO still didn’t have them.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: DP on December 17, 2018, 09:28:52 am
PS. getting the colors close to the Fuji profiles used to be an issue, I think CO still didn’t have them.

C1 v12 has Fuji profiles emulation, for recent cameras, based on apparently on 3 different CFA "color" types: X-H1 for all supported 24mp models, X-T3 for 26mp (only one model) and GFX 50R for all supported 50mp models
Title: Re: How good is raw conversion for X-trans files these days?
Post by: JaapD on December 18, 2018, 03:58:57 am
...... which can be found under the 'Curve' menu.

Regards,
Jaap.
Title: Re: How good is raw conversion for X-trans files these days?
Post by: armand on December 18, 2018, 03:08:37 pm
I had the v11 installed.
Just downloaded the Fuji Express 12 version and seems to be more friendly at a first look, when I get time I'll run few of the test/ problematic files through it.