Pages: [1] 2   Go Down

Author Topic: DNG Workflow  (Read 13234 times)

teddillard

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 717
    • http://www.teddillard.com
DNG Workflow
« on: October 31, 2008, 07:28:35 am »

USING.  USING dammit.  

This has come up in a few threads,  thought it might be good to devote one to the subject.  

Beyond simply using DNG files to provide a safer alternative to a proprietary RAW file, how are you using them in a workflow?  

I'm not really asking about the other DNG issues, such as adoption by the industry, etc, etc, since that has been very well addressed in other threads...  notably and recently here, by Jeff:
http://luminous-landscape.com/forum/index....showtopic=29008

...but I am very interested in the processing advantages mentioned in that thread, but not really elaborated on.  DNG does contain the "maker files", the special sauce that the camera manufacturers embed, but ACR cannot use that in most cases, and niether can the OEM software once it's in DNG.  The last I looked, other developers that embed processing data make it so that data is only readable by themselves...  (Irident, I think, was the last I looked at.)  DNG also contains a great JPEG embedded, as John's noted, but how do you use that in a systematic workflow?

I'm looking at the possibility of working with DNG files in a Smart Object workflow too, but so far just see it as another level of processing.  

Thoughts?
« Last Edit: November 01, 2008, 06:26:47 am by teddillard »
Logged
Ted Dillard

NikosR

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 622
    • http://
DNG Workflow
« Reply #1 on: October 31, 2008, 07:33:39 am »

The only use I have for DNG is when I use DxO for converting some of my images. I open the raw in DxO, process, output DNG and import than in LR. I use that workflow ONLY when what I need DxO to do is basic raw conversion + NR + geometric distortion and CA correction. Using DNG allows me the flexibility to then process the file in LR very similarly to if it were raw.

If I want to use the full DxO adjustments available I will probably opt for a DNG -> TIFF - > LR workflow.
« Last Edit: October 31, 2008, 07:48:25 am by NikosR »
Logged
Nikos

Farkled

  • Jr. Member
  • **
  • Offline Offline
  • Posts: 97
DNG Workflow
« Reply #2 on: October 31, 2008, 11:10:52 pm »

FWIW, I see no safety in DNG.  Will Canon succumb before Adobe?

I use DNG as does NilosR except that I will sometimes process quite a bit in DxO before feeding to ACR (I do no yet have LR).  I delete the DNGs when I'm done with the set.
Logged

Schewe

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 6229
    • http:www.schewephoto.com
DNG Workflow
« Reply #3 on: November 01, 2008, 01:27:17 am »

Quote from: Farkled
FWIW, I see no safety in DNG.  Will Canon succumb before Adobe?


Well, let's see...Minolta? Contax? And, if you owned one of the early Kodak cameras, Kodak has quit updating the software for processing those raw files. So, those users better hope Adobe fares better than many in the photographic industry.

BTW, I just gave away my 8x10 Polaroid processor...oh, and Polaroid will quit making film, the only one to continue will be Fuji.

So, there's no such thing as a "sure thing" except for a raw file format that is publicly documented. See, it doesn't depend on Adobe then.
Logged

ErikKaffehr

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 11311
    • Echophoto
DNG Workflow
« Reply #4 on: November 01, 2008, 01:55:31 am »

Hi,

AFAIK DNG is a pretty open format, essentially like TIFF. It conceivable that DNG would survive without Adobe. It may be slightly optimistic that Canon will support all old versions of cameras ever. Having a single format instead of many just makes things simpler for everyone.

I wouldn't say DNG is perfect, I know far to little about raw formats for that. I just hope that DNG grows into a common ground of handling raw data just like TIFF and JPEG are used for processed images.

Erik

Quote from: Farkled
FWIW, I see no safety in DNG.  Will Canon succumb before Adobe?

I use DNG as does NilosR except that I will sometimes process quite a bit in DxO before feeding to ACR (I do no yet have LR).  I delete the DNGs when I'm done with the set.
Logged
Erik Kaffehr
 

Panopeeper

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1805
DNG Workflow
« Reply #5 on: November 01, 2008, 02:18:04 am »

Quote from: teddillard
DNG does contain the "maker files", the special sauce that the camera manufacturers embed, but ACR cannot use that in most cases
ACR could use the additional information, but the basic position is, that ACR has to deliver the very same result, no matter if from the native raw file or from a DNG without any undocumented information.

Thus ACR uses only that data, which can beconverted in standard metadata, be it Exif, TIFF-EP, or DNG.

Examples:

1. WB can be converted in DNG, so ACR does make use of the WB information, even though that is undocumented,
2. contrast, sharpness, saturation can not be converted; although there are corresponding fields in Exif, they are not suitable as substitute. Thus these settings will be ignored by ACR.
3. Highlight Tone Protection (a flag in MakerNote, again undocumented) is partly supported, for the adjustment of intensity can be translated, but the initial curve change (which will be done in-camera and by DPP) can not be expressed in the standard metadata.

Quote
and niether can the OEM software once it's in DNG
If the OEM software can take advantage of the original MakerNote, then it can use it with minimal effort from the DNG file as well.

Quote
DNG also contains a great JPEG embedded, as John's noted
The Adobe DNG converter may add one or two JPEGs (one medium and one large), in addition to the thumbnail, if the respective option is selected. These are standard in TIFF, most programs can use at least one of them. For example if you open a DNG file with ACR, this preview JPEG is displayed first.
Logged
Gabor

NikosR

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 622
    • http://
DNG Workflow
« Reply #6 on: November 01, 2008, 05:24:06 am »

Just want to point out that the original question was about integrating DNG in one's workflow. Now. As it is. Not what may happen in the future. The OP explicitly pointed out that there are other threads (he also pointed to the latest) for discussion of the future of proprietary raw formats vs DNG or DNG's potential capabilities.
Logged
Nikos

NikosR

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 622
    • http://
DNG Workflow
« Reply #7 on: November 01, 2008, 05:28:27 am »

Quote from: Farkled
FWIW, I see no safety in DNG.  Will Canon succumb before Adobe?

I use DNG as does NilosR except that I will sometimes process quite a bit in DxO before feeding to ACR (I do no yet have LR).  I delete the DNGs when I'm done with the set.

You might to take a look at what DxO has to say about doing that. Take a look at my post in this thread http://luminous-landscape.com/forum/index....28285&st=20
Logged
Nikos

dchew

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1020
    • Dave Chew Photography
DNG Workflow
« Reply #8 on: November 01, 2008, 05:31:40 am »

I use DNGs in my workflow as follows:

1.  Import RAW CR2 files into LR to a WIP catalog.
2.  Rough edit, keywording and basic developing.
3.  Convert all selected, potentially usable files to DNG and export/import to my master catalog.

This way all my RAW files in the master catalog are DNGs.  If there are CR2 files in there I've screwed up somewhere or got lazy.  It's good for a part-time photographer like me who may not get to working on imported files for days or weeks after a shoot.  Keeps me organized.

So for me, the DNG format is more of a discipline thing, not so much all the reasons everyone else debates.  Although I do think there are more advantages than disadvantages to the DNG format.

Dave Chew

Logged

teddillard

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 717
    • http://www.teddillard.com
DNG Workflow
« Reply #9 on: November 01, 2008, 06:24:56 am »

thanks for the posts, keep 'em coming.  

VERY SORRY about the misspelling on the subject line, it's driving me nuts.  Any way to change it? I can't get to it via edt post.  (OCD)
« Last Edit: November 01, 2008, 06:50:23 am by teddillard »
Logged
Ted Dillard

teddillard

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 717
    • http://www.teddillard.com
DNG Workflow
« Reply #10 on: November 01, 2008, 06:38:25 am »

Quote from: Panopeeper
ACR could use the additional information, but the basic position is, that ACR has to deliver the very same result, no matter if from the native raw file or from a DNG without any undocumented information.

Thus ACR uses only that data, which can beconverted in standard metadata, be it Exif, TIFF-EP, or DNG.

Examples:

1. WB can be converted in DNG, so ACR does make use of the WB information, even though that is undocumented,
2. contrast, sharpness, saturation can not be converted; although there are corresponding fields in Exif, they are not suitable as substitute. Thus these settings will be ignored by ACR.
3. Highlight Tone Protection (a flag in MakerNote, again undocumented) is partly supported, for the adjustment of intensity can be translated, but the initial curve change (which will be done in-camera and by DPP) can not be expressed in the standard metadata.


If the OEM software can take advantage of the original MakerNote, then it can use it with minimal effort from the DNG file as well.


The Adobe DNG converter may add one or two JPEGs (one medium and one large), in addition to the thumbnail, if the respective option is selected. These are standard in TIFF, most programs can use at least one of them. For example if you open a DNG file with ACR, this preview JPEG is displayed first.

Good points...  just to clarify, ("If the OEM software can take advantage...") is there any OEM software that can work with DNG files now?   I'd be shocked, but am I reading right that Canon may be close to allowing that?

Got that on the JPEGS, this point was brought up in that another thread by John- the bigger JPEG as being a very big, high quality file that could be used as a "snapshot" (my words, not his) to process back to if need be...  I'm not sure why or how you'd use that, it certainly does not fit into any of my processes.  

"but the basic position is, that ACR has to deliver the very same result,..."  I'm not too clear on what you mean here.  Whose position is that, Adobe?  You're saying they feel they have to match the OEM processing, or are you saying they have to match the processing between the OEM RAW file and the DNG?
Logged
Ted Dillard

teddillard

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 717
    • http://www.teddillard.com
DNG Workflow
« Reply #11 on: November 01, 2008, 06:43:20 am »

Quote from: Farkled
FWIW, I see no safety in DNG.  Will Canon succumb before Adobe?

I use DNG as does NilosR except that I will sometimes process quite a bit in DxO before feeding to ACR (I do no yet have LR).  I delete the DNGs when I'm done with the set.

Interesting...  why do you use DxO?  You like the processing or controls better?  

I took a look at DxO awhile back, I'll have to look again.  (Does it support Smart Objects?    )
Logged
Ted Dillard

teddillard

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 717
    • http://www.teddillard.com
DNG Workflow
« Reply #12 on: November 01, 2008, 06:45:45 am »

Quote from: NikosR
Just want to point out that the original question was about integrating DNG in one's workflow. Now. As it is. Not what may happen in the future. The OP explicitly pointed out that there are other threads (he also pointed to the latest) for discussion of the future of proprietary raw formats vs DNG or DNG's potential capabilities.

...thanks for that.  
Logged
Ted Dillard

Panopeeper

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1805
DNG Workflow
« Reply #13 on: November 01, 2008, 11:59:03 am »

Quote from: teddillard
Whose position is that, Adobe?  You're saying they feel they have to match the OEM processing, or are you saying they have to match the processing between the OEM RAW file and the DNG?
If you convert a native raw file in DNG and then process the native raw and the DNG in ACR side by side, you get the very same result. ACR does not use more information from the native raw file than available in DNG format (NOT in the MakerNote saved in DNG).

In other words: if some information can not be converted in DNG (which does include Exif and TIFF-EP), then ACR does not use it.
Logged
Gabor

madmanchan

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 2115
    • Web
DNG Workflow
« Reply #14 on: November 01, 2008, 01:00:58 pm »

Quote from: teddillard
Is there any OEM software that can work with DNG files now?

Yes.

SilkyPix is the "OEM" software for many cameras, such as Pentax cameras. It reads DNG files (whether Pentax-created or not).

Capture One is the "OEM" software for Leica cameras. It also reads DNG files (whether Leica-created or not).

Quote
"but the basic position is, that ACR has to deliver the very same result,..."  I'm not too clear on what you mean here.  Whose position is that, Adobe?  You're saying they feel they have to match the OEM processing, or are you saying they have to match the processing between the OEM RAW file and the DNG?

As Gabor noted, consider two raw files (1) a non-DNG raw file (e.g., Canon CR2, Nikon NEF) and (2) a mosaiced DNG raw file created from (1). Camera Raw and Lightroom will process #1 and #2 exactly the same.

Logged
Eric Chan

john beardsworth

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 4755
    • My photography site
DNG Workflow
« Reply #15 on: November 03, 2008, 04:39:43 am »

Though it's attractive to compare the future readability of the myriad raw formats with DNG, Ted was asking about workflow advantages:

1) The embedded preview reflects your adjustments and is available in other non Adobe programs without a need to convert the raw data. So for those managing their archives with catalogues such as iView or Portfolio, they see the DNG's adjusted preview - with raw they only see the raw file's unadjusted preview (unless they use the camera maker's software like Nikon Capture).

2) The embedded preview is sufficiently good that it can speed up a variety of output processes. It's very much faster, for example, to output web galleries of entire shoots from iView because it uses the embedded preview whereas Lightroom, because its Web workspace lacks a draft mode, insists on generating the output directly from the original raw data. Multimedia authoring programs such as ProShow can show the adjusted DNGs.

3) Archive space needs are reduced because DNG file sizes are typically smaller than the raw originals. This depends on the original raw file's compression, but a DNG can be up to 35% smaller than a Nikon raw file, maybe 5-10% smaller than Canon.

4) The DNG carries metadata inside the file, not in a sidecar file, and this includes adjustment instructions, so it's easier to transfer your work to someone else or onto another computer.

5) The DNG carries metadata like copyright and keywords inside the image, so there's less risk that your metadata will go missing over time or be lost when someone else receives your files.

6) More non-Adobe programs read DNGs' embedded metadata than read sidecar files. Just as one thinks of the long term readability of the raw data, DAM is a process of serial monogamy, and you have to assume that one day you will inevitably move out and go elsewhere. Embedded metadata lets you leave with your metadata and take it to your new love. Imagine Adobe went under and you wanted to switch to Apple's Aperture - it fails to read metadata in sidecars but can read it from DNGs. (Going back to future readability, Aperture will also read the DNG files even if Apple has decided not to support the original camera).

John
Logged

teddillard

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 717
    • http://www.teddillard.com
DNG Workflow
« Reply #16 on: November 03, 2008, 05:02:18 am »

Quote from: johnbeardy
6) More non-Adobe programs read DNGs' embedded metadata than read sidecar files. Just as one thinks of the long term readability of the raw data, DAM is a process of serial monogamy, and you have to assume that one day you will inevitably move out and go elsewhere. Embedded metadata lets you leave with your metadata and take it to your new love. Imagine Adobe went under and you wanted to switch to Apple's Aperture - it fails to read metadata in sidecars but can read it from DNGs. (Going back to future readability, Aperture will also read the DNG files even if Apple has decided not to support the original camera).

John

Thanks, John...

About this metadata point.  First, regarding sidecar files, last I checked, over a year ago, mind you, nobody could read each other's sidecar files, has this changed?  Minor point, and in service of the DNG argument, but just to clarify...

Now, as far as the metadata in the DNG that is sidecar-related, the tests I ran showed that no one, at that point, made or read the DNG metadata, specifically the processing settings, interchangeably either.  I could process the file, save as DNG, then open the DNG in Camera RAW and it would show none of my processing.  Again, is this no longer the case?  At that time I did a bit of cross-program attempt with all the same result.

Finally, as far as Aperture goes, are you saying that Aperture 2 will now read DNG files made from non-supported cameras?  Again, last I checked, it could not and the folks I talked to at Aperture indicated it would not...
« Last Edit: November 03, 2008, 05:09:47 am by teddillard »
Logged
Ted Dillard

NikosR

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 622
    • http://
DNG Workflow
« Reply #17 on: November 03, 2008, 05:06:57 am »

Quote from: johnbeardy
Though it's attractive to compare the future readability of the myriad raw formats with DNG, Ted was asking about workflow advantages:

1) The embedded preview reflects your adjustments and is available in other non Adobe programs without a need to convert the raw data. So for those managing their archives with catalogues such as iView or Portfolio, they see the DNG's adjusted preview - with raw they only see the raw file's unadjusted preview (unless they use the camera maker's software like Nikon Capture).

2) The embedded preview is sufficiently good that it can speed up a variety of output processes. It's very much faster, for example, to output web galleries of entire shoots from iView because it uses the embedded preview whereas Lightroom, because its Web workspace lacks a draft mode, insists on generating the output directly from the original raw data. Multimedia authoring programs such as ProShow can show the adjusted DNGs.


Just to point out FWIW that processing a Nikon NEF file with Capture NX results in the embedded jpeg preview being updated which in turn results in the same advantages described here. So this advantage is not restricted to DNGs. I use Photo Mechanic a lot and it does offer the described advantages when working with Capture NX edited NEFs.

In fact, some of the other advantages you mention also apply to Nikon NEFs, with the added advantage that virtually any 3rd party software can open and read these (Unfortunately just the raw data. They are not necessarily able to write NEFs or understand any embedded processing instruction metadata since Nikon keep the format to themselves...).  This is not, currently and unfortunately, true for DNG.

This is by no means meant as a critisism of the DNG format, it is more a statement reflecting the current situation of adoption of the DNG format by other 3rd party software manufacturers.
« Last Edit: November 03, 2008, 05:16:51 am by NikosR »
Logged
Nikos

john beardsworth

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 4755
    • My photography site
DNG Workflow
« Reply #18 on: November 03, 2008, 05:09:39 am »

Quote from: NikosR
Just to point out FWIW that processing a Nikon NEF file with Capture NX results in the embedded jpeg preview being updated which in turn results in the same advantages described here. So this advantage is not restricted to DNGs. I use Photo Mechanic a lot and it does offer the described advantages when working with Capture NX edited NEFs.
Hey, you even quoted me saying "unless they use the camera maker's software like Nikon Capture"

John
Logged

NikosR

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 622
    • http://
DNG Workflow
« Reply #19 on: November 03, 2008, 05:20:08 am »

Quote from: johnbeardy
Hey, you even quoted me saying "unless they use the camera maker's software like Nikon Capture"

John

Maybe I misread to where your quoted phrase was applicable to. I thought you were saying 'unless...Capture' to read the files, while you obviously meant 'to update' the files in the first place. If I did, I apologise.
« Last Edit: November 03, 2008, 05:20:38 am by NikosR »
Logged
Nikos
Pages: [1] 2   Go Up