Pages: [1] 2   Go Down

Author Topic: LR can't use a library that's on a network drive  (Read 17347 times)

Scott McGee

  • Newbie
  • *
  • Offline Offline
  • Posts: 49
    • http://www.alaskaphotos.biz
LR can't use a library that's on a network drive
« on: February 26, 2007, 03:10:01 am »

Maybe I'm just way out in left field in thinking that Lightroom should be able to use a library that's located on a network drive. But it seems logical to me that it should be able to.

Here's my setup:
1) Dell desktop computer with four 18GB hard drives in RAID 5 (this is my C: drive)
2) ReadyNAS 2TB network attached storage in RAID 5 (this is my F: drive)

I have only Windows XP and my programs on the C: drive. I keep all my data files on the F: drive. Because of the limited space on my C: drive, I want to have my Lightroom library located on the F: drive. In Windows Explorer, I copied the Lightroom library from the default location in my C:\Documents and Settings folder to the F: drive. Then when opening Lightroom, I held down the Ctrl key to bring up the dialog box to select the library on the F: drive. When I selected it, I got a message in the dialog box that said Lightroom cannot use a library that's located on a network volume.

Does anyone know why this is, and if there's a workaround? Or do I just have to live with it?  

Scott
Logged

Scott McGee [url=http://www.alaskaphoto

boku

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1493
    • http://www.bobkulonphoto.com
LR can't use a library that's on a network drive
« Reply #1 on: February 26, 2007, 03:32:26 pm »

Quote
Maybe I'm just way out in left field in thinking that Lightroom should be able to use a library that's located on a network drive. But it seems logical to me that it should be able to.

Here's my setup:
1) Dell desktop computer with four 18GB hard drives in RAID 5 (this is my C: drive)
2) ReadyNAS 2TB network attached storage in RAID 5 (this is my F: drive)

I have only Windows XP and my programs on the C: drive. I keep all my data files on the F: drive. Because of the limited space on my C: drive, I want to have my Lightroom library located on the F: drive. In Windows Explorer, I copied the Lightroom library from the default location in my C:\Documents and Settings folder to the F: drive. Then when opening Lightroom, I held down the Ctrl key to bring up the dialog box to select the library on the F: drive. When I selected it, I got a message in the dialog box that said Lightroom cannot use a library that's located on a network volume.

Does anyone know why this is, and if there's a workaround? Or do I just have to live with it?  

Scott
[a href=\"index.php?act=findpost&pid=103184\"][{POST_SNAPBACK}][/a]

Not only that, I am finding it is choking on importing more than 1000 files from my Terastation NAS even though I am using the default library database location on my C: drive (I use Windows XP).

I currently backup to USB externals.

I am starting to change my strategy and look into using daisy-chained Firewire externals to hold my files, backup to the Terastation, and repurpose the USB drives.

I ordered a Western Digital 500GB My Book Pro just to see how it works on Firewire. Problem is, I hear they have a problem daisy-chaining.
Logged
Bob Kulon

Oh, one more thing...[b

Recked

  • Full Member
  • ***
  • Offline Offline
  • Posts: 128
LR can't use a library that's on a network drive
« Reply #2 on: February 26, 2007, 03:50:52 pm »

Hello,

Just out of curiousity and not the change the main subject of this post, but why don't you use an online storage facility instead of buying multiple external hard drives? Photoshelter comes to mind and while the advertised pricing is high for large storage needs they do have unadvertised prices that are more reasonable and at least the data is offsite etc. There is also ProtectMyPhotos.com, but I just tried and sadly their service at least for the time being reads local drives only and will not work with mapped network drives like my Nas. Their prices are really good so I was disappointed to learn they couldn't see my Nas.

Just a thought....

I was going to buy LightRoom until I saw this post and as I use a ReadyNAS NV for my inoffice storage I guess I won't be able to use LightRoom. Find it hard to believe that Adobe would do something like this. A bit confusing to say the least.....

good luck
Logged

boku

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1493
    • http://www.bobkulonphoto.com
LR can't use a library that's on a network drive
« Reply #3 on: February 26, 2007, 04:00:22 pm »

Quote
Hello,

Just out of curiousity and not the change the main subject of this post, but why don't you use an online storage facility instead of buying multiple external hard drives? Photoshelter comes to mind and while the advertised pricing is high for large storage needs they do have unadvertised prices that are more reasonable and at least the data is offsite etc. There is also ProtectMyPhotos.com, but I just tried and sadly their service at least for the time being reads local drives only and will not work with mapped network drives like my Nas. Their prices are really good so I was disappointed to learn they couldn't see my Nas.

Just a thought....

I was going to buy LightRoom until I saw this post and as I use a ReadyNAS NV for my inoffice storage I guess I won't be able to use LightRoom. Find it hard to believe that Adobe would do something like this. A bit confusing to say the least.....

good luck
[a href=\"index.php?act=findpost&pid=103329\"][{POST_SNAPBACK}][/a]

I'm not saying it is supposed to behave the way I describe. I have a hard to believing they would engineer it that way also.

I am only telling you what I am experiencing and I am also hearing similar banter on forums here and there. I can't wait for the situation to be solved if it is a bug, so I am moving my primary online image store from NAS to firewire volumes.
Logged
Bob Kulon

Oh, one more thing...[b

paulbk

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 528
LR can't use a library that's on a network drive
« Reply #4 on: February 26, 2007, 07:11:38 pm »

Bob,
just a quick fyi... I've had a Western Digital 500GB Pro Book for a few weeks now. I use as one of my photo file backups and connect via USB 2.. plenty fast. Thus far, a great drive.

p
Logged
paul b.k.
New England, USA

Scott McGee

  • Newbie
  • *
  • Offline Offline
  • Posts: 49
    • http://www.alaskaphotos.biz
LR can't use a library that's on a network drive
« Reply #5 on: February 26, 2007, 10:40:40 pm »

Well, I've answered my own question. I found this at the Adobe Lightroom support website.

------------------------------------------------

Q) Can I store my library on a network drive?

A) No, this is not supported. There are too many variables in a network configuration to guarantee that the library database will not become corrupted. See the next question for how to use your library with multiple computers.

------------------------------------------------


So, Adobe does not now, nor ever will, support having the library on a network drive or NAS device connected via Ethernet. However, Lightroom will support a library that's located on an external hard drive that is connected to the host computer via USB or Firewire.

Unfortunately in my case, my ReadyNAS does not support connecting to the host computer via Firewire or USB. So I can't put the Lightroom library on the NAS.      
« Last Edit: February 26, 2007, 11:36:51 pm by Scott McGee »
Logged

Scott McGee [url=http://www.alaskaphoto

NikosR

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 622
    • http://
LR can't use a library that's on a network drive
« Reply #6 on: February 27, 2007, 07:59:22 am »

Quote
Well, I've answered my own question. I found this at the Adobe Lightroom support website.

------------------------------------------------

Q) Can I store my library on a network drive?

A) No, this is not supported. There are too many variables in a network configuration to guarantee that the library database will not become corrupted. See the next question for how to use your library with multiple computers.

------------------------------------------------
So, Adobe does not now, nor ever will, support having the library on a network drive or NAS device connected via Ethernet. However, Lightroom will support a library that's located on an external hard drive that is connected to the host computer via USB or Firewire.

Unfortunately in my case, my ReadyNAS does not support connecting to the host computer via Firewire or USB. So I can't put the Lightroom library on the NAS.     
[a href=\"index.php?act=findpost&pid=103413\"][{POST_SNAPBACK}][/a]


In theory you could locate the library on a local drive and have it point to files on a network drive if local storage space is your issue. You will get a performance hit especially when importing lots of files and especially with low-end network drives and NAS appliances and, of course, you won't be able to easily share the library from different computers.

Saving XMP files together with the image files might be a crude way to simulate library sharing but you must be extra careful to avoid the potential of double concurrent updates (i.e. only ever have Lightroom active on one computer).

A low-end iSCSI solution might be the answer for network library sharing. This will allow files (including, in theory, the library) to be located on a network drive but appear to the operating system (and thus Lightroom) to be located on a local drive. Unfortunately, low-end iSCSI solutions are not yet mainstream (and maybe they never will be).

iSCSI solutions involve an iSCSI host, which is typically an appliance or pc with internal or external disks,  with appropriate software (or bootable firmware) to make it appear as a local drive to ethernet connected iSCSI clients which will be your computers with appropriate iSCSI drivers ( provided for free by Microsoft in the case of Windows).

For the computer savvy, iSCSI provides a method to encapsulate SCSI hard disk control coomands in a way that can be trasmitted over ethernet. The drivers on both ends have the job of encapsulating and de-encapsulating the SCSI commands. Low end iSCSI solutions support SATA protocols also.

Nikos
Athens, Greece
« Last Edit: February 27, 2007, 08:25:41 am by NikosR »
Logged
Nikos

NikosR

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 622
    • http://
LR can't use a library that's on a network drive
« Reply #7 on: February 27, 2007, 08:36:28 am »

Just a general comment regarding Lightroom basic architecture. Adobe have decided (rightly or wrongly) to go with the database concept in the heart of Lightroom (same as Apple have done). Their library is essentially a sort of database.

This decision means, in principle, that they are bound to face now or in the future all sorts of issues (integrity, replication, merging, incremental backup, synchronisation, logging etc.)  pertaining to all database systems. I am not aware of the internals of Lightroom database but if they have chosen not to use an industry standard embedded database system, but use propriatery code instead, they will have to re-invent the wheel in all these issues. Adobe is a large company with lots of resources but, to my knlowledge, this is the first time they are trying their hand on a database type application.

Nikos
Athens, Greece
« Last Edit: February 27, 2007, 08:38:31 am by NikosR »
Logged
Nikos

allenlux

  • Newbie
  • *
  • Offline Offline
  • Posts: 5
LR can't use a library that's on a network drive
« Reply #8 on: February 27, 2007, 08:47:23 am »

Quote
...I am not aware of the internals of Lightroom database but if they have chosen not to use an industry standard embedded database system...

Lightroom uses SQLite. The library database can be accessed by any tools which work with SQLite. This is a good design decision by Adobe which opens up many possibilities for writing extensions to LR.
Logged

NikosR

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 622
    • http://
LR can't use a library that's on a network drive
« Reply #9 on: February 27, 2007, 08:50:12 am »

Quote
Lightroom uses SQLite. The library database can be accessed by any tools which work with SQLite.[a href=\"index.php?act=findpost&pid=103469\"][{POST_SNAPBACK}][/a]

Thank you. That's good to know.

So the answer to the OP's question about 'Why Not?'  may be because SQLite, which is a flat file database, does not implement its own locking techniques and relies on the, often unreliable operating system locking and caching mechanisms, for ensuring integrity on network drives. Adobe wisely chose not to allow placement of the databse on a network drive since this could lead to corruption (and maybe in some extreme cases even when accesed by only a single client).

Also any hopes that Lightroom may grow up to be a multiuser application should probably be relegated to the distant future as SQLite, to my knowledge, is not really designed to be a robust multiuser database.

On the other hand, since tools to merge SQLite databases already exist, MR's hope of Lightroom supporting library merging in a future version is not overoptimistic.


Nikos
Athens, Greece
« Last Edit: February 27, 2007, 09:30:16 am by NikosR »
Logged
Nikos

jani

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1624
    • Øyet
LR can't use a library that's on a network drive
« Reply #10 on: February 27, 2007, 06:56:02 pm »

Quote
Well, I've answered my own question. I found this at the Adobe Lightroom support website.

------------------------------------------------

Q) Can I store my library on a network drive?

A) No, this is not supported. There are too many variables in a network configuration to guarantee that the library database will not become corrupted. See the next question for how to use your library with multiple computers.
Here's some additional input about this problem.

Not only are there many variables that can affect reliability in a networked disk setup, but there are also serious performance issues in CIFS (the network file system used by Windows and therefore most home/small office NAS devices).

Since you don't mention which ReadyNAS product you're using, it's a bit hard to say exactly what your performance will be like, compared to a FireWire 400/800 or USB 2 drive, but you should expect lower performance regardless of how good your network is.

According to the ReadyNAS Comparison Chart, the best theoretical performance you can get is 32 MB/s read and 24 MB/s write (if jumbo frames are enabled throughout a Gigabit Ethernet network).

The best theoretical performance for internal SATA drives is about twice as good, and with significantly better latency figures. (Latency is, in brief, the time between the request for data to be read or written, and the point in time where the data has been fetched or written.)

FireWire comes reasonably close to internal drives. USB 2.0 may reach comparable performance to FireWire, but only if there are no other active USB devices on the same bus (sometimes the same controller).

The advice about looking at iSCSI is not unreasonable in itself, but keep in mind that iSCSI works better with dedicated network interfaces and cabling than when connected to a hub or a home office switch.

External SATA (eSATA) is becoming a competitive solution for home computers, but like FireWire and USB drives, the usable cable length is limited (I don't recall the exact numbers for either interface, sorry).

And if you're on a wireless network, you're in for more potential performance problems with network disks, depending on atmospheric conditions (yes, even inside your house) and radio activity (other wireless devices in your house or neighbouring houses).

All in all, for active image editing, NAS devices designed for home use are probably not the best for such purposes.

Getting decent performance from NAS or SAN (don't you love these acronyms?) is possible, however, it just costs money.
Logged
Jan

boku

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1493
    • http://www.bobkulonphoto.com
LR can't use a library that's on a network drive
« Reply #11 on: February 27, 2007, 07:03:16 pm »

Quote
Here's some additional input about this problem.

Not only are there many variables that can affect reliability in a networked disk setup, but there are also serious performance issues in CIFS (the network file system used by Windows and therefore most home/small office NAS devices).

Since you don't mention which ReadyNAS product you're using, it's a bit hard to say exactly what your performance will be like, compared to a FireWire 400/800 or USB 2 drive, but you should expect lower performance regardless of how good your network is.

According to the ReadyNAS Comparison Chart, the best theoretical performance you can get is 32 MB/s read and 24 MB/s write (if jumbo frames are enabled throughout a Gigabit Ethernet network).

The best theoretical performance for internal SATA drives is about twice as good, and with significantly better latency figures. (Latency is, in brief, the time between the request for data to be read or written, and the point in time where the data has been fetched or written.)

FireWire comes reasonably close to internal drives. USB 2.0 may reach comparable performance to FireWire, but only if there are no other active USB devices on the same bus (sometimes the same controller).

The advice about looking at iSCSI is not unreasonable in itself, but keep in mind that iSCSI works better with dedicated network interfaces and cabling than when connected to a hub or a home office switch.

External SATA (eSATA) is becoming a competitive solution for home computers, but like FireWire and USB drives, the usable cable length is limited (I don't recall the exact numbers for either interface, sorry).

And if you're on a wireless network, you're in for more potential performance problems with network disks, depending on atmospheric conditions (yes, even inside your house) and radio activity (other wireless devices in your house or neighbouring houses).

All in all, for active image editing, NAS devices designed for home use are probably not the best for such purposes.

Getting decent performance from NAS or SAN (don't you love these acronyms?) is possible, however, it just costs money.
[a href=\"index.php?act=findpost&pid=103608\"][{POST_SNAPBACK}][/a]

Thanks for that insight. It was clear, understandable, and informative. You have completely defined my situation and why I am going to daisy-chained firewire drives for primary file storage.
« Last Edit: February 27, 2007, 07:03:48 pm by boku »
Logged
Bob Kulon

Oh, one more thing...[b

seanmcfoto

  • Full Member
  • ***
  • Offline Offline
  • Posts: 176
LR can't use a library that's on a network drive
« Reply #12 on: February 27, 2007, 08:34:50 pm »

Quote
Thanks for that insight. It was clear, understandable, and informative. You have completely defined my situation and why I am going to daisy-chained firewire drives for primary file storage.
[a href=\"index.php?act=findpost&pid=103610\"][{POST_SNAPBACK}][/a]
I'd also like to add mine Jani. Very clear and well explained.
Logged
Sean McCormack
[url=http://lightroom.sea

john beardsworth

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 4755
    • My photography site
LR can't use a library that's on a network drive
« Reply #13 on: February 28, 2007, 04:54:22 am »

Quote
Also any hopes that Lightroom may grow up to be a multiuser application should probably be relegated to the distant future as SQLite, to my knowledge, is not really designed to be a robust multiuser database.

On the other hand, since tools to merge SQLite databases already exist, MR's hope of Lightroom supporting library merging in a future version is not overoptimistic.

Don't focus on SQLite - after all, you didn't know it was there until a couple of posts back. Applications like LR can sit relatively easily on other databases too (eg Extensis Portfolio) such as SQL Server or Oracle. Multi user might not be tomorrow, but nor is it the distant future.

The database back end is irrelevant to merging databases. In beta 4 there was a mechanism called binders - because of other priorities (folders) it didn't make the cut for the v1 release, but it's bound to be revived in some form.

John
Logged

dlashier

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 518
    • http://www.lashier.com/
LR can't use a library that's on a network drive
« Reply #14 on: March 04, 2007, 03:49:20 am »

Just stumbled on this thread and find it incredible that Adobe didn't just provide an ODBC interface that would allow the user to use their database of choice. Sounds like they're about 10 years behind the times. It's not an issue for me (or most amateurs) as long as I can store the images on a NAS but it's bound to be a killer for professional use. Everything these days is going to DB storage as it's the most flexible and best performing method. Bundling SQLite is fine as a default but not allowing the user to choose a REAL database is just plain stupid. There are plenty of robust DB engines that provide record locking, transactions etc., even free ones (Oracle, Firebird, MS SQl Express). I doubt that providing the ODBC flexibility would have been any more work than interfacing directly, and they could have avoided support issues with a disclaimer "use with other DB at your own risk".

- DL
Logged

boku

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1493
    • http://www.bobkulonphoto.com
LR can't use a library that's on a network drive
« Reply #15 on: March 04, 2007, 10:59:31 am »

Quote
Just stumbled on this thread and find it incredible that Adobe didn't just provide an ODBC interface that would allow the user to use their database of choice. Sounds like they're about 10 years behind the times. It's not an issue for me (or most amateurs) as long as I can store the images on a NAS but it's bound to be a killer for professional use. Everything these days is going to DB storage as it's the most flexible and best performing method. Bundling SQLite is fine as a default but not allowing the user to choose a REAL database is just plain stupid. There are plenty of robust DB engines that provide record locking, transactions etc., even free ones (Oracle, Firebird, MS SQl Express). I doubt that providing the ODBC flexibility would have been any more work than interfacing directly, and they could have avoided support issues with a disclaimer "use with other DB at your own risk".

- DL
[a href=\"index.php?act=findpost&pid=104523\"][{POST_SNAPBACK}][/a]

Agreed - kind of makes you wonder how they made such an obviously poor decision.
Logged
Bob Kulon

Oh, one more thing...[b

allan67

  • Jr. Member
  • **
  • Offline Offline
  • Posts: 69
    • http://
LR can't use a library that's on a network drive
« Reply #16 on: March 04, 2007, 11:35:51 am »

Hello,

When you create a new volume or partition in Windows you have an option to mount it into existing empty folder on any NTFS-formatted local drive.
Did anyone try this to trick LightRoom into thinking that it accesses local folder, while in fact the data is stored on NAS?
The explanation can be found here (about half way down, when they talk about Drive Paths):
http://www.microsoft.com/technet/prodtechn...e/10w2kadb.mspx

I don't have a networked storage yet, so can't try it myself.

Allan
Logged

john beardsworth

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 4755
    • My photography site
LR can't use a library that's on a network drive
« Reply #17 on: March 04, 2007, 12:09:05 pm »

Quote
Agreed - kind of makes you wonder how they made such an obviously poor decision.
[a href=\"index.php?act=findpost&pid=104564\"][{POST_SNAPBACK}][/a]
Because they were developing a version 1 for two platforms and to a tight schedule. No doubt other back ends will come, but in their own good time.

John
Logged

jani

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1624
    • Øyet
LR can't use a library that's on a network drive
« Reply #18 on: March 04, 2007, 05:06:39 pm »

If you want to run SQLite with ODBC, use an ODBC wrapper for SQLite.

Edit: Typofix.
« Last Edit: March 05, 2007, 05:08:42 am by jani »
Logged
Jan

dlashier

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 518
    • http://www.lashier.com/
LR can't use a library that's on a network drive
« Reply #19 on: March 05, 2007, 03:44:45 am »

Quote
If you want to run SQLite with ODBC, use an ODCB wrapper for SQLite.
[a href=\"index.php?act=findpost&pid=104645\"][{POST_SNAPBACK}][/a]
But does LR support the ODBC interface? If you're happy with sqlite there's no need for ODBC. I should add that this is not really an issue for me and most likely will be purchasing LR before the special is up, but I'm just scratching my head about this as a DB adds all sorts of extensibility/interface options and I'm already using and familiar with both mySQL and Firebird and life would be simpler if I could use one of these. The mail server I currently runs allows this flexibility as does my web engine - pick your DB weapon of choice.

- DL
« Last Edit: March 05, 2007, 05:04:17 am by dlashier »
Logged
Pages: [1] 2   Go Up