Pages: [1] 2 3   Go Down

Author Topic: Scratch Disk size and speed  (Read 33456 times)

mdijb

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 666
    • mdiimaging.com
Scratch Disk size and speed
« on: September 10, 2009, 07:21:37 pm »

I am about to purchase a new MacPro and want to use a separate internal scratch Disk.  

1- is there much difference in performance between a 7200 and 10,000 rpm drive--the price difference is significant?

2-I have seen people using between 10 and 300 GB for this purpose.  It seems that the large dics are not needed.  What is the best size for just dedicating the drive to Photoshop use?

MDIJB
Logged
mdiimaging.com

Gellman

  • Full Member
  • ***
  • Offline Offline
  • Posts: 122
    • http://www.jgphoto.com
Scratch Disk size and speed
« Reply #1 on: September 10, 2009, 07:59:17 pm »

If I am not mistaken, 10,000 RPM speeds are only available in huge capacity hard drives. I can not imagine that you would need such a large drive capacity for a scratch drive. The optimal size of a scratch drive depends on the size of the files you routinely edit in Photoshop. I have heard from many sources that the scratch drive should be at least four or five times the size of your largest files. So even a relatively small 7200 RPM hard drive will prolly suit your purpose.

If you are really concerned about speed, you should be putting your money into more RAM. More available memory minimizes scratch drive use.

The best source of information I've seen about optimizing Photoshop on Macs is provided by Lloyd Chambers. You should check out his website, www.macperformanceguide.com, as well as his blog.

Good luck.

John
Logged

fike

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1413
  • Hiker Photographer
    • trailpixie.net
Scratch Disk size and speed
« Reply #2 on: September 10, 2009, 08:52:51 pm »

Yes, RAM first.  On the other hand, a 10,000 RPM drive is much faster than a 7,200 drive.  The largest performance improvement I have seen over the past few years of upgrades was a 10,000 RPM Western Digital Raptor.  They are far superior to the 7,200 drives.  They can be had as small as 150GB I think.  If you really want to go crazy get a decent SSD for your scratch disk.
Logged
Fike, Trailpixie, or Marc Shaffer

Jack Flesher

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 2592
    • www.getdpi.com
Scratch Disk size and speed
« Reply #3 on: September 11, 2009, 01:21:43 am »

You can buy 4 640G 7200's for the price of a single 300Gig 10K drive -- and if you put those 4 7200 drives in RAID-0 it will smoke the single 10K disk on I/O...  I partition off the outer 160G edge of a 4-drive RAID-0 and dedicate that for scratch.  I use the rest -- over 2TB -- for working image storage and it's also very fast on reads and writes of large image files.  However, since it is RAID-0 it is failure prone and needs to be backed up...

Logged
Jack
[url=http://forum.getdpi.com/forum/

fike

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1413
  • Hiker Photographer
    • trailpixie.net
Scratch Disk size and speed
« Reply #4 on: September 11, 2009, 08:35:45 am »

Quote from: Jack Flesher
You can buy 4 640G 7200's for the price of a single 300Gig 10K drive -- and if you put those 4 7200 drives in RAID-0 it will smoke the single 10K disk on I/O...  I partition off the outer 160G edge of a 4-drive RAID-0 and dedicate that for scratch.  I use the rest -- over 2TB -- for working image storage and it's also very fast on reads and writes of large image files.  However, since it is RAID-0 it is failure prone and needs to be backed up...

That RAID-0 will absolutely smoke a single 10,000 RPM drive, but it isn't simple and it is 4x prone to failure.  Also, your hardware (mboard and enclosure) need to support more than 5 drives (RAID plus your boot).  That isn't always available.

KISS--Keep It Simple Stoopid.

 


Logged
Fike, Trailpixie, or Marc Shaffer

Jack Flesher

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 2592
    • www.getdpi.com
Scratch Disk size and speed
« Reply #5 on: September 11, 2009, 10:43:13 am »

Quote from: fike
That RAID-0 will absolutely smoke a single 10,000 RPM drive, but it isn't simple and it is 4x prone to failure.  Also, your hardware (mboard and enclosure) need to support more than 5 drives (RAID plus your boot).  That isn't always available.

KISS--Keep It Simple Stoopid.

 

FWIW, with Mac OSX, RAID-0 is VERY simple to do with the built-in OS drive management software -- takes maybe a minute.  And FWIW2, the Mac MB supports up to 6 SATA2 drives WITHOUT adding a card! And who cares if a scratch array fails? Just rebuild it...    Stoopid
« Last Edit: September 11, 2009, 10:44:40 am by Jack Flesher »
Logged
Jack
[url=http://forum.getdpi.com/forum/

fike

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1413
  • Hiker Photographer
    • trailpixie.net
Scratch Disk size and speed
« Reply #6 on: September 11, 2009, 12:27:56 pm »

Quote from: Jack Flesher
FWIW, with Mac OSX, RAID-0 is VERY simple to do with the built-in OS drive management software -- takes maybe a minute.  And FWIW2, the Mac MB supports up to 6 SATA2 drives WITHOUT adding a card! And who cares if a scratch array fails? Just rebuild it...    Stoopid


Okay, just get an OCZ Vertex SSD.  Simple and even faster than RAID 0.
Logged
Fike, Trailpixie, or Marc Shaffer

Jack Flesher

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 2592
    • www.getdpi.com
Scratch Disk size and speed
« Reply #7 on: September 11, 2009, 02:17:37 pm »

Quote from: fike
Okay, just get an OCZ Vertex SSD.  Simple and even faster than RAID 0.

RAID-0 4 of those and you're really talking I/O
Logged
Jack
[url=http://forum.getdpi.com/forum/

Gemmtech

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 526
Scratch Disk size and speed
« Reply #8 on: September 11, 2009, 04:30:05 pm »

Add lots of ram first as others have stated, however I diverge from there, since 1998 I only use SCSI HD for the heavy stuff and the reason is simple, they are simply a lot more reliable than everything else.  RAID 0 is fine but so is RAID 10.  I know what so many people will say, SCSI is so much more expensive, but guess what (I KNOW I SHOULDN'T SAY IT) since 1998 I have NOT had 1 SCSI HD failure, but have had 4 IDE failures, 2 in the past year and I use a lot more SCSI drives than IDE/Serial etc.  Apple IIRC used to use a lot of SCSI?  



Logged

Plekto

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 551
Scratch Disk size and speed
« Reply #9 on: September 11, 2009, 06:08:02 pm »

Ram is 500-2000X faster than a hard drive.  How you do it, be it 64 bit OS, a ram disk, or whatever is up to you...
Logged

Jack Flesher

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 2592
    • www.getdpi.com
Scratch Disk size and speed
« Reply #10 on: September 11, 2009, 11:06:59 pm »

FWIW, Lloyd and I tested RAM discs in Leopard for scratch about a year ago and they were not as fast as our 4-drive RAID-0 on our CS benchmark test. (I have 24G of RAM in my Mac Pro.)  That may have changed with Snow Leopard, so definitely worth a look.  The other side of the issue is how well -- or in this case how poorly -- CS manages scratch overhead, especially for newer machines.
« Last Edit: September 11, 2009, 11:08:19 pm by Jack Flesher »
Logged
Jack
[url=http://forum.getdpi.com/forum/

Christopher

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1499
    • http://www.hauser-photoart.com
Scratch Disk size and speed
« Reply #11 on: September 12, 2009, 04:52:10 am »

It is a pity that there are no 10-16Gb SSD drives. Otherwise use 4 of them in raid 0 and you have a very nice scratch disk. Combine that with 24Gb of RAM and you have a very fast solution.

My main problem is still image storage. Right now I'm using 4 640GB drives in RAID 0 (gives me around 300-400 Mbs read and write speed), which is ok but not as fast as I would wish. My dream would be 6-8 300-500 SSD Drives (that would give me a write and read speed at around 1,5 Gbs), but that dream will have to wait a bit.


One site note, the 10,000 Raptors are not really that fast anymore. Current 7,200 Harddrives are as fast when it comes to writing and reading speed.
« Last Edit: September 12, 2009, 04:54:29 am by Christopher »
Logged
Christopher Hauser
[email=chris@hauser-p

fike

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1413
  • Hiker Photographer
    • trailpixie.net
Scratch Disk size and speed
« Reply #12 on: September 12, 2009, 08:45:55 am »

Quote from: Christopher
It is a pity that there are no 10-16Gb SSD drives. Otherwise use 4 of them in raid 0 and you have a very nice scratch disk. Combine that with 24Gb of RAM and you have a very fast solution.

There is a very good OCZ Vertx SSD drive that is only 30GB.  MicroCenter in the US has them for $100 after rebate.
Logged
Fike, Trailpixie, or Marc Shaffer

Jack Flesher

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 2592
    • www.getdpi.com
Scratch Disk size and speed
« Reply #13 on: September 12, 2009, 12:10:36 pm »

Personally, I'm waiting to see what Adobe does with CS-5 Mac and then decide what to do about scratch.  If they code it to actually utilize installed, available RAM, then scratch becomes almost unnecessary except perhaps for very large, layered files.  And with some wishful thinking here, utilizing a fast OS array may be adequate.  Worst case would be the same solution I am currently using -- the thin outer rim partition of a 4-drive stripe for scratch and the remaining for working image storage.  Regardless, I may move my OS from its current 2-drive RAID-0 array to a single really fast SSD, or if they get cheap enough, a pair of smaller fast ones -- 64G x 2 is plenty -- in RAID-0.  

If money were no object, I'd have OS on a 2x64G Intel X25E SSD R-0, scratch on a dedicated 4x32G Intel X25E SSD R-0, and image storage on a separate 4x256G Crucial SSD R-0 array.  Of course that is like $5,000 in SSD drives, which is not out of the question for some,  but still seems a bit extravagant for me. Maybe if I get a good bonus this year LOLOL!
« Last Edit: September 12, 2009, 12:12:56 pm by Jack Flesher »
Logged
Jack
[url=http://forum.getdpi.com/forum/

fike

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 1413
  • Hiker Photographer
    • trailpixie.net
Scratch Disk size and speed
« Reply #14 on: September 12, 2009, 03:29:57 pm »

Quote from: Jack Flesher
Personally, I'm waiting to see what Adobe does with CS-5 Mac and then decide what to do about scratch.  If they code it to actually utilize installed, available RAM, then scratch becomes almost unnecessary except perhaps for very large, layered files.  And with some wishful thinking here, utilizing a fast OS array may be adequate.  Worst case would be the same solution I am currently using -- the thin outer rim partition of a 4-drive stripe for scratch and the remaining for working image storage.  Regardless, I may move my OS from its current 2-drive RAID-0 array to a single really fast SSD, or if they get cheap enough, a pair of smaller fast ones -- 64G x 2 is plenty -- in RAID-0.  

If money were no object, I'd have OS on a 2x64G Intel X25E SSD R-0, scratch on a dedicated 4x32G Intel X25E SSD R-0, and image storage on a separate 4x256G Crucial SSD R-0 array.  Of course that is like $5,000 in SSD drives, which is not out of the question for some,  but still seems a bit extravagant for me. Maybe if I get a good bonus this year LOLOL!


If you get that bonus, you can slip me a few X25s too.
Logged
Fike, Trailpixie, or Marc Shaffer

Plekto

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 551
Scratch Disk size and speed
« Reply #15 on: September 13, 2009, 11:27:18 pm »

Quote from: Jack Flesher
FWIW, Lloyd and I tested RAM discs in Leopard for scratch about a year ago and they were not as fast as our 4-drive RAID-0 on our CS benchmark test.

I'd like to point out that a SSD isn't *exactly* the same as a DDR-based ram disk.  But DDR ram disks are *really* expensive.  OTOH, if you have 16GB or more, you can do nicely with a good 64 bit OS in a pinch.    You'll also have to move the swap file if you're using Windows, as well as the temp and swap directories for Photoshop/etc to the thing or you'll not see most of the benefit.

Yes, they cleaned up the 64 bit code in Snow.  Very slick now, as it should be.
Logged

Jack Flesher

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 2592
    • www.getdpi.com
Scratch Disk size and speed
« Reply #16 on: September 14, 2009, 10:06:03 am »

Quote from: fike
If you get that bonus, you can slip me a few X25s too.

Heck, I am such a gear slut I may fold and do it regardless of bonus -- but either way, you are on your own for obtaining your SSD's LOLOLOLOLOLOL!!!
Logged
Jack
[url=http://forum.getdpi.com/forum/

Etienne Cassar

  • Jr. Member
  • **
  • Offline Offline
  • Posts: 95
Scratch Disk size and speed
« Reply #17 on: March 11, 2010, 04:04:44 am »

I have just built a new PC with 2 Velociraptor HD in raid 0 for the OS and 4 1TB WD Caviar Black which I was planning to set up in Raid 5 for the RAW files.  I chose raid 5 and not raid 0 for the added advantage that you can recover data in case a single drive failure. I always keep a back up of my RAW files, but not always back up my xmp sidecar or psd/tiff files from photoshop.
I have partitioned the 4 drive array in 3 separate volumes.  The first 1gb volume I will dedicate for Photoshop scratch, and the remaining divided in 2 equal volumes, one for Raw files and the other half for edited files, such as psd or tiff files.
I was wondering if I would gain any benefit if I make a Raid 0 volume of 1gb out of the 4 drive array for the scratch disk instead and then set up another raid 5 volume from the remaining space, which I later partition in 2 drives in windows 7.
Any ideas please.

Thanks

Etienne
Logged

feppe

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 2906
  • Oh this shows up in here!
    • Harri Jahkola Photography
Scratch Disk size and speed
« Reply #18 on: March 11, 2010, 07:12:52 am »

There's no such thing as an SSD with TRIM with RAID at the moment, and haven't even heard rumors of something like that being added in the foreseeable future. OCZ Vertex is the only SSD I'm aware that has TRIM in their latest firmware, but TRIM doesn't work with RAID. The drive itself would work in RAID, though.

In English: while SSDs should work perfectly in RAID, putting SSDs in a RAID will result in degrading I/O performance over time until someone comes up with firmware supporting the TRIM feature or at least garbage collection with RAID.

The question is whether TRIM makes a noticieable degradation in I/O, and how long it takes for it to take place. From my experience comparing my old Raptor with the recently purchased OCZ Vertex I'm quite sure that even with massively degraded performance an SSD will run laps around any HDD setup, RAID or not.

FWIW, SSDs are the best and cheapest way to make a massive improvement in disk-use intensive applications.

PeterAit

  • Sr. Member
  • ****
  • Offline Offline
  • Posts: 4559
    • Peter Aitken Photographs
Scratch Disk size and speed
« Reply #19 on: March 11, 2010, 08:20:10 am »

Quote from: mdijb
I am about to purchase a new MacPro and want to use a separate internal scratch Disk.  

1- is there much difference in performance between a 7200 and 10,000 rpm drive--the price difference is significant?

2-I have seen people using between 10 and 300 GB for this purpose.  It seems that the large dics are not needed.  What is the best size for just dedicating the drive to Photoshop use?

MDIJB

This is one use where SSD drives really shine. For example, you can get an Intel 80GB SSD drive for about $240, and that is plenty of space.  But, I think it's better to use your $$ for more RAM so Photoshop doesn't need to go to the scratch disk.
Logged
Pages: [1] 2 3   Go Up