This is an archive of the mabination.com forums which were active from 2010 to 2018. You can not register, post or otherwise interact with the site other than browsing the content for historical purposes. The content is provided as-is, from the moment of the last backup taken of the database in 2019. Image and video embeds are disabled on purpose and represented textually since most of those links are dead.
To view other archive projects go to
https://archives.mabination.com
-
RebeccaBlack wrote on 2012-12-30 21:42
I want to write a lot of stuff to disks. Like, a lot. At least 50-100GB/day. I only need 200-500GB of space as I'll be deleting the data everyday after I'm done using it. It is necessary that I maintain a write speed of 375MB/s+ at all times.
I've heard SSDs don't like writing and erasing data a lot. And I have no experience with RAID setups, but after looking them up, it's looking like I'm going to be going with RAID 0 as this is not critical data I'm storing. That'd be with HDDs.
Are SSDs at the point where this kind of setup would be ideal? If so, which SSDs should I use? I would prefer to use them over HDDs, as they're more modern/lightweight and have inherently good read/write speeds, even if they're quite expensive for their storage capacity. RAID 0 HDD setups, on the other hand, fall apart when only one dies off and are quite heavy, prone to fragmentation, etc, but would have more reliability. Should I get a RAID setup for now and wait for SSD prices to drop?
It is worth noting that hard drives are the one piece of hardware I will never resell or in any way allow others to handle, so all sales are final and any money I put in basically goes into the void.
Oh, the writes will be sequential, by the way.
-
Yoorah wrote on 2012-12-30 22:02
You're gonna need to go with a RAID setup regardless of using HDDs or SSDs. HDDs are actually pretty decent for sequential IO. Where SSDs shine is random IO. That, and considering the fact that you'll be writing so much.. I'd probably go with a HDD array.
-
RebeccaBlack wrote on 2012-12-30 22:09
Blah, I figured. I'm just tired of using this bulky crap. Can't wait for SSDs to be reasonably priced lol.
-
Osayidan wrote on 2012-12-30 22:14
I wouldn't bother with SSDs for that unless you're dealing with huge numbers of small files, or lots of random writes.
If it's just a small number of huge files you're better off with a RAID0 of a few good HDDs. Make sure you have a good RAID card though, onboard RAID is garbage for most cases other than standard home use RAID1. You're more likely to get RAID issues at the controller level than the drives if you use onboard for intensive stuff.
With sequential writing of huge files like with video recording you'll be more limited by the interface speed than the drive speed, be it HDD or SDD.
You also won't see a benefit from SSDs at this level unless you get high end SSDs.
-
RebeccaBlack wrote on 2012-12-30 22:35
...I might need a RAID card? Ugh. I don't even really know what those things are, so more research to be done I guess. I'm sure they handle the implementation and efficiency of RAID setups just by the name alone, but I'm not sure how much I'd need to spend or anything like that. Guess I'll need to look into this all.