![]() |
|
|
Thread Tools | Display Modes |
![]() |
#21 | |
EVs Rule
Join Date: Apr 2011
City & State: Leeds
My Country: UK
Line Voltage: 230Vac 50Hz
I'm a: Professional Tech
Posts: 32,374
|
![]() Quote:
The company will send you a 4TB HDD for ~$200 but if you send that back to them, the service is free of charge - you effectively just pay the postage to send it back and they give you a full refund, or you can decide to keep the drive for the $200 deposit. So maybe $20 to get the data back in a few days. Other companies have similar policies, but Backblaze seemed to be one of the most attractive in terms of customer service and software. 100TB is a huge amount of data, I am no where near that level! FWIW they are unlimited in terms of backup (I am guessing that MOST of their customers don't use 100TB of space) but obviously if you had to recover the full 100TB that would take some time and a lot of drives. |
|
![]() |
![]() |
![]() |
#22 | ||
Badcaps Veteran
Join Date: Nov 2011
Posts: 1,595
|
![]() Quote:
Quote:
For example, I store images of all of my COTS optical media IN the magnetic portion of the archive (giving me an optical copy and a magnetic copy). The magnetic copy is much more convenient to access/use -- no need to physically sort through stacks of optical media for the disc in question! Likewise, I image every computer that I build, several times during the build process, so I can restore a computer to one of those states in a matter of minutes (instead of having to reinstall the OS, drivers, updates, apps and configure same). And, build VM's of each "work environment" so I can return to one of those at a future date. And, because "storage is free", I think nothing of adding an object to the archive -- without bothering to check if its already present, in some form, there. But, one of the best consequences of having a big archive is that it forces you to come up with ways of tracking its contents. And, lets you find duplicates of objects that you may not have realized you had! ("Geee, foo.pdf is the same object as 1986Taxes.pdf!") |
||
![]() |
![]() |
![]() |
#23 | |
EVs Rule
Join Date: Apr 2011
City & State: Leeds
My Country: UK
Line Voltage: 230Vac 50Hz
I'm a: Professional Tech
Posts: 32,374
|
![]() Quote:
You having 100 TB would certainly make that harder! I have at most 8 TB of data, about 2 TB of which is backed up (the rest is easily recoverable stuff, or junk like Downloads folder.) |
|
![]() |
![]() |
![]() |
#24 | |
Badcaps Veteran
Join Date: Nov 2011
Posts: 1,595
|
![]() Quote:
It would be "harder" if I lost a significant portion of it. But, as mentioned up-thread, there's a point where I'd just throw up my hands and say "F*ck it!". Currently, I am provided with a list of "object instances" that need to be "restored" accompanied by a volume identifier (disk number) that will allow those objects to be recreated from other instances that have the same contents (but may have different names). E.g., If <23>/foo/bar/taxes.2018 is corrupt (can't be read, struggled to be read, fails its signature check), there may be instances of the same content in <4>/la/dee/dah/2018 and <19>/woop/de/do/IRS. Mounting either volume <4> or <19> (coincident with <23>) will cause taxes.2018 to be "refreshed" with the correct contents (and its original "name" restored). All potential "sources" for a refresh image are logged and a job runs through and tries to minimize the number of different volume combinations that must be mounted to cause the desired updates to occur -- because I often am the physical means of bringing about those mounts! So, if <19> will be needed for some other purpose, it will be suggested as the source for the "taxes.2018" image -- instead of <4>. [The process isn't as verbose as my description suggests. I'm just emailed a report of which volumes I should mount along with a reason (some volumes may just be due for a patrol scan). Figuring out what objects to copy is handled automatically and the repairs noted.] In practice, the messages are all prompts for me to mount volumes that haven't been scanned in their prescribed intervals. E.g., a "store bought" optical medium needs to be "verified" very infrequently -- while a writeable optical disc needs more frequent reassurances. Both are tedious to verify (due to the effort required to load them into a drive and their relatively low storage capacity) so should see less mounts than spinning rust might. But, whenever any medium is mounted, the "jobs" that have been queued for it are automatically executed -- whether they be verification tasks or "refresh" tasks. Given that a medium tends to be mounted for some amount of time longer than the barest minimum required to read the data (or write) that you want to copy from (or add to) the archive, that extra time where the drive would otherwise be idle can be used to process any outstanding jobs -- or, get ahead on verification tasks for object instances on the medium that may not yet be "due" for verification. Trying to keep such a local copy of an archive (or "Backup") in sync with a copy stored on a remote server would be problematic -- you'd have to summarize the remote data (hashes) and, thereafter, assume the data is never corrupted and only pay the price for retrieving it when you determine that a local instance has been corrupted. Last edited by Curious.George; 12-29-2018 at 06:05 AM.. |
|
![]() |
![]() |
![]() |
#25 |
HC Overclocker
Join Date: Jul 2012
City & State: Singapore
My Country: Singapore
Line Voltage: 240VAC 50Hz
I'm a: Hobbyist Tech
Posts: 1,626
|
![]() lol i think curious george doesnt need anyone or any stinkin' web based cloud management system to store his stuff for him. he can more than handle everything himself. i dont think there is a cloud based storage solution out there that is as good as or if not, better than his current implementation.
what he should do though, is to sell his locally based data storage solution and archival system as some kind of a software kit. im sure such a product differentiation would stand out in the market and offer a breath of fresh air compared to all the web based cloud storage solutions out there. so its basically, locally based data storage vs cloud based data storage. so if u dont trust someone else to store your private data for you, just buy the locally based data storage solution software. im sure u can trust yourself not to be pebkac when setting it up, right? ![]() |
![]() |
![]() |
![]() |
#26 | ||
Badcaps Veteran
Join Date: Nov 2011
Posts: 1,595
|
![]() Quote:
Quote:
OTOH, you WANT to be able to delete every instance of a file. A RAID/ZFS configuration sits between the user and the store so it has some say over what happens -- and, a means of providing "real-time" reporting to the user as he acts on the store. As well as taking remedial actions as soon as needed instead of "when you get around to it". The user has no direct responsibility in its performance. But, that requires all of the media to be mounted and spinning at all times. I can't afford the thermal load that would represent nor the waste of electricity. And, I imagine it would adversely affect the reliability of the store, especially when it is accessed at such a low utilization rate (contrast with a regular file server that gets hammered on for daily use). OTOH, some of the mechanisms I've put in place can be applied to filestores, in general. E.g., being able to locate duplicate files "for free". |
||
![]() |
![]() |
![]() |
#27 |
5000!
Join Date: Dec 2011
City & State: South Greeley, Wyoming
My Country: US
Line Voltage: 13.9kv HT service and some 240v center tap oddity.
I'm a: Professional Tech
Posts: 3,981
|
![]() Anyway you could ship that dead SSD out here? After my research on the Sandforce controller that crapped out on my Chronos SSD, ive learned a bit about SSDs and their failure modes, and this one is very odd.
__________________
Things I've fixed: anything from semis to crappy Chinese $2 radios, and now an IoT Dildo.... "Dude, this is Wyoming, i hopped on and sent 'er. No fucking around." -- Me Excuse me while i do something dangerous You must have a sad, sad boring life if you hate on people harmlessly enjoying life with an animal costume. Sometimes you need to break shit to fix it.... Thats why my lawnmower doesn't have a deadman switch or engine brake anymore ![]() |
![]() |
![]() |
![]() |
#28 |
Badcaps Veteran
Join Date: Nov 2011
Posts: 1,595
|
![]() Any insights into recovering/accessing data in the over-provisioned portions of the drive?
|
![]() |
![]() |
![]() |
#29 | |
5000!
Join Date: Dec 2011
City & State: South Greeley, Wyoming
My Country: US
Line Voltage: 13.9kv HT service and some 240v center tap oddity.
I'm a: Professional Tech
Posts: 3,981
|
![]() Quote:
With the sandforce controller i do know the mapping can be worked out via way of a known file (EG, BOOTMGR) from the individual flash chips and the (weak) private key used by the controller for encryption. Last edited by goontron; 12-30-2018 at 09:14 PM.. Reason: Get your typos in check Nix... |
|
![]() |
![]() |
![]() |
Thread Tools | |
Display Modes | |
|
|