Author |
Message |
Registered: May 30, 2008 | Posts: 445 |
| Posted: | | | | This will of course be determined by MANY factors, including the speed of your computer, the number of profiles in your database, and other complexities like how detailed / large your local profiles are, cover scans, etc.
My database contains profiles for all the titles I now own (3,087) plus all the titles I have owned in the past (1,439). There are plenty of people with larger collections, but this is a fair number of items for Profiler to be tracking for me. I don't know how many years of my life I've got in manipulating, tagging, documenting in notes, etc., but I'm pretty worried about the loss of data, and I back it up frequently.
I have a pretty robust server type system running Win7 Pro 64-bit on an eight core processor, with 32G of RAM, eight 2.2TB drives in a RAID60 with five hot spares all run off of an LSI Megaraid 9260-16i, including the fancy performance enhancing CacheCade Pro option using three SSD drives as additional cache to the 512MB on the controller itself.
I think the system is pretty fast at most anything it does.
Even so, my backups are taking just over four (4) minutes to complete.
I guess I'm happy about that, but would still like to hear from other people as to their experiences with backup speeds for their collections on their systems. |
|
Registered: March 14, 2007 | Posts: 5,734 |
| Posted: | | | | Quoting lasitter: Quote: would still like to hear from other people as to their experiences with backup speeds for their collections on their systems. Can't say, I select "Backup Database", and when I come back from working, socialising, cooking, running, relaxing, sleeping... the backup is complete. | | | Don't confuse while the film is playing with when the film is played. [Ken Cole, DVD Profiler Architect] |
|
Registered: March 13, 2007 | Reputation: | Posts: 2,217 |
| Posted: | | | | Quoting lasitter: Quote: I guess I'm happy about that, but would still like to hear from other people as to their experiences with backup speeds for their collections on their systems. 0:01:25 for a backup of all 1422 profiles without covers and cast&crewDB. This includes the time to start DVD Profiler because it is done by a batch-file so I don't have to rename the files. | | | Mithi's little XSLT tinkering - the power of XML --- DVD-Profiler Mini-Wiki |
|
Registered: March 14, 2007 | Reputation: | Posts: 6,747 |
| Posted: | | | | I regularily sync my filesystem with another location on a completly different drive. It only takes a few seconds because it only syncs the files that have changed.
I use Beyond Compare but any file comparison tool will do (e.g. WinMerge). | | | Karsten DVD Collectors Online
|
|
Registered: May 30, 2008 | Posts: 445 |
| Posted: | | | | Quoting DJ Doena: Quote: I regularily sync my filesystem with another location on a completly different drive. It only takes a few seconds because it only syncs the files that have changed. So this is basically a file copy operation rather than the File -> Backup Database/ |
|
Registered: May 30, 2008 | Posts: 445 |
| Posted: | | | | Quoting Mithi: Quote: 0:01:25 for a backup of all 1422 profiles without covers and cast&crewDB. So doing it your way (limited backup) I got it under 2:30 for 4,526. That makes a difference for sure. |
|
Registered: March 14, 2007 | Reputation: | Posts: 6,747 |
| Posted: | | | | Quoting lasitter: Quote: Quoting DJ Doena:
Quote: I regularily sync my filesystem with another location on a completly different drive. It only takes a few seconds because it only syncs the files that have changed. So this is basically a file copy operation rather than the File -> Backup Database/ Yes, but it fulfills the same basic purpose. I have a backup of all my data on a different drive which I can restore if I made a major mistake or if my HDD crashed. | | | Karsten DVD Collectors Online
|
|
Registered: March 31, 2007 | Posts: 662 |
| Posted: | | | | Quoting DJ Doena: Quote: Quoting lasitter:
Quote: Quoting DJ Doena:
Quote: I regularily sync my filesystem with another location on a completly different drive. It only takes a few seconds because it only syncs the files that have changed. So this is basically a file copy operation rather than the File -> Backup Database/
Yes, but it fulfills the same basic purpose. I have a backup of all my data on a different drive which I can restore if I made a major mistake or if my HDD crashed. I do this in a similar way. I use Duplicati to do daily backups of my documents folder. Duplicati automatically creates a full backup once a month. All other backups are incremental. Two full backups are stored, older ones are removed. | | | |
|
Registered: March 13, 2007 | Reputation: | Posts: 20,111 |
| Posted: | | | | Backing up everything, with coverscans, headshots, etc... usually only takes me a little under 5 minutes for 5,731 profiles.
3.8gb total size of backup file. | | | Corey | | | Last edited: by Katatonia |
|
Registered: March 14, 2007 | Reputation: | Posts: 6,747 |
| Posted: | | | | I just tried the regular way:
4429 profiles resulting in a 1.06 GB backup file
Source: built-in SSD drive Target: built-in SATA drive
time elapsed: 3 minutes 20 seconds | | | Karsten DVD Collectors Online
|
|
Registered: March 13, 2007 | Reputation: | Posts: 2,217 |
| Posted: | | | | Quoting lasitter: Quote: Quoting Mithi:
Quote: 0:01:25 for a backup of all 1422 profiles without covers and cast&crewDB. So doing it your way (limited backup) I got it under 2:30 for 4,526. That makes a difference for sure. But be careful, the cast&crewDB-exclusion might bite you in the posterior if you use Cast & Crew pictures. If not this thing is quite irrelevant, c&c is of course present in the profiles itself. For the covers I do make a manual backup every once in a long time, because as a phpDVDProfiler-User I have those covers online as a quasi-backup anyways. | | | Mithi's little XSLT tinkering - the power of XML --- DVD-Profiler Mini-Wiki |
|
Registered: March 13, 2007 | Reputation: | Posts: 17,334 |
| Posted: | | | | Thanks for the reminder... forgot to back up here recently.
Full back-up... 7,142 total profiles... 13 minutes.
Size of Back-up: 1.68gb | | | Pete |
|
Registered: March 29, 2007 | Reputation: | Posts: 4,479 |
| Posted: | | | | I have a rather small collection of 1550 movies.
Backup takes about 3 minutes, and is 1.2 Gb. Most of size and time is taken by gallery images (15500) and headshots (~95% of crew and ~60% of cast have headshots). For covers I use rather small images (540x375) since I don't really care about what is on covers. | | | Images from movies | | | Last edited: by surfeur51 |
|
Registered: March 14, 2007 | Posts: 2,337 |
| Posted: | | | | Quoting lasitter: Quote:
I have a pretty robust server type system running Win7 Pro 64-bit on an eight core processor, with 32G of RAM, eight 2.2TB drives in a RAID60 with five hot spares all run off of an LSI Megaraid 9260-16i, including the fancy performance enhancing CacheCade Pro option using three SSD drives as additional cache to the 512MB on the controller itself. Your backup time sounds to be quite normal, so no worries. A bit off-topic, but out of professional curiosity, why such a RAID configuration? Why RAID60, and why 5 Spares!? You have 28,6TB of disc space and with that configuration you are only able to use 8,8TB for your actual data storage. Don't you think it's a bit overkill? You also have to remember that RAID60 write performance isn't the best possible compared to other RAID configurations. That can also effect your backup time. I understood that you have DVDP installed on this same computer and you are using same discs as a source and target for your backup. Since RAID isn't a backup of any kind, how do you backup that disc space? Do you have a tape library or another set of discs? |
|
Registered: March 13, 2007 | Reputation: | Posts: 2,293 |
| Posted: | | | | You guys are so lucky having these nice fast machines... I have about 4,500 titles and I normally do backups without images to speed things up but tried a full back-up today just to see... so
WITHOUT cover scans: 8 minutes. WITH cover scans: 23 minutes.
Which is why I, like bbbbb, set it going and then leave it! | | | It is dangerous to be right in matters where established men are wrong |
|
Registered: March 13, 2007 | Posts: 1,279 |
| Posted: | | | | Similar size collection to Voltaires, no cast & crew pics, the full backup takes 3 mins 15 seconds if I do it directly to my external drive, or 1 min 30 seconds to my C (SSD) drive, plus 50 seconds to copy across to the external. File sizeis 1.05gb so guess the cast & crew pics take a lot of space for those that have them. | | | IVS Registered: January 2, 2002 | | | Last edited: by Lithurge |
|