sarlalian Posted November 8, 2012 Report Share Posted November 8, 2012 Getting the Following Error: Catalog File out of sync with Backup Set "NAS04". To repair it, use Tools>Repair Catalog>Update existing Catalog File. System Information: Windows Server 2008 All current updates except for KB967723 applied Running as a VM on Citrix XenServer 5.6 sp2 Retrospect Multi Server Version 7.7.562 The Storage Repository is stored on a Synology Diskstation DS411 with 4 disks in a RAID 10 config. The catalog is stored on local disk on the VM. There are no network issues at this time, and the drives on the storage server appear to have no issues (they show as fine in the UI, and no SMART errors in the logs). I have repaired the catalog 3x but all backup scripts fail with the above error message. I'm guessing that I'll need to rebuild the catalog file, which took > 2 weeks the last time I had to do that. Is there anything else that anyone can think of before I start the rebuild? Quote Link to comment Share on other sites More sharing options...
Lennart_T Posted November 9, 2012 Report Share Posted November 9, 2012 2 weeks???!!!! Yikes! How large is the backup set in GB? How many files are there in the backup set? How is the diskstation connected to the server? Quote Link to comment Share on other sites More sharing options...
mastercam Posted November 9, 2012 Report Share Posted November 9, 2012 Also, did you try to save the catalog file to a new location? (even just a different folder) Quote Link to comment Share on other sites More sharing options...
sarlalian Posted November 9, 2012 Author Report Share Posted November 9, 2012 The full backup set is 3,784.6 G with 4,371,001 files with 1,702 G free. The catalog files are compressed and I haven't yet tried to move them, which is what I am trying now, will update once I know whether that helped or not. Quote Link to comment Share on other sites More sharing options...
Lennart_T Posted November 10, 2012 Report Share Posted November 10, 2012 The full backup set is 3,784.6 G with 4,371,001 files with 1,702 G free. The catalog files are compressed and I haven't yet tried to move them, which is what I am trying now, will update once I know whether that helped or not. OK, You have about 4TB and 5 million files. Not that much.I can recreate catalog files for 1TB of data, about 1.5 million files in about 8 hours. Our hardware is five years old and wasn't really fast even back then. Our NAS servers sits on a gigabit network. Not fibre channel or anything fast. Two weeks is 2*7*24*60 = 20160 minutes. You have 3,875,430 MB of data. Performance when recreating is 192 MB/minute. We get about 10 times that speed. What is your bottleneck? Can you describe your hardware in more detail, please? What else is running on the server? What is the CPU load? Quote Link to comment Share on other sites More sharing options...
sarlalian Posted November 12, 2012 Author Report Share Posted November 12, 2012 The problem with rebuilding the catalog files was not a current problem, but a experience with both a previous version of Retrospect that was running on different hardware. It was an experience that made me hesitant to try again, that said, I started rebuilding our catalog file over the weekend, and the rebuild process is running at about 2.4 G/min, so that should be fine. Quote Link to comment Share on other sites More sharing options...
sarlalian Posted November 20, 2012 Author Report Share Posted November 20, 2012 Ok, repairing the catalog and rebuilding the catalog have had no effect. Tried to recreate the catalog from disk which took a while, but completed successfully. (There were some inconsistencies (3 files missing)). + Executing Rebuild at 11/18/2012 1:28 PM (Execution unit 1) To Backup Set NAS04... The Disk Backup Set data file "AA001153.rdb" reported missing by user The Disk Backup Set data file "AA001176.rdb" reported missing by user Backup Set format inconsistency (5 at 3318147679) Backup Set format inconsistency (5 at 445257399) The Disk Backup Set data file "AA013370.rdb" reported missing by user 11/19/2012 11:35:14 PM: 5 execution errors Completed: 4084227 files, 3,555.3 GB Performance: 1836.2 MB/minute Duration: 1 09:39:31 (00:38:30 idle/loading/preparing) Which was followed up by a failing backup. + Normal backup using Nightly Linux at 11/20/2012 12:35 AM (Execution unit 1) To Backup Set NAS04... 11/20/2012 12:37:51 AM: Connected to devel * Resolved container devel to 3 volumes: / on devel /boot on devel /dev on devel - 11/20/2012 12:35:24 AM: Copying / on devel Catalog File out of sync with Backup Set "NAS04". To repair it, use Tools>Repair Catalog>Update existing Catalog File. 11/20/2012 1:13:29 AM: Execution incomplete Remaining: 3636 files, 24.1 GB Completed: 0 files, zero KB Performance: 0.0 MB/minute Duration: 00:38:04 (00:09:40 idle/loading/preparing) 11/20/2012 1:13:40 AM: Execution incomplete Total duration: 00:37:50 (00:09:40 idle/loading/preparing) So, I attempted to Repair the existing catalog file. This wouldn't work before recreating the catalog from disk. + Executing Rebuild at 11/20/2012 11:47 AM (Execution unit 1) To Backup Set NAS04... 11/20/2012 11:47:43 AM: Execution completed successfully Duration: 00:00:00 Then another failing backup. + Normal backup using Nightly Linux at 11/20/2012 12:11 PM (Execution unit 1) To Backup Set NAS04... 11/20/2012 12:11:45 PM: Connected to devel * Resolved container devel to 3 volumes: / on devel /boot on devel /dev on devel - 11/20/2012 12:11:42 PM: Copying / on devel Catalog File out of sync with Backup Set "NAS04". To repair it, use Tools>Repair Catalog>Update existing Catalog File. 11/20/2012 12:45:11 PM: Execution incomplete Remaining: 3636 files, 24.1 GB Completed: 0 files, zero KB Performance: 0.0 MB/minute Duration: 00:33:29 (00:07:11 idle/loading/preparing) 11/20/2012 12:45:23 PM: Execution incomplete Total duration: 00:33:28 (00:07:11 idle/loading/preparing) The backup server is a VM running on Server 2008, with all patches except for one. 2 Gigs of memory, 100Gib of storage. The actual hardware under the hypervisor is a HP DL360G, with 24G of memory. The VM's are stored on a Netapp FAS2020, with 12 TB of storage. Backups are stored on a Synology DiskStation DS411, with 4x Western Digital Red 2 TB 3.5 inch drives in a Raid 5 group. Previously one of the drives on the NAS was bad and it was operating in a degraded state, mind you the drive failed during the initial rebuild of the catalog, not during a previous backup. Quote Link to comment Share on other sites More sharing options...
Hofstede Posted November 21, 2012 Report Share Posted November 21, 2012 Maybe a wild guess but could it be you have a time difference between the catalog file on the server machine and the NAS? Maybe the errror is caused by a time difference between the catalog file and the backup set? Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.