Don Lee Posted April 27, 2012 Report Share Posted April 27, 2012 I rebuilt 4 retro 6.1 "quarterly" sets from tape, and copied the data to a single disk set. The fourth set suffered from the problem above, with the zillions of "inconsistency (2 at ....)" errors, and then the resultant rebuilt catalog was empty. (see here ) I just upgraded to Retro 9.0.2, and re-did the catalog rebuild. To my surprise, the catalog is being built *cleanly* - no errors. Is this a fix in 9.0.2? Is this an intermittent bug in 9.0.1? Is the process of reading the tape unreliable? What's up with this? Quote Link to comment Share on other sites More sharing options...
Don Lee Posted April 27, 2012 Author Report Share Posted April 27, 2012 I spoke too soon. On the third tape, I got some errors. The output in the log is different, though. With 9.0.1, I ended up with zero files in the rebuilt catalog. With 9.0.2, I have 2940 files. Much better! I'd be curious to see whether running it again under 9.0.2 would produce yet another variation on behavior, but I don't have time. My log with 9.0.1.401: + Executing Rebuild at 4/26/12 (Activity Thread 1) To Backup Set MercyShare11 [010]... !Backup Set format inconsistency (2 at 1884360320) !Backup Set format inconsistency (2 at 308217920) !Backup Set format inconsistency (2 at 308215904) !Backup Set format inconsistency (2 at 308214864) !Backup Set format inconsistency (2 at 308213664) !Backup Set format inconsistency (2 at 308212656) !Backup Set format inconsistency (2 at 308211616) !Backup Set format inconsistency (2 at 308210544) !Backup Set format inconsistency (2 at 308209712) !Backup Set format inconsistency (2 at 308207408) !Backup Set format inconsistency (2 at 308206336) !Backup Set format inconsistency (2 at 308205264) !Backup Set format inconsistency (2 at 308204176) !Backup Set format inconsistency (2 at 308202304) !Backup Set format inconsistency (2 at 308202336) !Backup Set format inconsistency (2 at 308200048) !Backup Set format inconsistency (2 at 308199136) !Backup Set format inconsistency (2 at 308198384) !Backup Set format inconsistency (2 at 308196304) !Backup Set format inconsistency (2 at 308195344) !Backup Set format inconsistency (2 at 308194384) !Backup Set format inconsistency (2 at 308193312) !Backup Set format inconsistency (2 at 308191568) !Backup Set format inconsistency (2 at 308191600) !Backup Set format inconsistency (2 at 308189248) !Backup Set format inconsistency (2 at 308188144) !Backup Set format inconsistency (2 at 308187328) !Backup Set format inconsistency (2 at 308185008) !Backup Set format inconsistency (2 at 308183968) !Backup Set format inconsistency (2 at 308183040) !Backup Set format inconsistency (2 at 308181888) !Backup Set format inconsistency (2 at 308179552) !Backup Set format inconsistency (2 at 308179584) !Backup Set format inconsistency (2 at 308177312) !Backup Set format inconsistency (2 at 308176272) !Backup Set format inconsistency (2 at 308175408) !Backup Set format inconsistency (2 at 308173104) !Backup Set format inconsistency (2 at 308170592) !Backup Set format inconsistency (2 at 308169456) !Backup Set format inconsistency (2 at 308167536) !Backup Set format inconsistency (2 at 308165536) !Backup Set format inconsistency (2 at 308165568) !Backup Set format inconsistency (2 at 308162960) !Backup Set format inconsistency (2 at 308161872) !Backup Set format inconsistency (2 at 308160960) !Backup Set format inconsistency (2 at 308158624) !Backup Set format inconsistency (2 at 308157664) !Backup Set format inconsistency (2 at 308156672) !Backup Set format inconsistency (2 at 308155536) !Backup Set format inconsistency (2 at 308153728) !Backup Set format inconsistency (2 at 308153760) !Backup Set format inconsistency (2 at 308151280) !Backup Set format inconsistency (2 at 308150176) !Backup Set format inconsistency (2 at 308149344) !Backup Set format inconsistency (2 at 308147024) !Backup Set format inconsistency (2 at 308145984) !Backup Set format inconsistency (2 at 308144848) !Backup Set format inconsistency (2 at 308143664) !Backup Set format inconsistency (2 at 308141840) !Backup Set format inconsistency (2 at 308141872) !Backup Set format inconsistency (2 at 308139632) !Backup Set format inconsistency (2 at 308138640) !Backup Set format inconsistency (2 at 308137888) !Backup Set format inconsistency (2 at 308135664) !Backup Set format inconsistency (2 at 308134528) !Backup Set format inconsistency (2 at 308133408) !Backup Set format inconsistency (2 at 308132288) !Backup Set format inconsistency (2 at 308130512) !Backup Set format inconsistency (2 at 308130544) !Backup Set format inconsistency (2 at 308128224) !Backup Set format inconsistency (2 at 308127184) !Backup Set format inconsistency (2 at 308126304) !Backup Set format inconsistency (2 at 308123968) !Backup Set format inconsistency (2 at 308122672) !Backup Set format inconsistency (2 at 308121664) !Backup Set format inconsistency (2 at 308120624) !Backup Set format inconsistency (2 at 308118768) !Backup Set format inconsistency (2 at 308118800) !Backup Set format inconsistency (2 at 308116304) !Backup Set format inconsistency (2 at 308114560) !Backup Set format inconsistency (2 at 308113808) !Backup Set format inconsistency (2 at 308111616) !Backup Set format inconsistency (2 at 308110528) !Backup Set format inconsistency (2 at 308109536) !Backup Set format inconsistency (2 at 1884360320) !Backup Set format inconsistency (2 at 308106144) !Backup Set format inconsistency (2 at 308105024) !Backup Set format inconsistency (2 at 308103840) !Backup Set format inconsistency (2 at 308101984) !Backup Set format inconsistency (2 at 308100896) !Backup Set format inconsistency (2 at 308099744) !Backup Set format inconsistency (2 at 308098768) !Backup Set format inconsistency (2 at 308097136) !Backup Set format inconsistency (2 at 308097168) !Backup Set format inconsistency (2 at 308094672) !Backup Set format inconsistency (2 at 308093072) !Backup Set format inconsistency (2 at 308092192) !Backup Set format inconsistency (2 at 308089936) !Backup Set format inconsistency (2 at 308088976) !Backup Set format inconsistency (2 at 308088000) !Backup Set format inconsistency (2 at 308086960) !Backup Set format inconsistency (2 at 308085280) !Backup Set format inconsistency (2 at 308085312) !Backup Set format inconsistency (2 at 308083008) !Backup Set format inconsistency (2 at 308081808) !Backup Set format inconsistency (2 at 308079728) !Backup Set format inconsistency (2 at 308077264) !Backup Set format inconsistency (2 at 308076176) !Backup Set format inconsistency (2 at 308075088) !Backup Set format inconsistency (2 at 308074000) !Backup Set format inconsistency (2 at 308072288) !Backup Set format inconsistency (2 at 308072320) !Backup Set format inconsistency (2 at 308069776) !Backup Set format inconsistency (2 at 308068752) !Backup Set format inconsistency (2 at 308067952) !Backup Set format inconsistency (2 at 308065136) !Backup Set format inconsistency (2 at 308063696) !Backup Set format inconsistency (2 at 308062320) !Backup Set format inconsistency (2 at 308061168) !Backup Set format inconsistency (2 at 308059424) !Backup Set format inconsistency (2 at 308059456) !Backup Set format inconsistency (2 at 308056944) !Backup Set format inconsistency (2 at 308055824) !Backup Set format inconsistency (2 at 308054880) !Backup Set format inconsistency (2 at 308052688) !Backup Set format inconsistency (2 at 308051744) !Backup Set format inconsistency (2 at 308050752) !Backup Set format inconsistency (2 at 308049696) !Backup Set format inconsistency (2 at 308047936) !Backup Set format inconsistency (2 at 308047968) !Backup Set format inconsistency (2 at 308045392) !Backup Set format inconsistency (2 at 308044400) !Backup Set format inconsistency (2 at 308043504) !Backup Set format inconsistency (2 at 308041232) !Backup Set format inconsistency (2 at 308040160) !Backup Set format inconsistency (2 at 308039104) !Backup Set format inconsistency (2 at 308037984) !Backup Set format inconsistency (2 at 308036272) !Backup Set format inconsistency (2 at 308036304) !Backup Set format inconsistency (2 at 308033968) !Backup Set format inconsistency (2 at 308032960) !Backup Set format inconsistency (2 at 308032080) !Backup Set format inconsistency (2 at 308029712) !Backup Set format inconsistency (2 at 308027760) !Backup Set format inconsistency (2 at 308026736) !Backup Set format inconsistency (2 at 308025216) !Backup Set format inconsistency (2 at 308023392) !Backup Set format inconsistency (2 at 308023424) !Backup Set format inconsistency (2 at 308020864) !Backup Set format inconsistency (2 at 308019808) !Backup Set format inconsistency (2 at 308019008) !Backup Set format inconsistency (2 at 308016736) !Backup Set format inconsistency (2 at 308015712) !Backup Set format inconsistency (2 at 308014752) !Backup Set format inconsistency (2 at 308013792) !Backup Set format inconsistency (2 at 308012048) !Backup Set format inconsistency (2 at 308012080) !Backup Set format inconsistency (2 at 308009632) !Backup Set format inconsistency (2 at 308008688) !Backup Set format inconsistency (2 at 308007808) !Backup Set format inconsistency (2 at 308005536) !Backup Set format inconsistency (2 at 308004480) !Backup Set format inconsistency (2 at 308002320) !Backup Set format inconsistency (2 at 308001264) !Backup Set format inconsistency (2 at 307997856) !Backup Set format inconsistency (2 at 307997888) !Backup Set format inconsistency (2 at 307995680) !Backup Set format inconsistency (2 at 307994576) !Backup Set format inconsistency (2 at 1884360320) !Backup Set format inconsistency (2 at 307993728) !Backup Set format inconsistency (2 at 307990416) !Backup Set format inconsistency (2 at 307989296) !Backup Set format inconsistency (2 at 307988400) !Backup Set format inconsistency (2 at 307987280) !Backup Set format inconsistency (2 at 307986192) !Backup Set format inconsistency (2 at 307984320) !Backup Set format inconsistency (2 at 307984352) !Backup Set format inconsistency (2 at 307981936) !Backup Set format inconsistency (2 at 307981040) !Backup Set format inconsistency (2 at 307980160) !Backup Set format inconsistency (2 at 307977760) !Backup Set format inconsistency (2 at 307976720) !Backup Set format inconsistency (2 at 307975696) !Backup Set format inconsistency (2 at 307974016) !Backup Set format inconsistency (2 at 307972304) !Backup Set format inconsistency (2 at 307972336) !Backup Set format inconsistency (2 at 307969808) !Backup Set format inconsistency (2 at 307968864) !Backup Set format inconsistency (2 at 307968000) !Backup Set format inconsistency (2 at 307965728) !Backup Set format inconsistency (2 at 307964640) !Backup Set format inconsistency (2 at 307963536) !Backup Set format inconsistency (2 at 307962400) !Backup Set format inconsistency (2 at 307960656) !Backup Set format inconsistency (2 at 307960688) !Backup Set format inconsistency (2 at 307958272) !Backup Set format inconsistency (2 at 307957200) !Backup Set format inconsistency (2 at 307956416) !Backup Set format inconsistency (2 at 307953536) !Backup Set format inconsistency (2 at 307952560) 4/26/12 2:28:29 PM: Execution completed successfully Duration: 04:44:27 (00:26:22 idle/loading/preparing) + Executing Unloading media... at 4/26/12 4/26/12 6:52:27 PM: Execution completed successfully and now my log with 9.0.2.107: + Executing Rebuild at 4/26/12 (Activity Thread 1) To Backup Set MercyShare11 [010]... !Backup Set format inconsistency (4 at 286205456) !Backup Set format inconsistency (4 at 286206288) !Backup Set format inconsistency (4 at 286207216) !Backup Set format inconsistency (4 at 286208144) !Backup Set format inconsistency (4 at 286209072) !Backup Set format inconsistency (4 at 286210000) !Backup Set format inconsistency (4 at 286210928) !Backup Set format inconsistency (4 at 286211856) !Backup Set format inconsistency (4 at 286212784) !Backup Set format inconsistency (4 at 286213712) !Backup Set format inconsistency (4 at 286214640) !Backup Set format inconsistency (4 at 286215568) !Backup Set format inconsistency (4 at 286216496) !Backup Set format inconsistency (4 at 286217424) !Backup Set format inconsistency (4 at 286218352) !Backup Set format inconsistency (4 at 286219280) !Backup Set format inconsistency (4 at 286220208) !Backup Set format inconsistency (4 at 286221136) !Backup Set format inconsistency (4 at 286222064) !Backup Set format inconsistency (4 at 286222992) !Backup Set format inconsistency (4 at 286223920) !Backup Set format inconsistency (4 at 286224848) !Backup Set format inconsistency (4 at 286225776) !Backup Set format inconsistency (4 at 286226704) !Backup Set format inconsistency (4 at 286227632) !Backup Set format inconsistency (4 at 286228560) !Backup Set format inconsistency (4 at 286229488) !Backup Set format inconsistency (4 at 286230416) !Backup Set format inconsistency (4 at 286231344) !Backup Set format inconsistency (4 at 286232272) !Backup Set format inconsistency (4 at 286233200) 4/27/12 2:23:42 PM: Execution completed successfully Completed: 2940 files, 38.2 GB Performance: 151.9 MB/minute Duration: 14:53:16 (10:35:28 idle/loading/preparing) Quote Link to comment Share on other sites More sharing options...
Don Lee Posted May 4, 2012 Author Report Share Posted May 4, 2012 Follow up on this: As detailed here, I have found that different runs behave differently. There is clearly some state either in the drive or in the retrospect engine that will cause different behaviors when the drive is power cycled. I do not have enough data points to say anything conclusive, but evidence suggests that the state is in the HP tape *drive*, because my last success after a zero-length-rebuild was to power cycle the drive and re-scan for it without restarting the engine. I still got some errors (out of memory on third tape, and a few "inconsistency " errors), but most of the files were found in the rebuilt catalog. Quote Link to comment Share on other sites More sharing options...
Don Lee Posted May 7, 2012 Author Report Share Posted May 7, 2012 I have identified one cause for different results on different operations, the apparent race condition when loading the tape drive, as documented here. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.