Jump to content

Nigel Smith

  • Content count

  • Joined

  • Last visited

  • Days Won


Everything posted by Nigel Smith

  1. While it's a good idea to enable Full Disk Access in Mojave to allow Retrospect to back up all the files on a machine, it'll rarely have an impact on external volumes. Privacy mainly acts on parts of the user folders -- ~/Library/Mail, ~/Library/Cookies, etc -- and any Time Machine Backup folders. It generally won't be in play when backing up a mounted NAS volume unless that volume has been set as a TM backup target, *possibly* if you're redirecting User directories to the (non-startup) volume, or something similarly funky. In fact, "Error -1101" is almost certainly not a Full Disk Access issue, since that generates an error when scanning -- an error that includes the path to the folder, text to the effect that 'Retrospect has detected it is not listed under "Full Disk Access..."', and a link to the KB article explaining how to fix the problem. In both cases above it is most likely a name, permissions or volume integrity problem. But the various flavours of NAS and client implementations of SAMBA/AFP can make this difficult to troubleshoot...
  2. Nigel Smith

    repetitive SIGSEGV error

    Glad it's sorted -- the rogue attempted startup, anyways. That "...localsnapshots" volume is cruft left over from previous OS's Time Machine -- 10.14 doesn't use it any more. As to why it's being scanned -- you say you're only backing up a couple of directories from the User folder on the system drive. If they are defined as Favourites then nothing else should be scanned (assuming you've tagged them appropriately for your script etc). If you are doing it via Rules, eg. "back up files on this computer if their path matches /Users/..." then Retrospect has to scan every file and folder on the machine looking for matches. That will include other mounted volumes if your tags etc are set that way. Needless to say, for fast scan times when you are only backing up a subset of a computer's data, Favourites are your friend. Bonus tip πŸ˜‰ Step away from the Console log! There's ridiculous amounts of guff in there these days, often with multiple updates a second. Step over to the Eclectic Light Company for a primer on using "log show" and how to isolate log items by time period, use predicates to filter by event or program, etc. I haven't tried their Consolation log viewer myself, but you might find it more friendly than using Terminal.
  3. Nigel Smith

    repetitive SIGSEGV error

    launchd still thinks it should load InstantScan, even if you've turned it off. Try the following in Terminal to stop launchd from trying to load retroisa now, and turn if off for the future: sudo launchctl unload /Library/LaunchDaemons/com.retrospect.retroisa.plist sudo defaults write /Library/LaunchDaemons/com.retrospect.retroisa Disabled -bool true Then check to see if it's worked: sudo launchctl list | grep -i retro ...and, with any luck, you'll see just retroclient and updater listed and not retroisa. How are you choosing those folders -- are they "Favo(u)rites", or are you using rules?
  4. Nigel Smith

    Event Handlers

    Just a note -- that returns the username of the "current active GUI user" (for want of a better term). So if "backup" logs in it will give "backup", if "admin" then logs in using multiuser switching (i.e. "backup" is still logged in but "admin" is active) it returns "admin" -- and if "admin" logs out (but "backup" is still logged in) it returns "root" because you are at the login window. May not be an issue for you with your setup but it would confuse the hell out of me... I tend to hardcode these things -- apparently /var/log is a popular choice for log files πŸ™‚ I'm glad you did! I've never got Script Hooks to work and had assumed the system was borked. Now you've shown otherwise I'll attack it again. Slack integration, here we come!
  5. I've not seen it in the manual but, to be fair, dual active NICs on a client isn't common and they can't document *everything*. Searching the KB for "bind" gets me that linked page as second hit -- although you have to be techie enough to know the term "bind" in relation to NICs and IPs... You don't always have to remove and re-add the client -- depends on how it was added in the first place. But it won't hurt to do so unless you are trying to preserve an easily-followed backup history (and, usually, you do this kind of shenanigans because you can't get any backup to begin a history with!). Connection not showing might be a client-version thing -- certainly works for me in e.g. 15.6.0 As to speed -- unencrypted will be faster than encrypted, fewer large files will be faster than a lot of smaller ones, and so on. Try your own tests and see where the bottleneck is, watch the network usage, CPU %s, and disk I/O rates at both ends, etc. And when you say encryption are you talking encrypted communications, encrypted backup set, or both? (IIRC, Chronosync offers encrypted comms but not the backup itself, instead recommending you use an encrypted disk if you want that sort of thing. But it's been a while...)
  6. Nigel Smith

    Selector doesn't work for only 1 Backup Script

    As promised. The Test Client: "NIG-PC" -- Windows 10 VM, Retrospect 15.6.0, with C drive and external E drive. Both drives had "Test_Data" and "Test_Data2" directories, each with a couple of text files inside. Server: Windows Server 2016, Retrospect Multi Server Premium v15.6.1.104 Client was added by Direct IP with "Volumes" tab "Client Sources" set to "Client Desktop" -- both C and E drives were visible A new disk-based Backup Set called "Filter_Test" was created A new filter called "Filter_Test" was created, initially blank and then edited as per the following screenshots After the filter was edited, an Immediate Backup was created: Source -- "NIG-PC"; Destination -- "Filter_Test"; Selecting -- "Filter_Test". The Preview button was clicked and, once the results generated, the screenshot taken. The Immediate Backup was then cancelled to clear any cached Preview and to force a re-scan for the next test The Results "Windows folder path exactly matches \Test_Data\" -- no drive letter, so nothing is matched: "Windows folder path exactly matches E:\Test_Data" -- no trailing backslash, so nothing is matched: "Windows folder path exactly matches E:\Test_Data\" -- drive letter and trailing slash included, matches only with "Test_Data" on E and not E:\Test_Data2 or C:\Test_Data: So, what about "matches pattern"? We know from the filter dialog tip that "* matches any or no characters and ? matches any single character", but x509 had no special characters in his filter yet still got matches. Let's see what we can find out, starting with a filter similar to x509's... "Windows folder path matches pattern \Test_Data" -- matches Test_Data and Test_Data2 on both drives: "Windows folder path matches pattern \Test_Data\" -- matches Test_Data only on both drives: "Windows folder path matches pattern E:\Test" -- matches Test_Data and Test_Data2 only on the E drive: "Windows folder path matches pattern st_Data" -- matches Test_Data and Test_Data2 on both drives: Conclusion Exact folder matching requires a full path, including the drive letter, and a terminating backslash, i.e. "E:\Test_Data\". The "matches pattern" condition includes invisible "*"s, both prefix and postfix, i.e. if you enter "st_Data" it is actually "*st_Data*". That may be what you want, e.g. the same folder name at different levels of the directory structure across multiple drives on a client, but could also greatly widen the matches beyond what was expected. As always, the more explicit you are the closer the filter results will match your wishes. Vagueness on "includes" can massively increase backup resource requirements, vagueness on "excludes" can result in important data being missed. So test, test, test -- and be careful out there! Note Yes this was all done with "includes" whilst x509 was having trouble with "excludes" -- that's simply because I think it is much easier to see none, one or two ticked boxes amongst a column of unticked in a fuzzy screenshot than to spot the gaps in a line of selected items. But the conclusions above also apply to "excludes", and it's simple enough to verify for yourself if you doubt it. Hope that helps someone!
  7. Nigel Smith

    Selector doesn't work for only 1 Backup Script

    I'm mainly going by (possibly wrong) logic and (possibly incorrect) Retrospect instructions... Windows Explorer and Windows Open/Save dialogs have a "current working directory" and "default working drive" (the C drive) -- for example, in an Explorer window address bar you can use full paths to go to a directory ("C:\Logs") but you can also use relative paths ("..\" will take you up one level from the currently shown directory). If you have a directory called "Data" on both C and D drives, typing "\Data" from any location on your system will always take you to C:\Data and never to D:\Data because there's an implicit "C:" before any path starting with "\". Retrospect Client (assuming you aren't defining volumes/favourites) runs at the "machine" level -- it can "see" all drives so, to reference a particular one, you must state which. I can do no better than quote (again) the tip from Retrospect's "Windows Path" filter dialog: Paths for FAT/NTFS volumes start with a drive letter and use backslashes (\) as separators, as in "C:\Data\". That might, perhaps, be clearer if it was written as: Retrospect path filters for FAT/NTFS volumes... Drive letters aren't exposed on networked systems because the "server" doesn't present them. In a UNC path, e.g. \\MyServer\FirstShare\TheFolder, you could consider the share name to be analogous to the local drive letter. It's just differences in the way Windows abstracts and presents absolute paths to directories/files accessible via various services. It's perhaps more obvious on Mac OS X, where every mounted volume including the system disk can be reached via /Volumes/<volume_name>. I'm trying to find a PC client to test against, but I wouldn't be surprised if you got the results you did because "match" requires a prefixed drive letter, while "match pattern" has an implicit "?:" at the start and so will match C:<pattern>, D:<pattern>, etc.
  8. Nigel Smith

    Selector doesn't work for only 1 Backup Script

    I can only comment that, as a Mac user, the total lack of consistency in Windows itself -- never mind other software houses' Windows apps -- gives me the heebie-jeebies... πŸ˜‰ To be fair, I've just fired up Windows RS Server and checked, and the tip states: Paths for FAT/NTFS volumes start with a drive letter and use backslashes (\) as separators, as in "C:\Data\". ...so it doesn't say it requires a trailing backslash, but does include one in the example. However, you originally said: ...which didn't include the drive letter. That will be mandatory since, unlike your PC's Explorer Address Bar or an app's Open/Save dialog, the Retrospect filter has no concept of "current drive" or "current working directory", so a "match" or "starts with" must begin with drive-letter-colon-backslash. And there's no reason not to include the trading slash, just in case... Still doesn't explain why it suddenly works when you change to "matches pattern" though (I had confused that with "contains", my bad...). If I get time later I'll try a couple of tests.
  9. By default, Retrospect Client will bind to the first available active IP address. In a dual-NIC setup (e.g. network card and wireless in a laptop) that "first available" can vary. So you'll need to tell the client which IP to bind to -- see this page for details. Obviously, only works for static IPs. Luckily it sounds like that's what you are using. That might be enough to get you going. Otherwise, could you re-post the problem but refer to machines as "clients" for the ones you want to back up and "server" for the one doing the RS backup? Like David, I'm getting a bit confused as to what's what!
  10. Nigel Smith

    Selector doesn't work for only 1 Backup Script

    I'm sure they don't -- but they aren't Retrospect! The Retrospect tool tip tells you how to how to do "path matches" -- you must include the drive letter and the trailing slash if you are matching a directory. I'm not saying it *isn't* buggy, just that you shouldn't assume it is if you haven't done things the way the software tells you to...
  11. Even without, that should still give you options -- e.g. to boot via a wireless network. And you should get a password dialog if firmware security has been set. So we're back to the standard fix -- zap the PRAM (Command-Option-p-r at startup and let it chime thrice, for those playing along at home). But only worth worrying about if, like me, you have an uncontrollable urge to pick at such things πŸ˜‰ Never heard of that one! I know a Terminal-fix to force a HS-SSD-HFS+ install but it's pretty geeky, hence the "dug their own hole" comment. I haven't tried it recently but I see no reason why the instructions here won't still work. Perhaps the download included that in its launch instructions. To be fair to Retrospect -- Apple's repeated incremental tightening of security, while laudable, has made "fully functional restores" very much a moving target for all backup solution providers. Even Time Machine doesn't often get it right (we regularly have to re-register third-party software, download drivers, etc), so what chance do the others have? And, given the huge number of potential scenarios, they can't test for everything and so have to rely on us to report back. Kudos to you for bothering, and let's hope they resolve it soon. But I would think that, when bootable restores aren't possible, restore to external HD then Migration Assistant is still a viable alternative.
  12. That would also worry me, because it should work and doesn't. Internet Recovery is a function of firmware. You should be able to boot to the Internet Recovery screen irrespective of network connection etc (although you might have problems after that e.g. if using a non-Apple ethernet adapter). But it can be blocked if you are using firmware security -- have you set a firmware password? Quick way to test would be to boot with the Option key held down -- if you go straight to the boot-disk choice screen you haven't, if you have to enter a password to get the boot-disk choice screen then you have. (Behaviour can vary with firmware version, but the preceding is probably the easiest and most consistent test.)
  13. OS 10.11.6 protects exactly *one* file in /Library -- com.apple.Boot.plist -- which wasn't your problem (unless the problem was over-vaguely reported by Retrospect). OS 10.13 and 14 include a bunch more files/subdirectories in /Library (but not /Library itself), which is why I was asking what version you were restoring to. It sounds like your original restore attempt was to 10.12, since you had an HFS+ SSD. Again, if you'll confirm I'll set a machine up and give it a go. Time Machine doesn't back up a bunch of files which an unfiltered RS backup *will* copy. I believe that, again, this varies by OS version. You can see the list in /System/Library/CoreServices/backupd.bundle/Contents/Resources/StdExclusions.plist ...and it may be that RS is trying to restore a file/folder into a SIP-protected area that Time Machine wouldn't have backed up in the first place! I'm losing track here, and you still haven't said what the OS version of the backed-up laptop was, but it *sounds* like you (eventually) had an 10.12 backup to restore to a 10.13 machine. Retrospect's recommended route for "OS on the new Mac is newer than the backed-up OS" is simply a less comprehensive description of your solution. So it seems to be covered, though perhaps not as fully documented as it could be. The only use-case I can see that is left are those who had an SSD, upgraded to 10.13 without converting to APFS, backed up, and are now trying to restore a 10.13 backup to a 10.13-enforced APFS disk. And if they had the technical knowledge to do the that "non-converting" upgrade then they should be able to get themselves out of the hole they dug for themselves...
  14. Not needed. Command-Option-Shift-R will do an Internet Recovery to the "as shipped" OS version -- including access to Disk Utilities and Terminal so you can nuke the APSF-formatted drive back to an HFS+ one. I don't know what the "Apple database problem" is, but I do know that MacTracker agrees with you as to the original OS version. If you *really* want to check, download the 10.12 installer, make a bootable USB installer with it, boot from that installer and you'll either get the opportunity to install (Stop! Do not pass go!) or a dialog to the effect that "This hardware is not supported". If you want, but can't find, the Sierra installer then let me know -- be warned, it's a 4.8GB download... I'm thinking it's more likely that the "database problem" was simply that 10.12 won't install on an APSF-formatted drive -- if they had managed to get that back to HFS+ first it might have been a different story. Disabling SIP may not have helped you -- that's only one part of Apple's "modern" protection scheme and doesn't (AFAIK) protect /Library. /System and therefore /System/Library, yes -- but not /Library. Other sandboxing elements have been introduced over time, and it might be one of those. I'd still like to have a play, even if the results won't be directly applicable to your situation. So let me know the OS version as of "Saturday night 30 Marchο»Ώ" when this all kicked off and I'll see if I can replicate and check the validity of the "Live Restore" instructions. It's a bit quiet here after the Easter hols, so I'm looking for a project anyway!
  15. What OS was the MBPro on? Asking because that sounds more like Apple's new(-ish) security sandboxing kicking in, rather than an UNIX permissions error. If you fancy trying again, reboot with Command-Option-Shift-R held down -- that should install the OS version the Mac shipped with (unless that's the "Apple database" you mention). I'll confess, we long-ago decided to only back up user data while reinstalling the OS, apps, etc from scratch. Always seems like a good opportunity to clear out the cruft that accumulates over time. But for bare-metal restores in the past I've always connected the Mac-to-be-restored to another Mac (either client or the RS server) in Target Disk mode, though I guess lack of adapter prevented you from doing that initially. I've a spare laptop sitting on the bench right now. Let me know the client OS and I'll set up a test (though it'll be with Server v13) using the "Live Restore" instructions here.
  16. It's how it *does* work with Retrospect client (and has for the last umpteen years), and I've seen other IP-listener daemons do the same. Since you are on a static, just run retroclient.exe /ipsave <static-address> (from the page linked above) on the client and it will always behind to your external interface rather than the virtual one -- no messing with RS Server required.
  17. Nigel Smith

    R16 really slow backups

    Windows 10 updates have killed SMB1 updates before, so I think you've nailed it. It would be better to sort your Synology so it'll work with SMB2 or 3, both for speed and security. How you do that will depend on your DSM version, but you'll find instructions in "Option 1" here <https://www.synology.com/en-global/security/advisory/Precaution_for_a_PotentialSMBVulnerability>. Unless you have a particular requirement to use SMB1?
  18. In my experience, RS Client binds to the first interface it finds to be active -- I often see this when someone has wireless enabled but unused while they are actually using ethernet. Sounds like yours is (sometimes) seeing the virtual interface before the real one. Instead of deleting/re-adding the client, try the instructions here <https://www.retrospect.com/en/support/kb/client_ip_binding> -- whether you use the "temporary" or "permanent" solution will probably depend on whether that machine is DHCPd or on a static IP.
  19. Probably a StorageLoader, then. <https://www.overlandstorage.com/products/tape-libraries-and-autoloaders/neos-storageloader.aspx#Overview> Yes, that'll be manual cleaning. I understand you don't want to mess around too much before the Bank Holiday weekend but, when you're back, these are both easy jobs to do. The first is just spitting out the cleaning tape to the mail slot and removing it, cancelling the "cleaning slot" designation on the library slot, adding a new member to each tape set -- all done through the Retrospect GUI. The second would be setting up static-IP settings as per your network via the StorageLoader's front panel (pp48 of <https://www.overlandstorage.com/pdfs/support/NEO-S-Series-UG-ENG.pdf>, plugging in an ethernet cable, logging in with your web browser then resetting password etc. You can then use the Web GUI to do the important things like check/update the library firmware etc. One word of warning (coz this always catches me out) -- pressing front panel buttons often (always?) rips control from Retrospect but, when you finish, RS (or the Mac OS SCSI routines) can't always gracefully resume operations without a restart. So pick an idle time when, if necessary, you can restart the backup server πŸ˜‰ Ooof! I excluded VHDs from our backups a l-o-n-g time ago, for that very reason. Not a practical solution for you though! And it may be worse than it first looks -- depending on how those VHDs are set up, every previous version of every edited file may still be on the VHD, hidden from a "file explorer" but still present in part or whole on the disk just as they are on a "real" hard drive. While you'll still get compression that might be countered by the large amounts of "unseen" cruft... Others (David? Lennart?) may be able to chip in how how best to manage this -- I've never used block level incremental backups <https://www.retrospect.com/uk/documentation/user_guide/mac/block_level_incremental_backup> or Retrospect Virtual <https://www.retrospect.com/uk/products/virtual>, which are the two quick fixes that leap to mind.
  20. Ah, but what is the library, how is it attached, and to what? I'll take a punt that it is a FlexStor II 1-U, fibre connected. On the face of it that is supported by Retrospect, but so is my fibre-connected Scalar 24 *except* the fibre connection is via a Thunderbolt to fibre adapter, which introduces its own problems -- I see similar SCSI errors to the ones you showed when my adapter has a "moment", and the tape finishes before it is "full" (note that on a sequential-tape system you can't go back and "fill up the gaps" later). You'll see RS's automated cleaning option if you click on "Options" when the drive (not the library) is selected as in your screenshot above. It is in "hours of use" and by default it is "0" (never) and I'd suggest you keep it at that. Cancel the cleaning slot and keep the cleaning tape in your desk for when needed and that'll give you an instant 33% bump in set capacity simply by adding a tape to each, which will buy you time to sort things out. Get the library on the network and use the management GUI to monitor the cleaning requirement instead. How often you'd need to manually load the tape and run a cleaning cycle will depend on your environment but, IMO, most people do it far too often given that LTO drives self-clean every time a cartridge is inserted. The drive/library should tell you when it is required: on the front panel there's probably a "Clean" indicator, and it'll show in (and should be set to email/Slack/SMS/whatever an alert from) the network management UI. And note on backing up the WP installs: Lots of small files will (almost) always take up more space on tape than the same amount of data in one single file -- assuming compression is the same, an unchanged WP install will use more tape capacity than the original installer. Also, many of the WP files across your client folders will be unchanged and thus the same and, under RS's default "don't copy the same thing twice" setting, don't actually get backed up a second/third/100th time and so don't contribute to the "compression percentage". So, across the whole set, the WP *code* contribution is minimal compared to media, assets, etc your clients have uploaded (which, I think, is the point Lennart was trying to get across). Hope some of that ramble helps...
  21. To my eyes, that looks more like a SCSI error causing a premature end to tape writing than an error with the tape itself. Retrospect would, in that case, still move on to the next tape so the effect is the same. Adam, you still haven't said what tapes you are using. I'm guessing from... IBM|ULTRIUM-HH6ο»Ώ|E6R3ο»Ώ ...that Lennard's right and it's an LTO-6, and that Retrospect's reported nominal capacity is bogus. If we are right then, given that you are a media company and probably dealing with already-compressed video etc, I reckon the "space used" on tapes 1 and 2 is both correct and the best you can expect (they're full but mis-reporting spare capacity), i.e. 2.5-3TB per tape because there's minimal compression, while tape 3 "finished early" because of the comms error. So each 3-tape set is barely big enough for your current weekly usage, even without problems like this. But more info would help here -- what are the tapes, what's the drive and firmware version, what machine is the server on and how is it connected to the tape library, etc. Oh, and I wouldn't recommend using Retrospect's "automated cleaning" with LTO drives. The drive itself should flag a cleaning requirement for you, either on its display or via remote management, when it needs it rather than after a certain amount of time.
  22. Generally -- yes, you can use static IPs on (your own, controlled) Wi-fi connections. How you do that will depend on your router's interface (can you assign by MAC, do you "block out" a range from DHCP distribution and manually set from that range on the client, etc). Some low-end boxes may not offer the facility at all, of course...
  23. Unless you have reason not to, update your Mac to 10.11.6 -- that fixed a lot of small 10.11 problems for us, especially as other software was updated to cater for more recent OSs. And try mounting over SMB rather than AFP. While it shouldn't make a difference, it often does -- especially since your NAS is probably running Windows permissions that are being translated so they can be used over AFP, so plenty of scope for "strange behaviour"...
  24. As well as another "What David said...", whilst you can't use the finish of one script to trigger the next, you can set scripts to run sequentially after a single trigger-action by using Run Documents. See page 234 of the Windows guide but, basically, if you open several runs documents at once then the scripts contained will run in alphabetical order. So name them "A - First Script", "B - Second Script", "C..." etc, set them all to use the same execution unit just to be sure, and you should be good. Personally though, I'd just use scripts as others have suggested. Set them to trigger at 1-minute intervals in the order you want, set them all to the same execution unit, and they'll run consecutively.
  25. Nigel Smith

    Copy with Move not working

    These look to be Dropbox folders... First, test the script with a local source instead of the Dropbox folder and see if the problem still happens. I'm expecting it won't πŸ™‚ but, if it does, follow David's suggestion of submitting a bug report. Otherwise you'll have to drill down through your Dropbox sharing settings, ownerships and permissions for those folder -- doing it through the Dropbox web interface will probably be easiest. While you're there, make sure those folders are actually empty! If everything looks OK then it is probably a Dropbox syncing problem -- try deleting those folders via the web interface instead of with Retrospect or through the Finder.