Jump to content


  • Content count

  • Joined

  • Last visited

  • Days Won


Posts posted by jotrago

  1. Perhaps I should have more correctly stated that Instant Scan only works on Windows Hosts with NTFS volumes (and NTFS Journals), and the Retrospect client installed directly on the host.

    NAS boxes share files use the open source SAMBA suite to present files using the SMB / CIFS protocol independently of the underlying file system. Most NAS Units run a variant of Linux and use EXT, ZFS, or BTRFS file systems under the hood, all of which are journaling file systems, but not NTFS, and hence would not work with Instant Scan.

    Even Windows NAS Servers ( Windows Storage Server) present their NTFS files as SMB/CIFS shares. (But of course, being Windows, you could install the Retrospect client on them and take advantage of Instant Scan because they DO use the NTFS file system under the hood)

    I do also admit that my approach would not reduce Volume Scan times, whereas Lennart's approach would.

  2. AFAIK Instant Scan works only on NTFS volumes as it relies on the NTFS File System Journal. Therefore it is unlikely to work on a NAS.


    For your situation I would recommend the following:-

    Create your scripts for the specific volumes to be backed up to their own BackupSets as you have already done.

    For the Project folders create a Projects script targeting the whole volume, and then create Selectors to EXCLUDE the regular folders catered for by other scripts.

    This script will then backup ANYTHING that appears in the volume EXCEPT the regular folders.
    Selectors provide a very powerful method to control exactly what gets backed up. See the docs and my note here

  3. OR

    Create a new Backupset on the new drive

    Then transfer the snapshots from the old backupset to the new one, you have the choice of transferring the entire backupset, or just the latest or selected snapshots.

    Update your scripts etc with the new BackupSet name.

    The advantage of this approach is that the entire process is done under Retrospect’s, control with logging and reporting.

  4. As you have found, Retrospect names its tapes with a sequence number and the Backup set name.

    The pre-labelled tapes you have will be the barcode labels intended for use in a library or auto loader. Since you have a standalone drive with no barcode reader, the tape labels are irrelevant.

    I would simply get some sticky labels and relabel the tapes according to the Retrospect numbering scheme.

    You can add them all to the backup set in advance by inserting the tapes one by one, and clicking the ADD button, and then write the label for the name that Retrospect gives for each tape. It's a bit laborious but you only have to do it once.

    This scheme works perfectly for me


    • Like 1

  5. The transfer is a copy function, so the data on your source tapes will remain intact.

    Depending on your plans for the source tapes you may want to consider the transfer options.

    Transferring ALL snapshots will transfer the entire data of all 25 tapes, maybe not quite what you want.

    If you want to Seed a new set of tapes to use going forward, and keep the Source tapes for history, then consider transferring the most recent snapshot.

    This will have the effect of transferring the most recent full backup to your new backupset.

    You can then start adding new backups to it, and only the changes will be updated.

  6. You might want to investigate "Transferring BackupSets" the process has options for what you want to transfer. See User guide for details on this.

    This would be easiest if you have two Drives, you can create a new backupset, and transfer snapshots into it.

    If not you would need to transfer to a disk set first, then to tape.

  7. WINS also relies on Broadcast and on Netbios which most VPNs do not forward by default. Depending on your VPN it may be possible to configure it to allow these broadcast packets (I use a Draytek Vigor Router for my VPNs which has an option to allow BroadCast and Netbios packets to traverse the VPN. )


    With Fixed Addressing the VPN server allocates the remote device an IP address when setting up the VPN, this is either done by the VPN service itself, which may have a facilitiy to set a fixed IP per devince, or otherwise they pass on the request to the Local DHCP Server, where again it may be possible to allocate a fixed address.

  8. I think you may find it comes down to your VPNs. Most by default do not forward broadcast traffic and the default Piton Client discovery mechanism relies on broadcast. 

    You may be able have the VPN configured to allow all or some broadcast traffic, depending on the implementation.

    Further your remote devices probably get allocated random addresses from a pool when they connect via the VPN, so when you specify the client manually it will work until the next reconnect when it may then have a different address, There is even the possibility of clients clashing. EG if Client A picks up address .123.123 today and backs up successfully, then tomorrow Client B connects and gets given address .123.123 then Retro is going to get very confused.

    You may need to investigate mechanisms to allocate your remote clients fixed addresses, eg Mac Binding in your DHCP Server.

    Hope this helps

    • Like 2

  9. Silent Install with pubkey.dat for Automatic Client Adding


    Unpack the Tar, copy folder to Downloads or suitable location

    In the installation folder create folder public_key, add the pubkey.dat file


    Run the install with --silent option


    johng@Centaur ~/Downloads/Linux_Client_x64_11_0_0_107 $ ls
    Install.sh  public_key  RCL.tar
    johng@Centaur ~/Downloads/Linux_Client_x64_11_0_0_107 $ sudo ./Install.sh --silent
    Install Retrospect Client? (y/n): 
    Adding RETROSPECT_HOME to system profile and login scripts...Done!
    Starting client as daemon... 
    Retrospect Client for Linux started successfully!
    Your system appears to be compatible with the startup system used 
    by Ubuntu and Debian. Would you like to modify rc.local 
    to automatically start Retrospect Client for Linux? (y/n): 
    johng@Centaur ~/Downloads/Linux_Client_x64_11_0_0_107 $

    Post Installation analysis






  10. Been running smoothly for a month now. Using a ProActive script backups are running as scheduled every other day. 20 odd backups in the can, usually with no errors at all, occasionally an issue with a log file or such that had changed during the backup.

    Albion is the Client, Gladiator is the Server

    Log Samples

    RetroHistory Log

    2016-09-07 22:07: Script "Albion" (GLADIATOR): /home, Execution completed successfully
    2016-09-09 22:07: Script "Albion" (GLADIATOR): /home, Execution completed successfully
    2016-09-11 22:25: Script "Albion" (GLADIATOR): /home, Execution completed successfully
    2016-09-17 22:31: Script "Albion" (GLADIATOR): /home, 2 execution errors
    2016-09-20 22:25: Script "Albion" (GLADIATOR): /home, Execution completed successfully


    RetroClient Log

    2016-09-22T07:59:11: Client version is
    2016-09-22T07:59:15: Multicast advertising on address:
    2016-09-22T07:59:22: ipludProc: Name service listener already running.



    2016-09-20T08:15:23: Client version is
    2016-09-20T08:15:28: Multicast advertising on address:
    2016-09-20T08:15:39: ipludProc: Name service listener already running.
    2016-09-20T22:25:17: Log: 2016-09-20 22:25: Script "Albion" (GLADIATOR): /home, Execution completed successfully

  11. You cannot delete stuff you DONT want out of a tape backup set. Grooming ONLY works on Disk Backup Sets

    But you CAN transfer stuff you DO want.

    You don't need to know where any of the backups are.

    If you setup a transfer job to a new Backupset for the Snapshot(s) that you DO want to keep, Retrospect will ask for the required tapes.

    Once complete you can recycle the old backup set tapes, which will delete the unwanted data.

    Ideally this works if you have 2 tape drives, or you would need sufficient space on a Disk Backup Set to recover the wanted backups, and then transfer them again back to tape.

  12. Retrospect has a selector with a default set of exclusions for windows.

    I set about creating one for Ubuntu Linux Workstations.

    I found this very useful article on AskUbuntu, and used it as my base.

    This is my Exclusion list, you may well need to tune it a bit for your own situation



    .dropbox and / or your favourite Web Storage(s)


    Folders &/ Files






    Selector File Attached

    • Like 1

  13. I finally got round to testing the new(ish) 64Bit Native Linux client on my Mint 17.3 (Ubuntu 14.04) Workstation.


    It works well, and here are my detailed results




    20160730 Retro Client Linux  -  Retrospect MultiServer on Win XP 32


    Tar Package containing an install.sh script and a .rcl package



    Open  Install.sh in gedit



    Logged in as Root or Run Install.sh as SUDO

    /usr/local must exist

    Installation folder /usr/local/retrospect/client


    Handles Upgrades - Checks for existing client


    Supports the Client Public Keys for Automatically adding clients

    Place keys in /usr/local/retrospect/client/public_key/pubkey.dat


    Installs Man & Info Pages












    retroclient.history          text

    retroclient.log                text

    retroclient.log.0.log        opens with LibreOfficeWrter

    retroclient.log.1.log etc  opens with LibreOfficeWrter

    retroclient.state             binary

    retropds.log                  opens with LibreOfficeWrter



    Unpack the Tar, copy folder to Downloads

    Open Terminal in folder

    sudo ./Install.sh


    johng@Mint17-3Dev ~/Downloads/Linux_Client_x64_11_0_0_107 $ sudo ./Install.sh

    [sudo] password for johng:


    Install Retrospect Client? (y/n): y


    Enter first access password:

    Retype the first access password:


    Adding RETROSPECT_HOME to system profile and login scripts...Done!

    Starting client as daemon...


    Retrospect Client for Linux started successfully!

    Your system appears to be compatible with the startup system used

    by Ubuntu and Debian. Would you like to modify rc.local

    to automatically start Retrospect Client for Linux? (y/n): Y


    johng@Mint17-3Dev ~/Downloads/Linux_Client_x64_11_0_0_107 $




    Unpack the Tar, copy folder to Downloads

    Open Terminal in folder


    johng@Mint17-3Dev ~/Downloads/Linux_Client_x64_11_0_0_107 $ ls

    Install.sh RCL.tar

    johng@Mint17-3Dev ~/Downloads/Linux_Client_x64_11_0_0_107 $ sudo ./Install.sh

    [sudo] password for johng:


    Install Retrospect Client? (y/n): Y


    Adding RETROSPECT_HOME to system profile and login scripts...Done!

    Starting client as daemon...


    Retrospect Client for Linux started successfully!

    Upgrade completed successfully


    johng@Mint17-3Dev ~/Downloads/Linux_Client_x64_11_0_0_107 $




    Post Installation analysis


    rcl script


    retrocpl - text control panel







    Added line "/usr/local/retrospect/client/rcl start "



    retroclient.history text

    retroclient.log text

    retroclient.log.0.log opens with LibreOfficeWrter

    retroclient.log.1.log etc opens with LibreOfficeWrter

    retroclient.state binary

    retropds.log opens with LibreOfficeWrter




    Retroclient is started by default at boot up


    It's a system process running under root, so does not show in System Monitor by Default

    Set View to "All Processes"


    Run retrocpl to check status


    johng@Mint17-3Dev /usr/local/retrospect/client $ ./retrocpl

    Server "Mint17-3Dev":


    back up according to normal schedule

    currently on

    readonly is off

    exclude is off

    0 connections, 0 authenticated


    Check for the retroclient process

    johng@Albion ~ $ ps -e | grep retro

    1744 ?        00:30:22 retroclient


    On Retro Server

    Configure > Clients > Add

    New Linux Client should be detected - ADD > Enter Password > Confirm Name > Done

    Client Goes Active



    Refresh Check connected & Speed - OK

    Check Options




    Configure > Volumes >

    Lots of system volumes in here

    Some have Icons on eg /

    I set mine to Selected Volumes and Selected Home




    See White Paper





    johng@Mint17-3Dev ~ $ man retroclient


    retroclient(1) General Commands Manual retroclient(1)



    retroclient - Retrospect Client



    retroclient [OPTIONS]



    retroclient is the Retrospect Client. When executed, it enables communication with a Retrospect

    application running under Windows on another computer. From the Retrospect application, you can

    access volumes on the client computer and back up, restore, or duplicate files. If retroclient is

    run with no arguments, the client is started.




    Prompt the user to set the first access password. Once set, the password can be changed from

    only the Retrospect application.


    -log n Set the logging level to n (default = 6). Logs are saved in /var/log/retroclient.log and



    --help Display help text and exit.



    Copyright 2015 Retrospect, Inc.





    Version 9.5 July 2015 retroclient(1)


    johng@Mint17-3Dev ~ $ man retrocpl



    retrocpl(1) General Commands Manual retrocpl(1)



    retrocpl - Retrospect Client Control Panel



    retrocpl [OPTIONS] [-proactive PROACTIVE_OPTIONS]



    retrocpl is the conrol panel application for the Retrospect Client. The control panel provides a

    way to view and modify the client settings. If retrocpl is run with no arguments the status of the

    client is reported.



    -stop Shut down the client process.


    -readonly [on | off]

    Set the client read-only mode (default is read/write).


    -exclude [on | off]

    Turn on or off the processing of /etc/retroclient.excludes.


    -log n Set the logging level to n (default = 6). Logs are saved in /var/log/retroclient.log and



    -proactive PROACTIVE_OPTIONS

    Configure the Proactive Backup options.


    --help Display help text and exit.



    asap Request a backup as soon as possible.


    normal Return to the normal backup schedule.



    Defer the backup until after the specified time.



    Defer backup for n days.



    © 2015 Retrospect, Inc.





    Version 9.5 July 2015 retrocpl(1)




    One installation on a Mint 17 VM did not add the start command to /etc/rc.local

    Added line "/usr/local/retrospect/client/rcl start " manually


    Check with retrocpl - Client running OK

    • Like 2

  14. Catalog files can get very big, especially if you have few backupsets that remain in use for long periods between Recycling. Several Gigs and higher is not uncommon.


    Consider creating separate duplication jobs for your config file and catalogs, so they are available as normal files (not a backup set) in the event of a Disaster.

    See the User Guide > CH10 Management > Catalog & Config backups

    and User Guide > CH10 Management > Moving Retrospect.


    As you can imagine writing to the catalog files is quite intensive as the metadata for thousands of files is written in to them.

    It is good practice where possible to use separate disk drives for Catalogs, Backupsets, and System / OS / Applications.

    Retrospect also makes intensive use of the Windows Temp folders.

  15. Generally this type of message indicates that Retrospect has run into an underlying windows OS error while performing a function.

    You can check these by using the windows "net helpmsg 1001" command on the CLI.

    Usually the message itself is not that helpful, in this case you will get "Recursion too deep; the stack overflowed."

    However the point is that the error is in Windows. Checking the System Event log for the error may provide additional clues, as well as googling the windows error message itself. Try "event id 1001 Recursion too deep; the stack overflowed"

  16. Just another point, you don't say how many LTO drives you have, but I suspect that if the system hosting the LTO Drive has the LTFS Drivers loaded to make the LTO appear in the file system, then you probably will not be able to use that drive for Retrospect Tape backups.

    I would imagine that an LTO drive is mounted EITHER as a conventional Tape Drive, OR and an LTFS. but NOT BOTH

  17. We had a discussion on LTFS a while back, this may shed some light



    In terms of having Retrospect write to an LTFS File system, this is not recommended for Retrospect Backup Sets, but  using the Duplicate function, which simply copies files from one place to another, to copy files to an LTFS file system IS supported on Retrospect 8 & later. See above discussion for details.

  18. Retrospect V7 does "Progressive" backup of changed files.

    SysVolInfo does indeed store Restore points amongst other NTFS related data.

    Windows Backup creates large image files as you indicated

    .vhd files are usually Disk Image files belonging to Virtual Machines, presumably you are using HyperV to run a VM


    A first backup with Retrospect will backup all these items, and as you say the contents of the 387G drive should fit on the 465 G drive.

    However on the next backup if a file has changed it will be backed up again.

    EG if your VHD has changed another 118 or 273G could be backed up

    Similarly if your Windows Backup has updated a file that could cause another 41 Gig to backup

    Thus your 465G drive is highly likely to run out of space on the Second backup run.



    Do you really need to use Windows backup AND then Retrospect.

    .vhd, since the VHD file will contain any changes to the VM you could get a way with keeping only on e backup Copy. Make a separate job and overwrite the backup every time.

    SysVolInfo 0 Use the System Restore management and the VSS management to manage the number of Restore Points and VSS Snapshots you keep to reduce the size.


    Upgrade to the latest Retrospect with has "Block Level" backups of large files whereby it only backs up the changes WITHIN the files, not the entire file. This would go a long way to solving your issues. (V7 is now really ancient and is not properly supported on Modern (W7&8 and later) OSs)