Jump to content
Xenomorph

Does anyone else backup over 10 Gbps?

Recommended Posts

This is similar to my last thread:
http://forums.retrospect.com/topic/154613-optimizations-for-10-gbps-networking-or-is-this-just-the-limit-of-lto-5/

Some things have changed. Some haven't. I have even more systems connected at 10 Gbps, and I've moved to faster & more dense LTO-6 tapes and tape drives. I'm also now backing up close to 500TB of data. I find myself falling behind more and more because Retrospect itself seems to drag its feet.

Server: Windows Server 2008 R2 w/ 32 GB RAM, running Retrospect Multi Server, version 16.5.0.218.
Client: Windows Server 2008 R2 w/ 32 GB RAM, running Retrospect Client, version 16.5.0.218

The Server and all Clients are connected with 10 Gbps Ethernet.

Doing direct client to server file copies over SMB easily hits 600-900 MB/sec.

When doing a backup of the exact same files, Retrospect only copies at 60-90MB/sec (3704 to 5241 MB/min). I can have Retrospect back up to Tape, local Disk, or even a RAM drive. It never gets above 60-90MB/sec.

I can see in Task Manager that the Retrospect.exe  process uses minimal CPU or RAM.

For the latest test copy & backup, I selected four Windows ISOs, around 3.5GB each, 14GB total. I configured a 16GB RAM Disk on both Client and Server. This ensures that I'm NOT dealing with Disk I/O or Tape Drive performance issues. This is direct RAM to RAM file copies over a 10 Gbps network.

* Windows Explorer showed "0.99 GB/sec" when doing a "drag & drop" copy from Client to Server over the network. This is about what I'd expect.

* Retrospect Backup (compression off) got just ~90 MB/sec backing up from the same source (a RAM disk on the Client) to the same destination (a RAM disk on the Server) over the network. This is no better than when I back up to Tape or Disk or when backing up over a 1 Gbps network connection.

* Retrospect Backup (compression off) did get 176-226 MB/sec backing up on from one RAM Disk to another RAM Disk on the same system. Doing it like this eliminates the network completely.

Does anyone else do backups over 10 Gbps networks?

What is the bottleneck with the backup? Does the Retrospect client application hold things back? Does the Retrospect server application hold things back? Are there any tweaks or modifications that I could make to the Retrospect server or client application?

 

Share this post


Link to post
Share on other sites
12 hours ago, Xenomorph said:

So why not add this as an additional post to your last thread, and save other people's time answering the same question?:rolleyes:  My answer, for instance, would be exactly the same.  A new post to an existing  topic makes that topic in the Forums list appear bolded, just like a new topic.

The cumulative Release Notes for Retrospect Mac do say under Engine for 16.5 "Improved: Client scanning 2x faster".  However that doesn't appear in the cumulative Release Note for Retrospect Windows, and may apply only to the scanning phase—for which there had been an Apple-created problem with Instant Scan for APFS-formatted Mac volumes which the Retrospect engineers said was going to be solved by switching to a 64-bit API to speed up non-Instant scan .  So that probably doesn't improve the actual backing up phase speed for Retrospect Windows. :(

Lennart_T suggested in a PM that the Engine should be made multi-threaded.  I responded that the Engine has been running each operation in a separate thread since Retrospect Windows 7.5 and Retrospect Mac 8, and I couldn't see how one would usefully multi-thread an individual backup operation.

Share this post


Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×