dsmISI for VEEAM - “Veeam Certified”

How to accelerated filing of VEEAM repository in Isilon OneFS Scale-out storage

General Storage is expanding his concept of integrating backup applications in a true Scale-out storage architecture by introducing Veeam support.

In principle, dsmISI for VEEAM implements dynamic multipathing, which automatically spreads reads and writes symmetrically across all available network paths and Isilon nodes, guaranteeing maximum throughput for any attached Veeam-Repository server. dsmISI for VEEAM is installed on the Linux operating system and communicates with Isilon clusters, creates NFS/SMB connections to all nodes and presents them to Veeam-Repository as a single, very fast file system. dsmISI for VEEAM automatically detects whenever Isilon nodes fail or when nodes are removed from or added to a cluster. Failovers are executed transparently for Veeam-Repository server. Dynamic load balancing at runtime ensures that all nodes of a cluster are being utilized equally.

Since 2013, General Storage dsmISI has been used successfully by TSM customers to fully benefit from EMC’s Scale-Out NAS Isilon solution as an extremely fast, seamlessly scalable and astonishingly easy to use backup-to-disk device.

In early 2016, we release dsmISI for VEEAM Availability Suite, allowing Veeam users for the first time to take advantage of the very same benefits… and more:

Benefits of dsmISI for VEEAM environments:

  • Practically limitless backup storage scalability in terms of capacity and performance, literally at the push of a button and without the need of re-configuring anything.
  • Single, shared repository for all backups with a capacity from 256 TiB up to 47 PiB
  • Support for unlimited backup file size
  • Fully automatic, active-active striping of loads across all nodes in an Isilon cluster
  • Optional, fully transparent, synchronous mirroring across Isilon clusters
  • ITransparent coexistence with dsmISI for TSM and other applications using an Isilon cluster
  • Optional integration with dsmISI MAGS TSM Client for migration / copy of Veeam backup data to and from TSM (Tape).

dsmISI for VEEAM / OneFS integration

dsmISI for VEEAM in detail

Using an Dell EMC Isilon Scale-Out NAS cluster with any backup-to-disk solution has obvious benefits such as seamless scalability of the target file system, scalability of performance and availability due to an active-active architecture. However, there are some drawbacks to consider. First of all, the fact that an Isilon’s file system is spanned across all nodes of a cluster make that file system as big as you like (simply by adding nodes to the cluster) – but scaling throughput along with capacity is basically limited by the number of machines accessing an Isilon and the distribution of their data paths across these nodes. By default, any NFS or CIFS transfer between any host and an Isilon is limited to the communication bandwidth of the node selected to be the network target in the cluster and the server initiating the transfer. This leads to reasonably balanced workloads when many servers communicate with relatively few Isilon nodes. But backup workloads are characterized by relatively few servers which have to transfer lots of data in a limited number of streams to a potentially large number of nodes.

Without dsmISI, each of these servers’ throughput would be limited by the bandwidth of the node it happens to communicate with at any given time, which would limit any backup workload’s bandwidth to a mere fraction of an Isilon’s performance capabilities.  dsmISI for TSM eliminates that bottleneck by equally spreading TSM workloads across all of an Isilon’s nodes, hence using all the available bandwidth all the time – no matter whether there is just one or many TSM servers using an Isilon as a backup target. dsmISI for Veeam uses the same basic technology to utilize Scale-Out NAS targets for Veeam Availability Suite – but with some additional functionality in order to accommodate the specific challenges Veeam poses to backup target storage.

In contrast to TSM, any Veeam backup job writes data in a single stream which therefore potentially has to satisfy much higher per-stream throughputs than a typical TSM workload which can usually be parallelized almost at will. Another Veeam specific challenge is the size of a target file, which cannot be configured but corresponds directly to the entire size of a backup job or virtual machine. Since virtual machines’ capacities can easily outgrow the file-size limitations of an Isilon Scale-Out NAS cluster (4 TB), natively using an Isilon can hardly be considered a useful solution for Veeam backup. dsmISI for Veeam addresses these challenges by fully virtualizing NAS storage into a standard block-type file system which not only allows practically unlimited file sizes, but uses the entire bandwidth of an Isilon cluster – even for a single data stream.

In summary, EMC’s Isilon Scale-Out NAS in combination with dsmISI for Veeam is the ideal backup target for rapidly growing virtual computing environments because it allows users to quickly and transparently scale to any performance or capacity requirement with unprecedented ease.

DOWNLOAD - Product Flyer

Whitepaper: Spectrum Protect and Veeam Availability Suite usage guide abstract, December 2016
Third-party software
Veeam and Spectrum Protect customers often need to store petabytes of backup data. For this, they need an efficient and powerful system that load balances the data stream across multi-target storage controllers, without the negative effects of deduplication storage systems. An example of a combined target disk storage system for Spectrum Protect and Veeam is General Storage’s dsmISI for Spectrum Protect and dsmISI for Veeam. An EMC Isilon Storage Systems is used with the dsmISI load balancer software to get the maximum out of the EMC file cluster nodes. With Veeam, a single target write stream is spread across the nodes for high throughput of more than 1 GBs per stream. General Storage MAGS can help bring Veeam Backup files to TSM tape and organize them.
Technical brief by Andreas Neufert, Solutions Architect, Veeam Software GmbH

Spectrum Protect and Veeam Availability Suite usage guide

Download full report