Permabit has unveiled Albireo High Performance Data Optimization Software, which it claims to provide massive scale with a scale-out grid storage architecture that can support petabytes of information.

The company claims that Albireo enables OEMs to deploy sub-file deduplication technology that does not negatively impact storage performance, enables them to continue to deploy their full feature set, and ensures data integrity is not impacted.

According to Permabit, the new software comes with two layer memory/disk index structure that delivers duplicate identification in microsecond times and offers 140+ megabytes per second per CPU core with linear scale-out capabilities to thousands of megabytes. Data integrity is maintained as data written to disk is not altered and integration occurs completely out of the data read path.

The new offering provides variable-chunk segmentation with content aware scanning that provides dedupe rates of 50% to 70%. For certain content types such as VMware images, Albireo can reduce data by as much as 90% or more, Permabit said.

In addition, the Albireo High Performance Data Optimization Software provides integration with as few as 6 API calls; offers block, file and unified storage support; and documentation and developer support.

Jered Floyd, chief technology officer and founder of Permabit, said: “Companies have been wrestling with the concept of primary data deduplication for some time now, but have been unwilling to sacrifice performance in order to achieve this benefit.

“In order for deduplication to operate effectively at the primary level it must have no performance impact; no feature set loss; and no risk of data integrity. Albireo makes this possible.”