View all newsletters
Receive our newsletter - data, insights and analysis delivered to you
  1. Technology
  2. Networks
December 5, 2014

65TB of data transferred in just 100 minutes

The record breaking data transfer was demonstrated during SC14 supercomputing conference.

By CBR Staff Writer

Researchers from the Argonne National Laboratory and DataDirect Networks (DDN) have transmitted 65 terabytes of data within 100 minutes, a transfer which usually requires two days with a 10 Gbps connection.

The record data transfer was demonstrated on 19th November during the SC14 supercomputing conference.

During the demonstration, scientists transmitted 85 Gbps of data — with peaks at over 90 Gbps — between storage systems in Ottawa, Canada, New Orleans and Los Angeles through a 100 Gbps wide-area network (WAN) connection.

The project was supported by Ciena, Brocade, and ICAIR.

For the high volume data transfer, the researchers used embedded file system and virtual machine capabilities of the DDN storage controller, the high-speed wide-area data transfer capabilities of the Globus GridFTP server, and an advanced 100G wide-area network.

Argonne National Laboratory principal software development specialist Raj Kettimuthu said, "Embedding the GridFTP servers in virtual machines on DDN’s storage controller eliminates the need for external data transfer nodes and network adapters."

"We sustained a data transfer rate of 85 Gbps for over 60 minutes — and occasionally for as long as 90 minutes — several times during the SC14 conference."

Content from our partners
Rethinking cloud: challenging assumptions, learning lessons
DTX Manchester welcomes leading tech talent from across the region and beyond
The hidden complexities of deploying AI in your business

"This demonstration was aimed at bringing together the experts and latest developments in all aspects concerning disk-to-disk WAN data movement, including network, storage, and data movement tools," Kettimuthu added.

The team expects that the approach can be used to achieve 100+ Gbps wide-area transfer rates between storage systems using multiple WAN paths and additional storage resources in the end systems.

Websites in our network
Select and enter your corporate email address Tech Monitor's research, insight and analysis examines the frontiers of digital transformation to help tech leaders navigate the future. Our Changelog newsletter delivers our best work to your inbox every week.
  • CIO
  • CTO
  • CISO
  • CSO
  • CFO
  • CDO
  • CEO
  • Architect Founder
  • MD
  • Director
  • Manager
  • Other
Visit our privacy policy for more information about our services, how Progressive Media Investments may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications. Our services are intended for corporate subscribers and you warrant that the email address submitted is your corporate email address.