Big data has emerged as a driving force for scientific discoveries. To meet data transfer challenges in big data era, DOE's Advanced Scientific Computing Research (ASCR) office has funded the BigData Express project. BigData Express is targeted at providing schedulable, predictable, and high-performance data transfer service for DOE's large-scale science computing facilities and their collaborators. In this talk, I will present the design and architecture of BigData Express, and discuss why it meets the data transfer challenges in big data era. I will also discuss the project's next stage research and development plan.
Slides will be available for download here after the presentation.
Dr. Wenji Wu is a Principal Network Research Investigator at Fermilab, where he has worked on high-speed networking, distributed systems and high-performance computing. His research focus is to utilize multicore and manycore to address performance challenges in high-speed networks and high-performance computing. Dr. Wu is now responsible for two DOE research projects, the MDTM project and the BigData Express project. Dr. Wu earned his PhD in computer engineering from University of Arizona. Contact him at Back to Top