Where HPC Meets Big Data

Big Data, High Performance Computing (HPC)

High performance computing (HPC) has contributed enormously to scientific innovation, industrial and economic competitiveness, national and regional security, and the quality of human life. For the most part, data-intensive HPC jobs have been in the government, academic and industrial sectors and have mostly involved the modeling and simulation of complex physical and quasi-physical systems. One of the early adopters, outside of the traditional HPC space, has been the financial services industry looking to adopt supercomputers for advanced data analytics. HPC systems are now being used for challenging analytics tasks, such as optimizing portfolios of mortgage-backed securities, pricing exotic financial instruments, and managing firm-wide, global risk. More and more High Performance Data Analysis (HPDA) is moving into the mainstream and beyond the traditional way we view HPC.

The data explosion fueling the growth of high performance data analysis stems from a mix of factors:

  • The ability of increasingly powerful HPC systems to run data-intensive problems at larger scale, at higher resolution, and with more elements.
  • The proliferation of larger, more complex scientific instruments and sensor networks, from “smart” power grids to bridge structural integrity monitoring to climate control monitoring for farmers.
  • The increasing transformation of certain disciplines into data-driven sciences.
  • The escalating need to perform advanced analytics in near-real time—a need that is causing a new wave of commercial firms to adopt HPC for the first time


So, what does this new shift mean to commercial enterprises?  What it means is supercomputing capabilities developed by leading universities, research institutions and national laboratories for basic science and national security are now being applied to problems that help businesses become more competitive and improve the quality of daily life. Computational analysis is transforming lives and high-performance computing, big data, and high-speed networks are fast becoming essential components of contemporary commercial businesses. Big Data has become characteristic of every computing workload. From its origins in research computing, to use in modern commercial applications spanning across industries, Big Data is the new basis of competitive value. The convergence of High Performance Computing (HPC), Big Data Analytics, and High Performance Data Analytics (HPDA) is the next game-changing business opportunity.


Businesses are investing in HPDA to improve customer experience and loyalty, discover new revenue opportunities, detect fraud and security breaches, optimize research and development, mitigate financial risks, and more. HPDA also helps governments respond faster to emergencies, improve security threat analysis, and more accurately predict the weather – all of which are vital for national security, public safety and the environment. The economic and social value of HPDA is immense. It is becoming integral to the journey towards a Cognitive and Learning business. Mellanox server and storage connectivity solutions are designed to deliver very high networking and system efficiency capabilities related to bandwidth, latency, offloads, and CPU utilization for HPC. With networking solutions that deliver 100Gb/s throughput at less than 1 microsecond server-to-server latency, efficient networking hardware offload capabilities, and innovative acceleration software, Mellanox high-performance networking solution accelerates most HPC workflows and delivers excellent ROI.

Register for our upcoming webinar with Scot Schultz from Mellanox and Marc West from IBM as they discuss how Mellanox and IBM are powering tomorrow’s modern infrastructures today, enabling the highest data center return on investment and lowest cost of ownership.

See you on October 18, 2016 at 10:00 a.m. PT!


About John Biebelhausen

John Biebelhausen is Sr. OEM Marketing Manager at Mellanox Technologies, Inc. Before joining Mellanox, John had an extensive career as a Marketing Executive in a range of technology companies including IBM, Lenovo, Dell and Sharp Labs. John was a founder in multiple start-up companies pioneering Direct Relationship Marketing and SaaS applications. John holds a MS of Science in Finance from Colorado State University and a BBA in Economics and Finance from Kent State University.

Comments are closed.