The Stern Center for Research Computing
Stern School of Business, New York University
Large Scale Distributed Processing for Heavy input/output Intensive Jobs
August 19, 2010 • Announcements
The Center has retired it’s Hadoop cluster which was used for large i/o intensive workloads. Users should instead use the NYU HPC cluster. This infrastructure is based on the open source apache hadoop. In this environment, a data file is split across many systems, and a program is sent to all of the nodes a… Read More ›