Stern School of Business, New York University


Large Scale Distributed Processing for Heavy input/output Intensive Jobs

August 19, 2010 • Announcements

The Center  has retired it’s Hadoop cluster which was used for large i/o intensive workloads. Users should instead use the NYU HPC cluster. This infrastructure is based on the open source apache hadoop. In this environment, a data file is split across many systems, and  a program is sent to all of the nodes a… Read More ›