Stern School of Business, New York University


Large Scale Distributed Processing for Heavy input/output Intensive Jobs

August 19, 2010 • Announcements

The Center now has a Hadoop cluster running which can be used for large i/o intensive workloads. This infrastructure is based on the open source apache hadoop. In this environment, a data file is split across many systems, and  a program is sent to all of the nodes a file is on rather than bringing… Read More ›