VFX Community
September 25, 2017, 07:54:24 AM *
Welcome, Guest. Please login or register.

Login with username, password and session length
News: Welcome to VFX Community, Vancouver's Visual Effects Forum for Photo-realistic 3D and Compositing.  Registration is currently closed to curb Spam.  Fresh content is now being directed to www.lostboys-vfx.com  Please join us there!
 
  Home   Forum   Help Arcade Search Calendar Gallery Tags Login Register  


Pages: [1]   Go Down
  Print  
Author Topic: One Renderfarm to Rule them all!  (Read 9306 times)
0 Members and 1 Guest are viewing this topic.
Mark Benard
Administrator
Senior Contributor
*****

Karma: 5
Offline Offline

Gender: Male
Posts: 384


Founder - Lost Boys Learning


View Profile WWW
« on: December 25, 2009, 04:24:39 PM »

Cool40,000 cpu Farm!!!  

The Data-Crunching Powerhouse Behind ‘Avatar’
December 22nd, 2009 : John Rath


A look at some of the high-density server and networking gear inside the Weta Digital data center used to render the animation for the new James Cameron movie "Avatar." (Photo: Foundry Networks Inc.)

It takes a lot of data center horsepower to create the stunning visual effects behind blockbuster movies such as King Kong, X-Men, the Lord of the Rings trilogy and most recently, James Cameron’s $230 million Avatar.  Tucked away in Wellington, New Zealand are the facilities where visual effects company Weta Digital renders the imaginary landscapes of Middle Earth and Pandora at a campus of studios, production facilities, soundstages and a purpose-built data center.

The 10,000 square foot server farm manages thousands of work orders and a serious amount of data. Information Management magazine reports on the creative artists and rendering done for the movie, as well as the thoroughbred data center supporting it.

The Weta data center got a major hardware refresh and redesign in 2008 and now uses more than 4,000 HP BL2×220c blades (new BL2×220c G6 blades announced last month), 10 Gigabit Ethernet networking gear from Foundry and storage from BluArc and NetApp. The system now occupies spot 193 through 197 in the Top 500 list of the most powerful supercomputers.

Thirty four racks comprise the computing core, made of 32 machines each with 40,000 processors and 104 terabytes of memory. Weta systems administrator Paul Gunn said that heat exchange for their servers had to be enclosed. The “industry standard of raised floors and forced-air cooling could not keep up with the constant heat coming off the machines,” said Gunn. “We need to stack the gear closely to get the bandwidth we need and, because the data flows are so great, the storage has to be local.” The solutions was the use of water-cooled racks from Rittal.

Gunn also noted that tens of thousands of dollars were saved by fine tuning the temperature by a degree.  Weta won an energy excellence award recently for building a smaller footprint that came with a 40 percent lower cooling cost for a data center of its type.

For the last month or more of production those 40,000 processors were handling 7 or 8 gigabytes of data per second, running 24 hours a day. A final copy of Avatar equated to 17.28 gigabytes per minute of storage. For a 166 minute movie the rendering coordination was intense.

Link to Source
« Last Edit: December 25, 2009, 07:14:41 PM by Mark Benard » Logged

Mark Bénard | Managing Director
Lost Boys Learning | School of Visual Effects

"Divine Creators in the Making"
 

www.lostboys-learning.com
 

FacebookLinkedInVFX CommunityYouTubeVimeo

Studio Phone: 250-871-8103
Mailing: Suite 104 – 2456 Rosewall Crescent, Courtenay, BC Canada, V9N 8R9 (Vancouver Island)

Lost Boys Learning is North America's only dedicated visual effects school with world-class training in photo-realistic 3D for VFX and compositing for film and television. Boasting a 94% placement rate Lost Boys Learning offers a specialized 1 year Visual Effects Diploma.  Our students work with the award winning VFX Supervisor and experienced mentor, Mark Bénard, in a project-based learning environment, covering VFX pre-production and shooting, 3D for VFX and compositing.
Tags:
Pages: [1]   Go Up
  Print  
 
Jump to:  




Powered by MySQL Powered by PHP Powered by SMF 1.1.21 | SMF © 2015, Simple Machines Valid XHTML 1.0! Valid CSS!