Senior Systems Architect, Grid Services

Position: Senior Systems Architect, Grid Services Location: Santa Clara, CA. The Internet is a big, busy place, and we at Yahoo! are proud to stand out in the crowd. As the world's number one Internet brand, servicing over a half billion people, we're determined to maintain our commitment to delivering news, entertainment, information and fun... each and every day. In order to maintain our position as one of the world's most trafficked Internet destinations, we're always on the lookout for people with big ideas and big talent to help us provide our visitors with the innovative products and services they've come to expect from Yahoo!. We're looking for people like you. How Big Can You Think? Yahoo! Grid Services is searching for a Senior Services Architect to help design the deployment of compute grids at Yahoo!. Yahoo! compute grids are used for data-mining and research, as well as delivering production data to the Yahoo! serving systems. The primary software platform is Hadoop (hadoop.apache.org ), an Apache Software Foundation open source project. It provides both a distributed file system and map-reduce computation framework. Yahoo! is the largest contributor to Hadoop. As a member of the Grid Services team, you will have a chance to work on a significant open source project. The Grid Services team combines powerful open source packages, including Hadoop, thousands of computers, and petabytes of data to create massive shared compute grids. Yahoo! researchers and engineers perform data analysis on a vast scale to improve our services. Requirements and Responsibilities * Provide technical leadership for system administrators both within Grid Services and others within Yahoo!. * Consider, propose, and implement new methods for system monitoring, management and automation. * Invent better ways to manage the existing clusters, via scripting and tools development. * Monitor cluster health and performance, use critical thinking to find areas for improvement. * Manage projects from conception to completion, including design, cross-team organization, reviews and delivery. * Applications profiling and performance analysis. * Real-time problem diagnosis/resolution on live systems. * Devise schemes to transfer terabytes of data from diverse locations, securely and reliably. * Collaboration with peer development organizations on new products/feature design and/or diagnosis of problems with the production systems. * Documentation on the running systems and their associated configurations. * Compose and deliver presentations on Hadoop and grid services to audiences both inside and outside of Yahoo!. Minimum Job Qaulifications * Experienced as a Unix systems engineer in an internet related business. * Proven experience operating large installations of systems. * Strong shell scripting skills in at least two of awk, perl, python, ruby, etc. * Experience designing large deployments integrating a variety of hardware and software technologies. * Demonstrated team experience managing complex production server environments including direct administration of Unix systems. * Strong interpersonal and communication skills; capable of explaining simple procedures in writing or verbally; good phone skills. Preferred Job Qualifications * BS or MS in Computer Science (or equivalent). * Minimum 6 years experience as a Unix systems engineer with at least 2 years in an internet related business. * 4+ years experience operating large installations of systems. * Knowledge and work experience with Java and Java profilers. * Cluster computing platforms like Condor, Torque, Maui / Moab, Sun Grid Engine. * Experience with programming models for large clusters: MPI, PVM, etc. Yahoo! Inc. is an equal opportunity employer. For more information or to search all of our openings, please visit http://careers.yahoo.com.