3521 Mary Court
Eureka, CA 95503
scott@zorch.SF-Bay.ORG
I’ve run Site Reliability Engineering, systems administration, ISP operations, technical support and MIS groups. My engineering skills are in design, automation, simplification and supportability. My deep technical areas are UNIX internals and internet services. My superpower is making operational problems go away and causing my part of the business to run smoothly.
Professional Experience:
Site Reliability Manager (October 2018 to present, remote since March 2020)
Google Inc., New York, NY:
Manager for the NYC-based half of the SRE team that supports Google's internal and external development infrastructure, including our internal Piper source repository and our internal/external git/Cloud Source Repositories product. Lead a team of 7 SREs in NYC partnered with a team in Munich. Develop strategy for the overall team, oversee creation of quarterly goals from the strategy and our operational backlog. Ensure that team members become oncall ready rapidly and coach them in their overall career development. Spearhead a project to strengthen and update our critical Piper emergency recovery system "Piper Bailout." As a long-time Google engineer, participate in team teaching exercises to improve depth of knowledge of Google infrastructure and UNIX internals. Maintain healthy relationships with our partner developer teams. Write design and discussion documents to encourage our team and partners to converge on solutions to particularly difficult problems.
Site Reliability Engineer/Systems Engineer (May 2007 to September 2018)
Google Inc., New York, NY:
SRE tech lead of a team of 3 SREs supporting git-hosting infrastructure used by Android, Chromium, Go and productized as Cloud Source Repositories. Work closely with development lead on service direction especially with regard to service complexity, reliability and performance. Implement a staged rollout strategy that releases new binaries gradually in order to minimize full-service outages. Previously, lead SRE supporting IAM and privacy as a service. Part of a team maintaining Google's Production Security infrastructure, including DDoS response, IAM, privacy as a service, and internal certificate authorities. Improved and rewrote IAM configuration push service using internal automation framework and designed configuration push to prevent recurrence of Google’s January 2014 outage.
Bruin Online Operations Supervisor (Programmer/Analyst IV) (October 2006 to May 2007)
University of California, Los Angeles, Los Angeles/Westwood, CA:
Managed team of 4 UNIX Systems Administrators responsible for operation of "Bruin Online," UCLA's system supporting 35,000 mailboxes. Migrate infrastructure from Solaris to Redhat Linux. Support peer department on shared SAN and backup infrastructure.
Lead UNIX Systems Administrator (Operating Systems Analyst II) (March 2003 to September 2006)
California State University, Northridge, Northridge, CA:
Senior/lead systems administrator supporting a University community of 30,000 students and 4,000 staff. Manage e-mail system supporting extended community and over 100,000 mailboxes. Lead 3 systems administrators managing UNIX-based servers. Manage software and hardware infrastructure projects through to completion. Set team and project goals and manage performance to those goals. Mentor team members in technical intricacies of UNIX systems.
Vice President, Internet Technology (July 1998 to November 2000)
Asia Online Limited, Hong Kong:
Managed Hong Kong-based ISP operations - 25 people in System/Network, Technical Support and MIS departments. Increased backbone capacity by 25%, dial-up capacity by 22%. Increased Support call pickup rate from 88% to 96%. Used Technical Support's customer contacts to pursue cross-selling opportunities. Performed forward planning and budgeting for local and regional technical operations. Conducted due diligence on potential acquisitions.
Vice President, Engineering (January 1997 to June 1998)
Whole Earth Networks, San Francisco CA:
Performed project, personnel and operations management for Internet Service Provider's Engineering organization. Assisted in creation and execution of corporate strategy. Architected and deployed upgrades to physical plant. Designed infrastructure for new service offerings.
Manager, Internet Services and Operations (October 1995 to November 1996)
Worldview Systems Corporation, San Francisco, CA
UNIX System and Network Administrator (January 1990 to October 1995)
Tandem Computers Inc., Cupertino, CA
B.S. cum laude in Computer Science, CSU Stanislaus
Selected by Network World (December 2003) as one of the "50 most powerful people in networking."
Past President of CAUCE North America (www.cauce.org), the leading anti-spam advocacy organization.
Media appearances in: