Incident Responder (Blockchain Network and Systems Administration) Full Time (Remote)

We’re seeking an Incident Responder (Blockchain Network & Systems Administrator) with knowledge of Blockchains, Smart Contracts, Web2 concepts, networks/network protocols, automation methods, and contingency operations, to perform in-depth troubleshooting of all issues that arise.

In this role you will be ensuring that Chainlink Labs and their products/services remain operational at all times, through both proactive and reactive response to Incidents as well as through leading the Postmortem Process and completion of corrective and preventative actions identified within it.

The primary function in this role is to triage and bring all Incidents to resolution, whether independently or by acting as an Incident Commander, when alerted by our monitoring or other sources. When not actively triaging incidents, you will be working towards the improvement of the Incident Response Process by contributing to the below:

• Identifying needed policy and procedure changes.
• Developing contingency plans.
• Improving the gathering and presentation of Incident related data.
• Working with other teams to eliminate tech debt which might result in Incidents.
• Creating automations for common Incident Response tasks.

In addition to the above, as an Incident Responder for the Incident Response Team you will:

• Respond to all alerts routed to the Incident Response Team, generated from within our monitoring stack, within 1 minute.
• Evangelize and enact best practices, to guide high-quality Incident Response Process utilization within Chainlink Labs.
• Create and execute contingency planning exercises, to ensure continued operational readiness of the Incident Response Team, and those we support.
• Identify and make useful metrics based off of Incident occurrence.

Requirements

• Able to work within a 5 days per week shift rotation, within the hours of 2300-0700UTC.
• Excellent verbal and written English communication skills.
• Ability to function as a leader (Incident Commander), to both SMEs and leadership, during Major Incidents.
• Ability to identify risks/issues and develop recommendations for solutions.
• Familiarity with Git and Infrastructure as code.
• 3+ years of relevant experience. You may have worked in Network & Systems Administration, Incident Response,
• Infrastructure or Platform support, Technical Support or other functions.
• Ability to work in a fast paced environment with dynamic priority evolution.
• Flexibility to join teamwide meetings, which may be outside of your defined schedule.

Desired Qualifications

• Ability to program in Python or Go.
• Experience with distributed systems and container orchestration. You have maintained or even built Kubernetes clusters before and feel comfortable deploying complete new services on them
• Experience with AWS, Terraform/Terragrunt, Kubernetes,  ArgoCD, Prometheus and Grafana, and GitHub Actions.
• Experience running any infrastructure in the blockchain/web3 space
• Technical proficiency with Layer 1 and Layer 2 Blockchains.

Our Principles

At Chainlink Labs, we’re committed to the key operating principles of ownership, focus, and open dialogue. We practice complete ownership, where everyone goes the extra mile to own outcomes into success. We understand that unflinching focus is a superpower and is how we channel our activity into technological achievements for the benefit of our entire ecosystem. We embrace open dialogue and critical feedback to arrive at an accurate and truthful picture of reality that promotes both personal and organizational growth.

About Chainlink Labs

Chainlink is the industry standard oracle network for connecting smart contracts to the real world. With Chainlink, developers can build hybrid smart contracts that combine on-chain code with an extensive collection of secure off-chain services powered by Decentralized Oracle Networks. Managed by a global, decentralized community of hundreds of thousands of people, Chainlink is introducing a fairer model for contracts. Its network currently secures billions of dollars in value for smart contracts across the decentralized finance (DeFi), insurance, and gaming ecosystems, among others. The full vision of the Chainlink Network can be found in the Chainlink 2.0 whitepaper. Chainlink is trusted by hundreds of organizations—from global enterprises to projects at the forefront of the blockchain economy—to deliver definitive truth via secure, reliable data.

This role is location agnostic anywhere in the world, but we ask that you overlap some working hours with Eastern Standard Time (EST).

We are a fully distributed team and have the tools and benefits to support you in your remote work environment.

Chainlink Labs is an Equal Opportunity Employer.