Senior Software Engineer - Incident Insights & Readiness

Boston · New York · USD 192,000-240,000 / year · 5+ years experience · Full-time · Hybrid · Posted Sep 30, 2026

At a glance

Datadog is the leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve issues before they impact customers. Trusted globally by Fortune 500 companies and high-growth AI leaders, Datadog enables businesses to move faster with clarity and confidence. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center.

The Incident Insights & Readiness SRE team at Datadog fosters a resilient culture by using incidents as learning opportunities and catalysts for growth.
The team builds the software, tooling, and operational frameworks that help Datadog engineers prepare for, respond to, and learn from incidents.

Own and improve the on-call experience for the company by establishing best practices and building platforms to support on-call rotations and compensation.
Define how we respond to incidents, lead the design and implementation of software to streamline the process, and collaborate with product teams to improve incident response across Datadog.
Contribute to the post-mortem process for the company, collaborating with teams on writing them, and identifying opportunities to reduce friction and enhance learning value for the organization.
Support various teams in facilitating incident reviews that emphasize learning and blamelessness.
Provide technical leadership and day-to-day coaching to team members, accelerating their growth through design reviews, collaborative problem-solving and operational excellence best practices.
Train our on-callers in incident and post-mortem processes, sharing expertise in incident management best practices.
Lead cross-functional initiatives in engineering organizations across Datadog, embedding with teams to understand their challenges and drive lasting improvements to reliability and operational excellence.

At least 5 years of experience building software that solves real user problems, designing new features, and collaborating on code and technical design reviews.
Experience building or operating distributed systems, with familiarity with Kubernetes and an understanding of complex failure modes.
Demonstrated ability to independently own ambiguous technical problems from design through delivery while balancing long-term engineering quality with pragmatic execution.
Experience analyzing incidents, identifying systemic risks, and driving engineering improvements informed by operational learnings.
Experience participating in on-call rotations and improving incident response processes.
Empathy, collaboration, and communication skills in English to cultivate strong relationships across various teams in the organization.
Experience mentoring engineers, driving cross-functional initiatives, and influencing technical direction without relying on organizational authority.