Senior Software Engineer - Husky Storage
Boston · New York · USD 192,000-240,000 / year · Full-time · Remote · Posted Oct 16, 2026
At a glance
- Employment
- Full-time
- Workplace
- Remote
- Location
- Boston · New York
- Salary
- USD 192,000-240,000 / year · OTE
About Datadog
- Datadog is the leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve issues before they impact customers. Trusted globally by Fortune 500 companies and high-growth AI leaders, Datadog enables businesses to move faster with clarity and confidence. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center.
About the role
- As a Senior Software Engineer on the Husky Storage team, you will work hands-on with a distributed storage system at petabyte scale and help evolve the platform to support the AI era.
- The role involves moving from a custom storage format towards open standards like Parquet, Arrow, and DataFusion, enabling on-premises solutions and analytical workloads.
Responsibilities
- Drive Husky to the next level of adoption by migrating our storage format to open source Parquet and re-imagine compaction on a format-agnostic, DataFusion-based substrate
- Drive concrete cost-reduction work including block-level inverted index compression, combining the database with external objects at the row level, and storage tiering/caching
- Scale our solution to enable customers to manage event versioning at scale, using temporal-database techniques
- Play an influential role in operating and deciding how to best operate our service going forward
- Work across the write path with Ingestion and toward a cleaner Iceberg-based handoff to ADP/Lakehouse for batch/analytical workloads
Requirements
- Enthusiastic and experienced with large-scale distributed systems and/or storage engines
- Comfortable with improving and operating large distributed systems that customers rely on for critical business functions
- Strong fundamentals in columnar/file storage formats such as Parquet, ORC, Arrow or comparable systems
Preferred qualifications
- Experience with Go, Java, or Rust
- Experience with compaction or compression/encoding schemes like RLE, dictionary, delta, or gorilla
- Experience with object storage like S3, GCS, or Azure Blob at scale, including caching and cost optimization
- Experience with Kafka and stream processing
- Experience with Kubernetes
Benefits
- New hire stock equity (RSUs)
- Employee stock purchase plan (ESPP)
- Continuous professional development, product training, and career pathing
- Intradepartmental mentor and buddy program for in-house networking
- Inclusive company culture and ability to join Community Guilds
- Free, global mental health benefits for employees and dependents age 6+
- Healthcare, dental, parental planning, and mental health benefits
- 401(k) plan and match
- Paid time off
- Fitness reimbursements
Skills
- Parquet
- Arrow
- DataFusion
- ORC
- Go
- Java
- Rust
- Kafka
- Kubernetes
- S3
- GCS
- Azure Blob
