Deskripsi Pekerjaan
Apex Distributed Labs is seeking a Principal Site Reliability Engineer to lead the architectural evolution, availability, and performance of our core globally distributed infrastructure. In this role, you will champion zero-downtime deployments, eliminate architectural bottlenecks, and establish best-in-class operational standards across critical multi-region services serving millions of concurrent users.
We prioritize engineering solutions over operational duct tape. You will work directly with platform engineers, product teams, and executive leadership to define reliability boundaries, drive automated incident lifecycle workflows, and build resilient systems capable of sustaining exponential traffic growth.
Tanggung Jawab
- Architect, automate, and operate high-availability distributed systems across multi-cloud environments.
- Define, measure, and enforce Service Level Objectives (SLOs) and Error Budgets across core services.
- Lead root-cause analysis (RCA) efforts and implement architectural mitigations to eliminate systemic failures.
- Develop scalable automation tooling and Kubernetes-native operators to reduce manual operational toil.
- Orchestrate multi-region failover tests, disaster recovery protocols, and chaos engineering exercises.
- Collaborate with development teams to optimize application runtimes, database indexing, and network routing.
- Drive capacity planning, load profiling, and cloud infrastructure cost-optimization strategies.
Kualifikasi
- 7+ years of dedicated experience running large-scale distributed systems in production environments.
- Expert-level proficiency in Go, Python, or Rust for systems programming and tooling development.
- Deep understanding of the Linux kernel, POSIX APIs, eBPF, TCP/IP networking, and distributed tracing.
- Demonstrated mastery of Kubernetes, Istio/Envoy service mesh, and infrastructure as code (Terraform).
- Proven track record managing large-scale stateful storage systems like PostgreSQL, Kafka, or ClickHouse.
- Experience implementing observability platforms using Prometheus, Grafana, OpenTelemetry, and Jaeger.
- Strong background leading incident response and post-mortem discussions for critical outages.