Deskripsi Pekerjaan
ScaleCore Systems is seeking a Senior AI Infrastructure Engineer to architect, scale, and maintain the underlying compute engines powering enterprise-scale foundational models.
In this role, you will bridge the gap between low-level hardware performance and cloud-native distributed architecture, ensuring optimal efficiency, fault tolerance, and minimal latency across production clusters.
Tanggung Jawab
- Architect and maintain distributed GPU clusters supporting large-scale training and inference pipelines.
- Optimize high-throughput, low-latency model serving frameworks across multi-cloud architectures.
- Partner with ML research teams to automate pipeline orchestration and feature storage workflows.
- Deploy comprehensive telemetry, tracing, and automated remediation systems for deep infrastructure observability.
- Audit and enforce infrastructure-wide security controls, secret management, and compliance standards.
- Drive capacity planning, utilization metrics, and cost optimization initiatives across all hardware resources.
Kualifikasi
- 5+ years of production experience running distributed, highly available systems on Linux.
- Proficiency in Go, Python, or Rust, with a solid grasp of systems programming principles.
- Deep operational knowledge of Kubernetes, container runtimes, and Terraform infrastructure-as-code.
- Demonstrated experience optimizing hardware accelerators, including NVIDIA GPUs and CUDA environments.
- Solid experience with distributed messaging systems such as Apache Kafka, Pulsar, or gRPC.
- Bachelor's degree in Computer Science, related technical field, or equivalent practical industry experience.