Deskripsi Pekerjaan
Apex Neural Systems is seeking a Senior AI Infrastructure Engineer to design, scale, and optimize high-throughput distributed systems supporting large-scale foundation models. In this role, you will architect core GPU compute infrastructure, streamline training and inference pipelines, and drive down latency across production multi-tenant environments.
Tanggung Jawab
- Architect, deploy, and scale high-concurrency model training and serving clusters using Kubernetes and Ray.
- Optimize GPU/TPU utilization, memory bandwidth, and distributed compute workloads across cloud providers.
- Build reliable observability, telemetry, and automated self-healing tooling for deep learning pipelines.
- Collaborate with research scientists to productionize cutting-edge model architectures at low latency.
- Enforce security, resource isolation, and RBAC policies across shared infrastructure clusters.
- Diagnose complex performance bottlenecks across the networking, kernel, and hardware layers.
Kualifikasi
- 5+ years of software engineering experience focusing on distributed systems and cloud infrastructure.
- Proficiency in Go, Python, or C++ in high-throughput, latency-critical production environments.
- Production experience with orchestrators such as Kubernetes, Slurm, or Ray Core.
- Hands-on experience profiling CUDA workloads, TensorRT, or Triton Inference Server.
- Deep understanding of Linux networking, IPC mechanisms, and distributed storage systems.
- Bachelor's degree in Computer Science, Electrical Engineering, or equivalent practical experience.