Skip to content
Genesis AI

Training / AI Infrastructure

San CarlosLocation unclear
FullTime · Engineering & Research
POSTED 30 APR
Apply Ask
Role
201 days opentrue age
Posted 30 Apr
CompanyGenesis AI →
69open roles
Opened · 30d
+4
Closed · 30d
−9
10d of snapshots · 30d window
Market
3,172open · DevOps / SRE / Infra
Opened · 7d
+2357% of open
All devops / sre / infra
6,880open
All tracked boards · live 18 Nov · n=3,172
Node.jsPythonPyTorchDistributed systems

What You’ll Do

Drive down wall-clock time to convergence by profiling and eliminating bottlenecks across the foundation model training stack stack, from data pipelines to GPU kernels

Design, build, and optimize distributed training systems (PyTorch) for multi-node GPU clusters, ensuring scalability, robustness, and high utilization

Implement efficient low-level code (CUDA, cuDNN, Triton, custom kernels) and integrate it seamlessly into high-level training frameworks

Optimize workloads for hardware efficiency: CPU/GPU compute balance, memory management, data throughput, and networking

Develop monitoring and debugging tools for large-scale runs, enabling rapid diagnosis of performance regressions and failures

What You’ll Bring

Deep experience in distributed systems, ML infrastructure, or high-performance computing (8+ years)

Production-grade expertise in Python

Low-level performance mastery: CUDA/cuDNN/Triton, CPU–GPU interactions, data movement, and kernel optimization

Scaling at the frontier: experience with PyTorch and training jobs using data, context, pipeline, and model parallelism

System-level mindset with a track record of tuning hardware–software interactions for maximum utilization

Source · Genesis AIFirst seen 2 Nov1 editsOriginal ↗