Lead AI Platform Engineer

• Design scalable, future-proof data platforms optimized for AI research workloads
• Build efficient data pipelines leveraging GCP's advanced services
• Implement cost-effective storage and monitoring solutions for ML at scale
• Create flexible training resource management with intelligent queuing
• Optimize resource allocation for maximum training efficiency
• Participate in on-call rotation to ensure system reliability
• Lead adoption of cutting-edge ML tools and frameworks
• Streamline existing workflows while introducing new tooling that reduces complexity
• Enhance tooling and documentation to accelerate team velocity
• Implement guardrails for cost, quality, and performance
• Identify and eliminate technical bottlenecks in the training pipeline

• 8+ years of experience in AI/ML Infrastructure, Research Platform Engineering, or related software engineering roles
• 3+ years of professional experience working as an AI data and infrastructure setting or similar position
• Strong proficiency in Python and SQL
• Deep expertise with GCP services like BigTable, BigQuery, Dataproc, Dataflow
• Experience with distributed processing frameworks (e.g., Apache Beam, PySpark)
• Familiarity with workflow orchestration tools (e.g., Airflow, Composer, Astronomer)
• Understanding of distributed training systems and data loading optimization
• Experience with experiment tracking and training tooling
• Ability to thrive in a startup environment with aggressive prioritization

Pay range: $230K - $275K