Senior Software Engineer, Go - LLM Team

• Partner closely with the customer success team to understand customer use cases, challenges, and integration needs
• Translate customer pain points surfaced by the CS team into technical solutions and product improvements
• Build features and tooling that directly address customer needs and improve their workflows
• Provide technical guidance and expertise to the customer success team
• Own and deliver complete features and integrations within our LLM gateway service
• Build and maintain integrations with multiple LLM providers and AI services
• Write clean, maintainable, well-tested code following best practices
• Design and implement scalable, fault-tolerant solutions
• Proactively identify and address technical debt, reliability issues, and code quality concerns
• Participate in on-call rotation to ensure service reliability and rapid incident response
• Conduct thorough code reviews
• Ensure proper test coverage across unit, integration, and end-to-end testing
• Improve code maintainability and extensibility through targeted refactoring
• Contribute to runbooks, incident postmortems, customer-facing documentation, and knowledge sharing
• Identify bottlenecks and propose solutions to improve team velocity and system reliability
• Work closely with product, customer success, and engineering teams
• Collaborate with external API providers to troubleshoot integration issues
• Translate ambiguous customer requirements into well-scoped technical work
• Proactively communicate status, risks, and blockers
• Mentor junior engineers
• Participate in architectural discussions and contribute to technical decisions

• 5+ years of professional software engineering experience
• Strong proficiency in Go with demonstrated ability to write production-quality code
• Hands-on experience with LLM APIs and understanding of prompt engineering concepts
• Experience building or working with API gateways, proxies, and rate limiting systems
• Deep experience with prompt engineering, chain-of-thought, few-shot learning, and other LLM optimization techniques
• Experience building applications with llms or ai agents with cascading architectures
• Solid understanding of software engineering fundamentals: data structures and algorithms, system design and architectural patterns, testing strategies
• Experience with RESTful APIs and distributed systems concepts
• Experience building or integrating with third-party APIs
• SQL and database design
• Version control (Git) and CI/CD pipelines
• Containerization (Docker) and cloud infrastructure
• Strong communication skills and ability to collaborate effectively with cross-functional teams

Pay range: $180K - $240K

• Competitive equity grants
• 100% employer-paid benefits
• Flexibility of being fully remote