Software Engineer – LLM & Agent Integration

Who We Are

At Firstup, our mission is to improve the employee experience at every moment that matters, large and small. As the communication pipeline for the world's workforce, we now serve 40 of the Fortune 100 companies, reaching and connecting more than 17 million employees daily.
Our employees are experts in the employee experience, workforce communications and technology. Joining Firstup means joining a movement to make work better for every worker. As the world’s first intelligent communication platform, Firstup meaningfully engages employees at every moment from hire to retire, and delivers engagement insights to help companies support, promote and retain their talent. Our movement has taken root and is evident in our world-class customer base. Now we need your help. Ready to make a difference in the world?

Our Values
Every employee is an owner with responsibility and credit for our progress.Leadership is in our build and we see change as a catalyst for improvement.We win as a team, committed to help our coworkers and customers thrive.

We are seeking a skilled and versatile Software Engineer with hands-on experience integrating Large Language Models (LLMs) and intelligent agent systems into modern SaaS platforms. This role involves building robust, scalable, and intelligent software systems that leverage AI capabilities to deliver real-world business value. You will work closely with cross-functional teams to design, implement, and optimize innovative features and services.

Responsibilities

• Design, develop, and maintain production-grade software systems that integrate LLMs and autonomous agent frameworks into SaaS products.
• Collaborate with product managers, ML engineers, and platform teams to deliver intelligent, user-focused solutions.
• Architect and implement APIs, services, and tools that facilitate the deployment and orchestration of LLM-powered applications.
• Evaluate and integrate open-source and commercial AI/ML tools and libraries to accelerate development.
• Contribute to engineering best practices, including CI/CD, testing, and observability for LLM-integrated systems.
• Drive experimentation and prototyping to explore new agent behaviors and AI-driven features.
• Ensure security, privacy, and compliance requirements are upheld within all deployed systems.

Minimum Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, or a related field—or equivalent professional experience.
• 3+ years of experience in software engineering, preferably in a SaaS environment.
• Strong proficiency in Python, with experience in frameworks used for LLMs and agents (e.g., LangChain, LlamaIndex, Transformers, OpenAI APIs).
• Experience deploying containerized applications using Docker, Kubernetes, and Helm.
• Familiarity with AWS services and cloud-native architectures.
• Experience integrating ML or AI components into production systems.
• Solid understanding of API design, event-driven architecture, and distributed systems.
• Ability to independently lead and deliver technical projects from concept to production.
• Excellent communication and documentation skills.

Preferred Qualifications

• Experience with vector databases, semantic search, and knowledge retrieval pipelines.
• Familiarity with observability and monitoring tools for ML/AI systems in production.
• Background in agentic workflows, memory/context management, or orchestration frameworks.
• Prior experience in a fast-paced startup or enterprise SaaS company.
• Active involvement in open-source AI or ML projects, or strong personal portfolio of side projects.

Firstup expects the base salary for this role to be between $80,000-$150,000. The starting rate of pay may vary based on factors including, but not limited to, position offered, location, education, training, and/or experience.

Why Firstup?

Because you care - about people, the work you do, and the connections you make. Work is such a large part of life; it only makes sense to make it awesome.

If you want to engage brilliant minds in a high-growth and inclusive environment where ideas are rewarded regardless of who they come from, join us. This is a rapidly changing space so if you thrive on ambiguity, are hungry for a challenge, and have the guts to speak your mind, you could be a perfect fit.

We offer an excellent PTO program, great health benefits, a casual and friendly environment, remote work, and a leadership team who truly believes in your growth – both personally and professionally.

Firstup is committed to providing equal employment opportunities to all applicants for employment and to all employees, without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, protected disability, veteran status, or any other protected status in accordance with applicable federal, state or local laws.