Developer - Machine Learning Platform

Build the foundations of large-scale AI

Do you want to see your work fuel millions of machine learning predictions every day? Join our machine learning platform team and contribute to deploying models, including large language models (LLMs), in a reliable and scalable manner.

You will work on a platform that trains thousands of models and handles over 100M requests per day, while developing your expertise in distributed systems and machine learning infrastructure.

As a senior developer, you will

• Contribute to the entire development cycle, including coding, testing, and deployment.
• Analyze and improve the usability, observability, and reliability of our AI platform.
• Participate in maintaining services handling millions of requests and calls to large language models each day.
• Collaborate with applied scientists, data engineering specialists, and developers to integrate agentic applications into production.
• Contribute to the evolution of our AI platform to support the growth and scaling of agentic workflows for Coveo users.
• Propose improvements to our existing processes and use AI-assisted programming tools to optimize your work.

Specifically, here's what qualifies you for the role

• More than 5 years of experience in developing backend applications in a cloud environment (Python or Java/Spring preferred; experience with Amazon Web Services (AWS) is a plus).
• Good understanding of distributed systems and scalable application design.
• Ability to troubleshoot and diagnose systems with guidance when needed.
• Comfort with learning new tools, technologies, and best practices.

What will set you apart

• Experience with Terraform, AWS Bedrock, OpenSearch Serverless, vector databases, LiteLLM, or other inference gateways for large language models.
• Experience with machine learning workflows or agentic workflows.
• Strong interest in scalable backend services, large-scale real-time systems, workflows, agentic applications, or large-scale real-time inference.

You don't need to check all the boxes: passion is a big plus, and we recognize that qualifications are transferable.

Send us your application, we want to learn more about you!

Join the Coveolife!

We encourage all qualified candidates to apply, regardless of age, gender, disability, career gaps, or origin.

This job description was written by humans, assisted by AI. We may use technology in our recruitment process to help us see the person behind the resume.

Coveo is committed to offering accessible employment practices. If you need accommodation due to a disability at any time during the recruitment process, please contact HR@Coveo.com to discuss.