Data Platform Engineer (DevOps)

Recognizing the benefits of remote work, including employee morale, productivity, reduced commuting, employee well-being, and environmental impact, we are proud to be a digitally focused company. The technologies and programs we have invested in have allowed us to build an excellent foundation to support this approach. Our digital work environment, combined with our easily accessible offices and collaboration spaces, offers our team the freedom and flexibility to work in the way that best supports their productivity.

About Us

Tecsys is a growing innovative company that provides supply chain management solutions to major healthcare systems, hospitals, and pharmaceutical companies, as well as to distributors, retailers, and third-party logistics service providers (3PL). We collaborate with industry leaders to transform their supply chains through technology. If you enjoy tackling challenging tasks and evolving in a learning-focused environment, Tecsys might be the company for you!

We are looking for a Data Platform Engineer (DevOps) to join our TecsysIQ Data & AI team. This is a hybrid role that involves developing and operating the cloud data platform that powers our analytics and AI products based on Databricks and AWS.

You will be responsible for the infrastructure-as-code and delivery pipelines that enable the provisioning and deployment of the platform, as well as the Databricks tasks and continuous delivery pipelines that move and transform the data. You will collaborate closely with the data platform developers, application development teams, and product owners to set up new client environments, evolve CI/CD and version management processes, and create and maintain data pipelines to ensure the reliability and scalability of the platform.

If you are as comfortable writing Terraform code as you are debugging a Spark Structured Streaming task, this position is for you.

Responsibilities

• Platform & DevOps
• Provision and evolve AWS and Databricks accounts and workspaces using Terraform across multiple regions and environments, while managing remote state and environment-specific configurations.
• Take ownership of Helm charts and Kubernetes tasks used to integrate new client environments and deploy the application layer on provisioned workspaces.
• Create and maintain Docker images as well as Java/Maven build pipelines, and publish artifacts to internal artifact and container registries.
• Integrate build, test, and deployment processes into CI/CD pipelines, while improving version and release management across multiple interconnected code repositories.
• Manage secrets and credentials securely using cloud secret management and Kubernetes services — never storing them in the source code.
• Data Platform & Pipelines
• Design, develop, and maintain Databricks tasks and pipelines, including data curation, transformations, and initial bulk load processes.
• Develop and operate real-time and Change Data Capture (CDC) streaming pipelines across ingestion and transformation layers using Spark Structured Streaming.
• Develop and evolve end-to-end data flows through the Bronze, Silver, and Gold layers, adapting pipelines to handle new data sources and schema changes as the platform grows.
• Develop and maintain reusable pipeline components and frameworks to quickly integrate new data flows.
• Optimize Databricks clusters and SQL warehouses for cost and performance, while ensuring catalog, schema, and access management across different environments.
• Collaborate with data platform developers, product owners, and business stakeholders in an Agile environment to deliver high-quality data products.

Qualifications

• Practical experience with Databricks and Apache Spark, including the creation of batch or real-time data pipelines (mandatory).
• Strong skills with Terraform and experience managing cloud infrastructures on AWS.
• Practical knowledge of Kubernetes and Helm, as well as containerization with Docker.
• Proficiency in Python (PySpark) and/or Java, as well as strong SQL skills for data validation and troubleshooting.
• Experience with Git-based workflows and CI/CD pipelines in an environment with multiple code repositories.
• Understanding of data quality concepts, ETL/ELT processes, and data observability.
• Experience working in Agile teams collaborating with data platform developers and product owners.
• Excellent analytical, problem-solving, and communication skills.

We understand that experience can take many forms and that professional journeys are not always linear. If you do not meet all the requirements for this job posting, we still encourage you to apply.

At Tecsys, we are committed to fostering a diverse and inclusive work environment where all employees feel valued, respected, and empowered to succeed. We believe that diversity fuels innovation and strengthens our ability to deliver exceptional solutions. We welcome and encourage applications from individuals of all backgrounds, with diverse experiences and perspectives, to join our team.

Tecsys adheres to the principle of equal opportunity employment. Accommodations are offered to selected candidates for interviews.

Note: To apply for this position, you must be a Canadian citizen, permanent resident of Canada, or hold a valid Canadian work permit.