Senior Data Engineer

*For the English version of this job description, please refer to the following link:*

• Senior Data Engineer

About AppDirect

Become a citizen of the world in the digital age and empower a new generation of globally connected entrepreneurs. AppDirect offers a subscription platform to sell any product as a service, through any channel and on any device. We power millions of subscriptions for organizations worldwide. Our actions are always guided by our values and culture – a culture that allows you to be seen, stay authentic, and excel.

About the Data Knowledge Team

Our mission is to unify the data from all business units of the company within a governed data lake with a semantic layer, to feed analytics, AI, reporting, data sharing, and internal and external dashboards.

About You

We are looking for a senior data engineer with a "data as a product" approach and capable of designing reliable and reusable production pipelines and models to join our data knowledge team based in Montreal. In this role, you will develop production data products and data lake pipelines that feed internal and external analytics and dashboards. You will collaborate with engineering and product teams to establish clear data contracts and define reusable models.

What You Will Do and How You Will Stand Out

• Platform Architecture and Modeling: Design, build, and improve the data lake platform (reusable models and pipelines on Snowflake + dbt, with integrated Databricks workloads) to provide reliable and governed data to analytics and product teams.
• Requirements Analysis and Stakeholder Collaboration: Translate product and business requirements into data models and pipelines, collaborating with product leads, operational units, and engineers, to ensure domain logic is correctly deployed in production.
• Pipeline Modernization: Migrate existing ETL processes to modern, performant, streaming, and incremental pipelines, opting for Snowflake or Databricks as needed.
• Snowflake Performance and Cost: Utilize and optimize Snowflake to maximize reliability and efficiency, including adjusting warehouse sizing and usage, clustering/partitioning as needed, and ensuring visibility on credit spend to avoid cost explosions.
• AI-Assisted Operations: Use AI-assisted development tools and specification-driven workflows to design, automate, and deploy data pipelines and the platform.
• Self-Service Operations: Facilitate data integration and enable operational unit engineers to create their own data products on our platform.
• Customer-Facing Data Products: Design and evolve data feeding customer-facing products (including reporting and analytics services) to ensure pipelines and models deliver reliable product experiences.
• Data Quality and Reliability: Ensure data quality by promoting and deploying robust data governance, automated testing, validation techniques, and data lineage.
• Metadata Management: Maintain rich and detailed metadata in Unity Catalog and Snowflake to feed downstream applications, including AI agents and our semantic layer (Cube.dev).
• Research and Innovation: Find solutions to complex problems and develop proofs of concept to evaluate emerging technologies.
• Documentation and Culture: Write and maintain high-quality documentation to facilitate knowledge sharing and AI-assisted workflows.

Required Skills

• AI-Assisted Development: Excellent understanding of AI-assisted development workflows, with hands-on experience using tools designed to improve code efficiency, automation, and quality, such as Cursor, Claude, OpenCode, GitHub Copilot, or ChatGPT.
• Specification-Driven Development: Experience with the specification-driven development approach, including transforming requirements into clear specifications and acceptance criteria, then implementing them (including AI-assisted workflows).
• Snowflake Expertise (Key Skill): 2+ years of experience designing and operating production data pipelines and models on Snowflake, with SQL, Python, and dbt, including delivering reliable ELT transformations with a history of quality and performance.
• dbt Proficiency: 2+ years of hands-on experience designing modular, versioned, and tested data models with dbt (data build tool), considering transformation as a software engineering practice (Git workflows, code reviews, automated testing).
• AWS: 2+ years of experience working with AWS cloud services.
• Data Governance: Solid understanding of concepts related to data quality, lineage, validation techniques, and data governance.
• Collaboration and Communication: Ability to approach complex technical concepts with both technical and non-technical stakeholders, understand needs, and work effectively within a distributed team.

Bonus Skills

• Databricks: Hands-on experience with Databricks (workspaces, jobs/workflows, Spark SQL/PySpark, Delta Lake) to contribute to the development of the data lake alongside Snowflake.
• Managed Ingestion (Fivetran): Knowledge of Fivetran (or similar ELT connectors) for reliable data ingestion from source to data warehouse, connector governance, and schema evolution management.
• Semantic Layer (Cube.dev): Proficiency with Cube.dev (or similar semantic/metric layer) for self-serve analytics and consistent metrics across products and users.
• Real-Time Data Streaming: Desired experience in designing and maintaining real-time data solutions using streaming platforms like Apache Kafka.

At AppDirect, we believe innovation is best achieved in an environment that fosters the diversity of excellence, experience, and thought. We welcome each "AppDirecteur" and "AppDirectrice" for their unique imprint. We promote an inclusive and non-discriminatory environment with respect to race, religion, age, sexual orientation, and gender identity, to foster authenticity, pride, and excellence. In this regard, we strongly encourage applications from Indigenous people, people with disabilities, people from diverse sexual orientations and genders, and/or people with intersecting identities.

At AppDirect, we take data privacy very seriously. For more information on our use and management of candidate personal data, please read our Candidate Privacy Policy. To learn more about our general privacy practices, please review AppDirect's Privacy Notice: ...

Please note that this role requires a good knowledge of English since the selected candidate will need to collaborate with teams located, among others, in the United States, India, Argentina, as well as in the provinces of Ontario and Alberta.

At AppDirect, AI tools may assist our recruitment team in certain administrative automations – always under human supervision. These tools do not make hiring decisions or fully automated decisions regarding your application – all decisions are made by our teams. By submitting your application, you acknowledge that your information may be processed in this manner.