détails d'emploi
We are seeking a Software Developer (ETL) with expertise in Azure Data Engineering, Medallion Data Lakehouse architectures, and Databricks. This role involves designing scalable data solutions, building ETL/ELT pipelines, and optimizing data workflows in a hybrid work environment (three days onsite, two days remote).
Advantages
...
•Hybrid Work Model: Enjoy a flexible work environment with both onsite collaboration and remote work.
•Cutting-Edge Data Engineering: Work with Databricks, Delta Lake, and Azure Data Factory to develop scalable cloud-based solutions.
•High-Impact Role: Play a key role in data ingestion, transformation, and analytics integration for large-scale data systems.
•Automation & Optimization: Implement CI/CD pipelines, cloud security, and data governance in an advanced cloud-native environment.
•Long-Term Growth: Opportunity for contract extensions and involvement in future data-driven initiatives.
Responsibilities
•Design and develop scalable Medallion Data Lakehouse architectures.
•Build, automate, and optimize ETL/ELT pipelines using Azure Data Factory (ADF), Databricks (PySpark, SQL, Delta Live Tables), and dbt.
•Develop solutions for integrating structured and unstructured data into star and snowflake schemas.
•Optimize SQL queries, indexing, and partitioning strategies for improved performance.
•Ensure data quality, integrity, and governance through data lineage, cataloging, and metadata management.
•Implement and manage cloud security using RBAC, Unity Catalog, and data encryption.
•Optimize cloud storage and retrieval performance using Parquet, ORC, and JSON formats.
•Develop and manage workflows and job scheduling in Azure environments.
•Monitor and troubleshoot cloud-based data processes to ensure high availability and performance.
•Enhance Power BI reporting capabilities by integrating Azure Synapse Analytics and Databricks SQL Warehouses.
•Implement AI-driven insights using MLflow and AutoML within data pipelines.
•Support data visualization, analytics, and reporting through Power BI and DAX.
Qualifications
Required Experience
•10+ years in ETL/ELT development and data engineering.
•Strong expertise in Databricks, Delta Lake, Azure Data Factory, and Azure Synapse Analytics.
•Experience with SQL Server, PostgreSQL, and distributed computing frameworks.
•Proficiency in Python (PySpark), SQL, and PowerShell.
•Experience with CI/CD automation using Azure DevOps and GitHub Actions.
•Deep understanding of cloud security, governance, and compliance.
Preferred Skills
•Experience integrating Power BI with Azure Synapse and Databricks SQL Warehouses.
•Familiarity with AI-driven data pipelines using MLflow and AutoML.
•Public sector or healthcare data management experience.
Summary
This Software Developer (ETL) role is ideal for professionals with strong expertise in Azure Data Engineering, Databricks, and cloud-based data pipelines. The role offers opportunities to develop large-scale data solutions, automate workflows, and optimize cloud security and performance, making a significant impact in data-driven decision-making processes.
Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.
Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to accessibility@randstad.ca to ensure their ability to fully participate in the interview process.
voir plus
We are seeking a Software Developer (ETL) with expertise in Azure Data Engineering, Medallion Data Lakehouse architectures, and Databricks. This role involves designing scalable data solutions, building ETL/ELT pipelines, and optimizing data workflows in a hybrid work environment (three days onsite, two days remote).
Advantages
•Hybrid Work Model: Enjoy a flexible work environment with both onsite collaboration and remote work.
•Cutting-Edge Data Engineering: Work with Databricks, Delta Lake, and Azure Data Factory to develop scalable cloud-based solutions.
•High-Impact Role: Play a key role in data ingestion, transformation, and analytics integration for large-scale data systems.
•Automation & Optimization: Implement CI/CD pipelines, cloud security, and data governance in an advanced cloud-native environment.
•Long-Term Growth: Opportunity for contract extensions and involvement in future data-driven initiatives.
Responsibilities
•Design and develop scalable Medallion Data Lakehouse architectures.
•Build, automate, and optimize ETL/ELT pipelines using Azure Data Factory (ADF), Databricks (PySpark, SQL, Delta Live Tables), and dbt.
...
•Develop solutions for integrating structured and unstructured data into star and snowflake schemas.
•Optimize SQL queries, indexing, and partitioning strategies for improved performance.
•Ensure data quality, integrity, and governance through data lineage, cataloging, and metadata management.
•Implement and manage cloud security using RBAC, Unity Catalog, and data encryption.
•Optimize cloud storage and retrieval performance using Parquet, ORC, and JSON formats.
•Develop and manage workflows and job scheduling in Azure environments.
•Monitor and troubleshoot cloud-based data processes to ensure high availability and performance.
•Enhance Power BI reporting capabilities by integrating Azure Synapse Analytics and Databricks SQL Warehouses.
•Implement AI-driven insights using MLflow and AutoML within data pipelines.
•Support data visualization, analytics, and reporting through Power BI and DAX.
Qualifications
Required Experience
•10+ years in ETL/ELT development and data engineering.
•Strong expertise in Databricks, Delta Lake, Azure Data Factory, and Azure Synapse Analytics.
•Experience with SQL Server, PostgreSQL, and distributed computing frameworks.
•Proficiency in Python (PySpark), SQL, and PowerShell.
•Experience with CI/CD automation using Azure DevOps and GitHub Actions.
•Deep understanding of cloud security, governance, and compliance.
Preferred Skills
•Experience integrating Power BI with Azure Synapse and Databricks SQL Warehouses.
•Familiarity with AI-driven data pipelines using MLflow and AutoML.
•Public sector or healthcare data management experience.
Summary
This Software Developer (ETL) role is ideal for professionals with strong expertise in Azure Data Engineering, Databricks, and cloud-based data pipelines. The role offers opportunities to develop large-scale data solutions, automate workflows, and optimize cloud security and performance, making a significant impact in data-driven decision-making processes.
Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.
Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to accessibility@randstad.ca to ensure their ability to fully participate in the interview process.
voir pluspartager l'offre d'emploi
