Senior Azure Data Engineer (Hybrid) Job at Cleo Consulting, Ontario, CA

cnRlUnJMeEVmc3RBV29vSmx4enR0Z2VD
  • Cleo Consulting
  • Ontario, CA

Job Description

Assignment: RQ00163 - Data Science Developer - Senior

Job Title: Data Science Developer Senior

Start Date: 2025-09-22

End Date: 2026-03-20

Office Location: 525 University Avenue. Toronto.

Account: Metrolinx

Department: Solution Delivery

# Business Days: 130.00

Location: Hybrid 2 days onsite/3 days remote

Public Sector Experience: Preferred

Must Haves:

  • 5+ years' experience Azure environment
  • 5+ years' experience Data engineering with ADF and Databricks
  • 5+ years' experience Programming experience with Python, SQL

Description

Responsibilities

  • Participate in product teams to analyze systems requirements, architect, design, code and implement cloud-based data and analytics products that conform to standards
  • Design, create, and maintain cloud-based data lake and lakehouse structures, automated data pipelines, analytics models
  • Liaises with cluster IT colleagues to implement products, conduct reviews, resolve operational problems, and support business partners in effective use of cloud-based data and analytics products.
  • Analyze complex technical issues, identify alternatives and recommend solutions.
  • Support the migration of legacy data pipelines from Azure Synapse Analytics and Azure Data Factory (including stored procedures, views used by BI teams, and Parquet files in Azure Data Lake Storage (ADLS)) to modernized Databricks-based solutions leveraging Delta Lake and native orchestration capabilities
  • Support the development of standards and a reusable framework that streamlines pipeline creation
  • Participate in code reviews and prepare/conduct knowledge transfer to maintain code quality, promote team knowledge sharing, and enforce development standards across collaborative data projects.

General Skills

  • Experience in multiple cloud-based data and analytics platforms and coding/programming/scripting tools to create, maintain, support and operate cloud-based data and analytics products, with a preference for Microsoft Azure
  • Experience with designing, creating and maintaining cloud-based data lake and lakehouse structures, automated data pipelines, analytics models in real world implementations
  • Strong background in building and orchestrating data pipelines using services like Azure Data Factory and Databricks
  • Demonstrated ability to organize and manage data in a lakehouse following medallion architecture;
  • Background with Databricks Unity Catalog for governance is a plus
  • Proficient in using Python and SQL for data engineering and analytics development
  • Familiar with CI/CD practices and tools for automating deployment of data solutions and managing code lifecycle
  • Comfortable conducting and participating in peer code reviews in GitHub to ensure quality, consistency, and best practices
  • Experience in assessing client information technology needs and objectives
  • Experience in problem-solving to resolve complex, multi-component failures
  • Experience in preparing knowledge transfer documentation and conducting knowledge transfer
  • Experience working on an Agile team

Desirable Skills

  • Written and oral communication skills to participate in team meetings, write/edit systems documentation, prepare and present written reports on findings/alternate solutions, develop guidelines / best practices
  • Interpersonal skills to explain and discuss advantages and disadvantages of various approaches

Technology Stack

  • Azure Storage, Azure Data Lake, Azure Databricks Lakehouse, Azure Synapse, Azure Databricks
  • Python, SQL
  • PowerBI
  • GitHub

Job Tags

Work at office, Remote work,

Similar Jobs

Healthpeak Properties, Inc.

Summer Analyst - Investments Job at Healthpeak Properties, Inc.

 ...Healthpeaks Summer Analyst Program offers ambitious undergraduate students a unique opportunity to gain hands-on experience within our Investments team. Over the course of 10 weeks, analysts will develop a strong foundation in life science, medical office, and senior housing... 

Real Property Management

Leasing Agent Job at Real Property Management

 ...Leasing Agent (Independent Contractor)&##128205; Simi Valley, CA & Surrounding Cities &##127970; Real Property Management East San Gabriel ValleyAbout UsReal Property Management Ventura County is a trusted property management company serving Southern California... 

CalOpps

Senior Library Assistant (20652638) Job at CalOpps

 ...interconnectedness of the customer and employee experience.ABOUT THE DEPARTMENTThe is comprised of two divisions, Library and Recreation & Childcare, that are...  ...services.THE POSITIONThe Senior Library Assistant performs the most complex paraprofessional library... 

NavitsPartners

Document Control Administrator - DCA 25-27249 Job at NavitsPartners

 ...Job Title: Document Control Administrator - I (Assistant) Location: DeSoto, KS 66018 Duration: 4+ Months (Contract) Work Hours: Onsite | Monday to Friday | Start time: 8:00 AM CST Pay Rate: $24.00/hr Position Overview: We are seeking a detail... 

Amazon.com Services LLC

Front-End Engineer Internship - 2026 (US) Job at Amazon.com Services LLC

 ...all over the world? As a Front-End Engineer Intern, youll have the opportunity to work closely with experienced developers to create the user-facing side of software....  ...Science, Computer Engineering, Information Science, Web Development, Human-Computer Interaction, or...