ETL Developers

HRBrain

CONTRACT
Canada
Posted 3 months ago

We are looking for a ETL Developers! Reach out if you are interested and feel free to refer friends/colleagues!

 

Type of Employment: Contract
Title: ETL Developers
Term: Contract – 6 months with extension
Location: Toronto – Hybrid
Industry: Government
Job ID number: C1396

 

Brief Description on Duties:

Description
The Office of the Public Guardian and Trustee (OPGT) requires a Senior Software Developer – ETL to perform activities for interfacing the new Dynamics 365 solution and data warehouse with internal (OPS) and external systems as a member of the integrations team made up of internal and vendor staff.

SCOPE:

The Office of the Public Guardian and Trustee (OPGT) requires a Senior Software Developer – ETL to perform activities for interfacing the new Dynamics 365 solution and data warehouse with internal (OPS) and external systems as a member of the integrations team made up of internal and vendor staff.

DELIVERABLES:

As a member of the integrations team, you will be responsible for integrating the new Dynamics 365 solution and data warehouse and internal (OPS) and external systems as a member of the integrations team made up of internal and vendor staff. A high-level list of deliverables for the integrations team follows:

These deliverables will require:

  • Data Analysis: analyze the existing processes and data in the legacy applications and help in designing new processes.
  • Data Mapping and Transformation: map entities and fields in Dynamics 365 CE, F&O and Data Lakehouse to data elements in interfaces. Handle necessary data transformations, ensuring compatibility and consistency.
  • Data Extraction, and Ingestion: help extract/import the required data from/into the Dynamics 3565 and data warehouse, develop and implement extraction/ingestion processes.
  • Data Validation: validate the extracted/imported data to ensure its accuracy, completeness, and consistency. Help with identifying and resolving data quality issues.
  • Develop processes for transferring data and files between internal and external environments via network, sFTP, APIs, Microsoft Power Platform, Logic Apps.
  • Develop processes for encryption and decryption in an Azure environment.
  • Testing and Quality Assurance: conduct thorough testing to verify the accuracy and integrity of the data manipulated in interfaces. Define test cases and address any issues or discrepancies that arise during the testing phase.
  • Document the processes developed.
  • Ongoing Support: provide post-development support, analyze, and address issues or questions; help optimize processes in the new environment.
  • Other duties as assigned.
  • The Vendor’s Personnel will also be required to:
  • Complete work and achieve milestones within the assigned deadlines;
  • Notify the Cluster/Ministry project Manager in writing of any issues or other material concerns related to the Assignment Deliverables, as soon as he/she becomes aware of them
  • Submit Deliverables for the Cluster/Ministry approval as they are completed.
  • Comply with the Ontario Government and the Cluster/Ministry security procedures and practices
  • Comply with the Ontario Government and the Cluster/Ministry architecture/technology standards and best practices
  • Comply with the Ontario Government and the Cluster/Ministry Conflict of Interest and Confidentiality Guidelines
  • Provide knowledge and skill transfer to a designated Cluster/Ministry staff; and
  • Comply with the Ontario Government I&IT Directive, Operational Policy on the I&IT Project Gateway Process, and other applicable Guidelines, Standards and Procedures.

Must Haves:

  • 5+ years of proven working experience in an ETL role; strong understanding of ETL principles, including data extraction, transformation, and loading processes; knowledge of common ETL design patterns.
  • Understanding of data pipeline architectures, Azure workflow orchestration tools, and concepts related to data ingestion, transformation, and movement.
  • Proficiency in Azure Data Factory, Azure Synapse workspaces
  • Strong SQL skills and experience working with Azure SQL Databases and Dataverse; good understanding of Azure storage concepts and technologies.
  • Proficiency in scripting languages like Python, experience with Azure-specific scripting using PowerShell or Azure CLI, .NET, C#, Power Platform, Logic Apps
  • Expert proficiency with data manipulation languages (T-SQL, PL/SQL), data definition languages, physical database design, data modeling, query performance analysis & tuning
  • Knowledge of integration technologies commonly used with Dynamics, such as DataVerse, Data Entities, and APIs.
  • Experience with continuous integration/continuous deployment (CI/CD) processes around DevOps, data workflows, Synapse workspaces.

 

Nice to Have: 

  • Ex-Ministry
  • Similar public sector projects

Job Features

Job CategoryETL Developer

Apply Online