ETL Developers
HRBrain
We are looking for a ETL Developers! Reach out if you are interested and feel free to refer friends/colleagues!
Type of Employment: Contract
Title: ETL Developers
Term: Contract – 6 months with extension
Location: Toronto – Hybrid
Industry: Government
Job ID number: C1396
Brief Description on Duties:
Description
The Office of the Public Guardian and Trustee (OPGT) requires a Senior Software Developer – ETL to perform activities for interfacing the new Dynamics 365 solution and data warehouse with internal (OPS) and external systems as a member of the integrations team made up of internal and vendor staff.
SCOPE:
The Office of the Public Guardian and Trustee (OPGT) requires a Senior Software Developer – ETL to perform activities for interfacing the new Dynamics 365 solution and data warehouse with internal (OPS) and external systems as a member of the integrations team made up of internal and vendor staff.
DELIVERABLES:
As a member of the integrations team, you will be responsible for integrating the new Dynamics 365 solution and data warehouse and internal (OPS) and external systems as a member of the integrations team made up of internal and vendor staff. A high-level list of deliverables for the integrations team follows:
These deliverables will require:
- Data Analysis: analyze the existing processes and data in the legacy applications and help in designing new processes.
- Data Mapping and Transformation: map entities and fields in Dynamics 365 CE, F&O and Data Lakehouse to data elements in interfaces. Handle necessary data transformations, ensuring compatibility and consistency.
- Data Extraction, and Ingestion: help extract/import the required data from/into the Dynamics 3565 and data warehouse, develop and implement extraction/ingestion processes.
- Data Validation: validate the extracted/imported data to ensure its accuracy, completeness, and consistency. Help with identifying and resolving data quality issues.
- Develop processes for transferring data and files between internal and external environments via network, sFTP, APIs, Microsoft Power Platform, Logic Apps.
- Develop processes for encryption and decryption in an Azure environment.
- Testing and Quality Assurance: conduct thorough testing to verify the accuracy and integrity of the data manipulated in interfaces. Define test cases and address any issues or discrepancies that arise during the testing phase.
- Document the processes developed.
- Ongoing Support: provide post-development support, analyze, and address issues or questions; help optimize processes in the new environment.
- Other duties as assigned.
- The Vendor’s Personnel will also be required to:
- Complete work and achieve milestones within the assigned deadlines;
- Notify the Cluster/Ministry project Manager in writing of any issues or other material concerns related to the Assignment Deliverables, as soon as he/she becomes aware of them
- Submit Deliverables for the Cluster/Ministry approval as they are completed.
- Comply with the Ontario Government and the Cluster/Ministry security procedures and practices
- Comply with the Ontario Government and the Cluster/Ministry architecture/technology standards and best practices
- Comply with the Ontario Government and the Cluster/Ministry Conflict of Interest and Confidentiality Guidelines
- Provide knowledge and skill transfer to a designated Cluster/Ministry staff; and
- Comply with the Ontario Government I&IT Directive, Operational Policy on the I&IT Project Gateway Process, and other applicable Guidelines, Standards and Procedures.
Must Haves:
- 5+ years of proven working experience in an ETL role; strong understanding of ETL principles, including data extraction, transformation, and loading processes; knowledge of common ETL design patterns.
- Understanding of data pipeline architectures, Azure workflow orchestration tools, and concepts related to data ingestion, transformation, and movement.
- Proficiency in Azure Data Factory, Azure Synapse workspaces
- Strong SQL skills and experience working with Azure SQL Databases and Dataverse; good understanding of Azure storage concepts and technologies.
- Proficiency in scripting languages like Python, experience with Azure-specific scripting using PowerShell or Azure CLI, .NET, C#, Power Platform, Logic Apps
- Expert proficiency with data manipulation languages (T-SQL, PL/SQL), data definition languages, physical database design, data modeling, query performance analysis & tuning
- Knowledge of integration technologies commonly used with Dynamics, such as DataVerse, Data Entities, and APIs.
- Experience with continuous integration/continuous deployment (CI/CD) processes around DevOps, data workflows, Synapse workspaces.
Nice to Have:
- Ex-Ministry
- Similar public sector projects
Job Features
Job Category | ETL Developer |