Data Platform Engineer

We’re looking for a Data Platform Engineer! Reach out if you’re interested and feel free to refer friends/colleagues!

Type of Employment: Contract
Title: Data Platform Engineer
Term: Fulltime
Location: WFH then Toronto, Mississauga, Etobicoke and London
Job ID number: C1055

Brief description of duties:

The Data Platform Engineer is involved in the complete lifecycle of cloud-based big data platforms from design and development to implementation, as well as operational support. She/he champions and contributes to the development of standards, tools, processes, and best practices.

What you will do:

• Installing, configuring, maintaining, and securing big data platform environments focused primarily on an Azure Synapse ecosystem using toolsets such as (but not limited to):
  – Azure Data Factory
  – Azure Databricks clusters
  – PolyBase
  – Azure Service Bus
  – Azure Synapse
  – Azure Data Lake (Gen 2)
• Experience in key aspects of platform performance health and availability monitoring and administration in a 24×7 production environment
• Assisting users, when required, in troubleshooting data extract errors and data pipeline execution issues
• Strong communication and presentation skills with a high degree of comfort with large and small technical audiences including the ability to influence senior-level executives
• Identify and implement the optimal data ingestion method technology for a batch processing solution using a variety of ELT/ELT toolsets (i.e. Syncsort, ADF) to develop/support batch processing solutions
• Identify transformation logic to be used in the Mapping Data Flow in Azure Data Factory Design batch and near real-time processing solutions including streaming
• Design, implement and support scheduled data pipelines from a variety of sources into the Azure ecosystem
• Manage the data lifecycle, design Azure Data Storage Solutions, and recommend a solution based on requirements which include data archival and restoration