Data Platform Engineer

HRBrain

Full Time
Canada
Posted 3 months ago

We’re looking for a Data Platform Engineer! Reach out if you’re interested and feel free to refer friends/colleagues!

 

Type of Employment: Contract
Title: Data Platform Engineer
Term: Fulltime
Location: WFH then Toronto, Mississauga, Etobicoke and London
Job ID number: C1055

 

Brief description of duties:

 

The Data Platform Engineer is involved in the complete lifecycle of cloud-based big data platforms from design and development to implementation, as well as operational support. She/he champions and contributes to the development of standards, tools, processes, and best practices.

 

What you will do:

  • Installing, configuring, maintaining, and securing big data platform environments focused primarily on an Azure Synapse ecosystem using toolsets such as (but not limited to):
    – Azure Data Factory
    – Azure Databricks clusters
    – PolyBase
    – Azure Service Bus
    – Azure Synapse
    – Azure Data Lake (Gen 2)
  • Experience in key aspects of platform performance health and availability monitoring and administration in a 24×7 production environment
  • Assisting users, when required, in troubleshooting data extract errors and data pipeline execution issues
  • Strong communication and presentation skills with a high degree of comfort with large and small technical audiences including the ability to influence senior-level executives
  • Identify and implement the optimal data ingestion method technology for a batch processing solution using a variety of ELT/ELT toolsets (i.e. Syncsort, ADF) to develop/support batch processing solutions
  • Identify transformation logic to be used in the Mapping Data Flow in Azure Data Factory Design batch and near real-time processing solutions including streaming
  • Design, implement and support scheduled data pipelines from a variety of sources into the Azure ecosystem
  • Manage the data lifecycle, design Azure Data Storage Solutions, and recommend a solution based on requirements which include data archival and restoration

Job Features

Job CategoryData Engineer
Microsoft Azure ecosystem4-5
cloud data platforms4-5
Unix and Windows integrated4-5

Apply Online