Data Engineer

We are looking for a Data Engineer! Reach out if you are interested and feel free to refer friends/colleagues!

Brief Description on Duties:

The Data Engineer will design, build, and support the cloud-based infrastructure for the data pipeline and analytics across the client’s development and data platforms to produce high-performance and scalable solutions.

The role requires the incumbent to innovate and drive solutions that complement the IT vision.

• This role will lead enhancements requested by Investment business partners, including Front Office, Investment Risk, and Investment Operations. They will be providing occasional production support to their core investment data warehouse.

Responsibilities:

• As a key member of the data platform design committee, set guidelines, standards, and best practices for new project initiatives across development and data management teams.
• Design and implementation of data and technology infrastructure for new data and analytics platform with Azure data stack
• Design and build data solutions for distributed ETL processing for all data ingestion into the data platform (dimensional layer) with scalable and usable data pipelines.
• Be the primary liaison and owner for data projects, technical backlog, and managing the delivery solutions with business stakeholders.
• Oversee and build custom web APIs using Azure Function Apps to integrate with external services
• Oversee and develop complex SQL for ETL and data extractions with high-performing and easy-to-manage code.

MUST HAVE:

• ETL with Azure Data Factory experience, building pipelines, with strong experience building Dimensional data warehouses
• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS)
• Azure Databricks (ADB)
• Azure Synapse
• Azure Function apps
• Build processes (plan, design, and implement enhancements end-to-end)
• Expert in SQL – development from transformation perspective, writing complex SQL queries, views, and procedures
• Some sort of investment or capital markets experience

Soft skills:

• Independent worker needing very little guidance after being trained on framework
• Flexible and accommodating with work being done – learn existing practice/framework, can enhance and work with it
• Strong communication skills

Nice to Have:

• Power BI
• Snowflake – VERY NICE TO HAVE