AWS Cloud Engineer

We are looking for an AWS Cloud Engineer! Reach out if you are interested and feel free to refer friends/colleagues!

Type of Employment: Contract to hire
Title: AWS Cloud Engineer
Term: 6-months – 37.5 hours/week
Location: Remote
Job ID number: C1153

Brief description of duties:

We are looking for a Tech Lead AWS Cloud Data Engineer for a specific global program in the CRM domain focusing on data integrations implemented on AWS Platform .

Background on Integration work

• We are leveraging a Data Hub built on AWS infrastructure to streamline data integrations within the program.
• The Data Engineering workstream is currently handling data pipelines with AWS using Glue,EMR,Lambda,S3,Redshift,Airflow
• Tech lead will also take ownership of AWS DH and discuss with relevant teams to build integration on AWS
• The current tech stack includes native AWS services around data management on cloud, additionally real time tool stacks as Solace, Ser

Responsibilities

• Practical knowledge of AWS Cloud Services related to data storage, integration and processing (e.g. S3, EMR, Redshift, Glue, Athena, Lambda, Athena, etc.)*****
• Familiarity with AWS foundation services related to compute, network, storage, content delivery, administration, security, deployment ,management and automation technologies****
• Good understanding of AWS Data Analytics services*
• Build end to end data pipeline using native AWS services(S3, AWS EMR, Glue, Athena,Airflow & Redshift)***
  In depth understanding and experience on building data pipelines using Python (preferred) /Scala (nice to have)**
• Experience with AirFlow for Job Orchestration
• Understand and use existing PySpark accelerator framework provided by external consulting company
• Experience with Spark job tuning, cluster tuning
• Collaborate with the Integration Architect and provide inputs around end to end data flows for data integrations based on requirements
• Manage deployed data pipelines on AWS and enhance as and when required
• ETL Architect knowledge
• Knows how to design, build, scale and optimize data-driven solution
• Excellent ability to communicate technical information via documents, diagrams or presentations
• Lead and drive project scoping phase. Collaborate with business and informatics stakeholders to lead the business case development for new initiatives including high level solution options and resource estimates.

MUST haves:

• AWS Cloud Engineering
• Work with vendor
• AWS – Glue, S3, EMR
• Python & Spark programming languages
• Multiple integrations
• 4-8 Data Engineers (in-house & vendor resources)

Nice to have:

• Experience in in building data pipeline Informatica or Talend
• AWS Solution architect certification
• Data modeling and Data architecture