AWS Data Engineer

United Airlines

Remote

Sr. AWS Cloud Data Engineer/Architect (AWS Scala/Spark Developer)

Visa friendly

1 year ongoing contract

MUST HAVE

8+ years experience as a Data Engineer
Experience with Scala, Spark and Apache Flink streaming
AWS Cloud Development
Experience with Kafka and or other AWS streaming technologies (Apache Flink is idea and will be a start)

Python, Pyspark

SCALA IS NEEDED (PROFICIENT)

Requirements

Pluses:

Java experience

IBM MQ

Proficiency with ETL architecture.

Day to day:

Senior Scala and Spark Solutions Developer and Data Engineer capable of building a data standardized solution. Ideal candidate has extensive experience with both Data streaming and batch solutions including event-driven and microservices architecture. This is a high visibility, fast-paced key initiative that will integrate data across internal and external sources.

Responsibilities

* Designing, creating, and maintaining Scala-based data task to transform raw data into meaningful data models

* Participating in all architectural development tasks related to the data pipeline.

* Writing code in accordance with the data model requirements

* Collaborating with cross-functional teams

* Mentoring team members in Scala development and management

* Document Scala Development processes including Knowledge Documents, build and run books

* Work with business analysts to understand requirements

* Test to ensure designs are in compliance with specifications

* Debug and resolve technical issues

* Make recommendations to existing infrastructure

* Continually engage in professional development

* Develop documentation to track