Job description

AWS Data Engineer Lead, Core Technical Skills

5+ years of AWS experience

Experience in a regulated environment

AWS services - S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions

Experience with Kafka/Messaging preferably Confluent Kafka

Experience with databases such as DocumentDB, MySQL, Postgres, Glue Catalog, Lake Formation, Redshift, DynamoDB and Aurora and SQL

Tools and Languages – Python, Spark, PySpark

Experience with Secrets Management Platform like Vault and AWS Secrets manager

Experience with Event Driven Architecture

Experience with Rest APIs and API gateway

Experience with AWS workflow orchestration tool like Airflow or Step Functions

AWS Data Engineer Lead Additional Technical Skills (nice to have, but not required for the role)

Experience with native AWS technologies for data and analytics such as Kinesis, OpenSearch

Databases - Document DB, MongoDB Atlas

Data Lake platform (Hive, Druid, Apachi Hudi/Apache Iceberg/Databricks Delta)

Java, Scala, Node JS, Pandas

Workflow Automation

Experience transitioning on premise big data platforms into cloud-based platforms such as AWS

Strong Background in Kubernetes, Distributed Systems, Microservice architecture and containers

Day to Day Responsibilities/project specifics:

Provides technical direction, guides the team on key technical aspects and responsible for product tech delivery

Lead the Design, Build, Test and Deployment of components

i. Where applicable in collaboration with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead)

Understand requirements / use case to outline technical scope and lead delivery of technical solution

Confirm required developers and skillsets specific to product

Provides leadership, direction, peer review and accountability to developers on the product (key responsibility)

Works closely with the Product Owner to align on delivery goals and timing

Assists Product Owner with prioritizing and managing team backlog

Collaborates with Data and Solution architects on key technical decisions

i. The architecture and design to deliver the requirements and functionality

Mentor other developers in development of components and related processes

Job Type: Full-time

Salary: $80.00 - $85.00 per hour

Experience level:

• 10 years
• 11+ years
• 9 years

Schedule:

• 8 hour shift

Experience:

• AWS Data Engineer: 5 years (Preferred)

Work Location: On the road

www.arclintfl.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, www.arclintfl.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, www.arclintfl.com is the ideal place to find your next job.