Type: Contract
Reference ID: 21111606
Date Posted: 05/15/2024
Apply now: Big Data Engineer, a hybrid position local to Atlanta, GA. The start date is ASAP for this long-term contract position.
Job Title: Big Data Engineer Location: Hybrid to Atlanta, GA Duration: 6+ Months to extend Rate: $90-100 Per Hour W2 Start Date: ASAP
Responsibilities:
Architecture and Design
Code Development
Production Support
Mentoring of junior team members
Automation
Requirements:
Bachelor's in computer science or closely related discipline.
High level of experience with Spark Steaming
4+ years of focused experience in Big Data space.
Highly experienced with Scala and either Python or Java
Experience building data processing pipelines at scale on AWS.
Experience in AWS components like EMR, EC2, ECS and Redshift
Deep understanding of the concepts involved with managing resources in AWS.
Experience working with different file formats like Avro , Json , Parquet
Nice to Haves:
Experience in Rest based microservice architecture
Ability to lead new and complex projects having multiple dependencies from design phase all the way to production. This may involve facilitating across multiple teams.
Nice to have experience in Airflow and Jenkins or other CI/CD.
Nice to have experience on different monitoring, alerting, dashboarding tools like Datadog and PagerDuty.
Nice to have dev ops experience with focus on cloud formation and terraform
Other skills needed to perform the job (ex: presentation skills, negotiation skills, etc.).
