Scala and Spark Developer
Austin, TX, United States
Job Title: Scala and Spark Developer
Job ID: 2023-12155
Job Location: Austin, TX; Morris Plains, NJ
Job Travel Location(s):
# Positions: 1
Employment Type: W2
Candidate Constraints:
Duration:Long Term
# of Layers:0
Work Eligibility:All Work Authorizations are Permitted – No Visa Transfers
Key Technology: Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop
Job Responsibilities:
Work with business and technical leadership to understand requirements
Participate in sprint planning sessions and help TPOs
Troubleshooting the issues, provide effective solutions and application monitoring in productions environment.
Skills and Experience Required:
7+ years of strong development experience in Spark, Scala, Python, Shell scripting, PostgreSQL, and Hadoop
In depth knowledge on Hadoop architecture and its components
Strong working knowledge on Single Store (MEMSQL) database
Should have good hands-on experience working with Indexes, Shard keys, column store, and reference tables using Single Store database.
Must understand basic AWS services and hands on experience
Basic to moderate Terraform development experience needed
Should be able to demonstrate work experience in Hadoop, Spark, hive
Strong hands-on experience on Scala and Spark is must
Must have work experience on Hadoop as data warehouse/Data Lake implementations
Strong experience on DevOps pipeline implementation
Health care domain knowledge is a plus
Troubleshooting the Hadoop Yarn jobs is must
Strong experience in writing complex and effective SQLs, and Stored Procedures
Strong development experience on Single Store database operations
Strong profiling skills using Single Store database
Strong query optimizations skills to improve performance of ETL process
Implement Hadoop job orchestration using Shell scripting, and Airflow
Experience in Agile and working knowledge on DevOps tools (Get, Maven, Jenkins, Sonar Cube, and Checkmarks)
Unix Shell scripting and basic administration of Unix servers
AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and Cloud Watch)
Experience in Jira and Confluence
Must participate in production support model.
#J-18808-Ljbffr