ⓘ There was an unexpected error processing your request.
Please refresh the page and try again.
If the problem persists, please contact us with your issue.
You can always manage your preferences and update your interests to ensure you receive the most relevant opportunities.
Get ready to discover your next great opportunity.
Highbrow LLC
Austin, TX, United States
Job Title : Lead AWS Data Bricks Spark/Scala Engineer Job ID: 2022-11882 Job Location: Remote, Memphis, TN (preferred), Morris Plains, NJ, Austin, TX (preferred), St. Louis, MO Job Travel Location(s): # Positions: 1 Employment Type: W2 Candidate Constraints: Duration:Long Term # of Layers:0 Work Eligibility:US Permanent Eligibility to Wor
Job Source: Highbrow LLCInfosys
Austin, TX, United States
Job Description : In the role of Lead Data Engineer , you will interface with key stakeholders and apply your technical proficiency across different stages of the Software Development Life Cycle including Requirements Elicitation, Application Architecture definition and Design. You will play an important role in creating the high-level design artif
Job Source: InfosysHighbrow LLC
Austin, TX, United States
Job Title: Scala and Spark Developer Job ID: 2023-12155 Job Location: Austin, TX; Morris Plains, NJ Job Travel Location(s): # Positions: 1 Employment Type: W2 Candidate Constraints: Duration:Long Term # of Layers:0 Work Eligibility:All Work Authorizations are Permitted – No Visa Transfers Key Technology: Spark, Scala, Python, Shell scr
Job Source: Highbrow LLCTEKsystems
Austin, TX, United States
Description: • Exceptional skills in Scala and Spark • Hands on experience with data processing technologies, ETL processes and feature engineering • A track record of developing scalable pipelines and delivering data promptly in a collaborative team environment Skills: Spark, scala, Etl, Aws Top Skills Details: Spark,scala,Etl Additional Ski
Job Source: TEKsystemsInfogain Corp
Austin, TX, United States
GCP Data Engineer (Standard) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India Person with 5+ years of experience in development. Good hands-on knowledge on Core Java and should be able to write complex SQL queries Knowledge on Apache Beam Knowledge on Any cloud technologies (GCP, AWS, Azure). Good communicat
Job Source: Infogain CorpAcxiom LLC
Austin, TX, United States
We are seeking a highly skilled and experienced Senior Software Engineer specializing in Identity Graphs to join our dynamic team. The ideal candidate will be responsible for developing cutting-edge identity graph-based solutions and contributing to the architecture, design, and implementation of our identity graph platform. You will work closely w
Job Source: Acxiom LLCInfogain Corp
Austin, TX, United States
GCP Data Architect (Standard) with skills Big Data, Kafka, Python, Scala, Apache Spark for location Bangalore, India MI/AL Dataplatform Architect with 10-15 years experience, with expertise mainly in ML Ops Architect should be able to do coding and work as an Individual Contributor Should be an Implementation Expert where the person should be abl
Job Source: Infogain CorpHard Yaka
Austin, TX, United States
Senior Data Engineer (Government Security Clearance) About Us: AnChain.AI is an AI-powered Web3 cybersecurity company specializing in cryptocurrency investigation, compliance and cybersecurity. Founded in 2018 by cybersecurity and enterprise cloud veterans, AnChain.AI is backed by both Silicon Valley and Wall Street VCs, and selected in the Ber
Job Source: Hard YakaAustin, TX, United States
Job Title: AWS Data Bricks Spark/Scala Engineer
Job ID: 2023-11933
Job Location: Morris Plains, NJ (remote to start); Remote, Memphis, TN (preferred), Morris Plains, NJ, Austin, TX (preferred), St. Louis, MO
Job Travel Location(s):
# Positions: 1
Employment Type: W2
Candidate Constraints:
Duration:Long Term
# of Layers:0
Work Eligibility:All Work Authorizations are Permitted
Key Technology: DataBricks, AWS, Spark
Job Responsibilities:
Drive mentality of building well architected applications for AWS Cloud.
Drive the mentality of quality being owned by the entire team
Identify code defects and work with developers to address quality issues in product code.
Finding bottlenecks and thresholds in existing code through the use of automation tools.
Articulate clear business objectives aligned to technical specifications and work in an iterative agile pattern daily.
Ownership over your work task and are comfortable interacting with all levels of the team and raise challenges when necessary.
Skills and Experience Required:
6-8 years of strong experience in Spark, Python, Shell Scripting, PostgreSQL, Hadoop, AWS (S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, and CloudWatch), Databricks (Delta lake, Notebooks, Pipelines, cluster management, Azure/AWS integration)
In depth knowledge on Hadoop architecture and its components. Troubleshooting the Hadoop Yarn jobs is must. Implement Hadoop job orchestration using Shell scripting, and Airflow
In depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, RDD caching, Spark MLib.
Strong experience in writing complex and effective SQLs, and Stored Procedures. Strong query optimizations skills to improve performance of ETL process.
Should have strong hands-on cloud experience with AWS suite
Should be able to demonstrate work experience in Hadoop, Spark, hive
Should have strong development experience on Databricks components
Strong hands-on experience on Spark is must
Must have work experience on Hadoop as data warehouse/Data Lake implementations
Moderate to senior Terraform development experience needed
Health care domain knowledge is a plus
#J-18808-Ljbffr
AWS Data Bricks Spark/Scala Engineer jobs in Austin, TX, United States
ⓘ There was an unexpected error processing your request.
Please refresh the page and try again.
If the problem persists, please contact us with your issue.
You can always manage your preferences and update your interests to ensure you receive the most relevant opportunities.
Get ready to discover your next great opportunity.