Technical Lead
Austin, TX, United States
#LI-AS3
Technical/Functional Skills :
Key Qualifications:
•Create Designs and POC's for new requirements from the client and lead onsite/offshore team at different phases of SDLC lifecycle to take requirements to closure.
•Make sure the team is following all the industry standards or best practices while developing code in Spark/scala.
•Review code, test cases written by the team and look at the performance of spark AWS modules written in spark/python and provide feedback.
•Involve in Requirement gathering and run design reviews with the client.
•Assist in the design and implementation of ETL (Extract, Transform, Load) processes using Spark, learning best practices for data extraction, transformation, and loading in a distributed computing environment.
•Oversee the optimization of Spark jobs by tuning parameters, partitioning strategies, and caching techniques to improve overall performance and resource utilization.
•Involve in development and maintenance of Spark-based data pipelines, ensuring data integrity, reliability, and timely processing of large-scale datasets.
•Collaborate with cross functional teams in AMP ecosystem to implement solutions.
•Have regular connect with team members and unblock the team members to make sure the assigned tasks are completed on timely manner.
•Involve in Sprint Planning & Task Allocation to the team members.
•Mentor and guide the team to take up new learnings based on new requirements from client.
#J-18808-Ljbffr