Engineer
, CA, United States
Location: Universal City, CA
Duration: 6+ months contract, Full-Time
Employment Type: W-2
Job Description:
· Build complex data engineering pipelines using Python and Airflow to hydrate DataMart in Snowflake and Data Lake in AWS Cloud
· Maintain cloud-based platforms and environments of supported applications, troubleshooting and patching functional issues and data issues in lower or production environments when necessary.
Responsibilities:
· Build complex data engineering pipelines using Python and Airflow to hydrate DataMart in Snowflake and Data Lake in AWS Cloud.
· Quick thinking in troubleshooting production scale data pipelines and analytical thinking in identifying data issues.
· Integrate code with defined CI/CD framework and AWS services required for building secure data pipelines.
· Work in an agile software development team to complete backlog items, working in conjunction with other developers within and other data engineers & architects.
· Test and create automated tests for your code, ensuring every function, service, and object is compatible with your team’s work and with the many systems within the Client system portfolio.
· Act alongside other senior data engineers, help formulate best practices and setting up toolsets and procedures for the team, leveraging internally available tools and communicating with other internal development & product teams.
· Stay up to date on new development and platform technologies, make recommendations for the right tool for the job, and take the lead in setting up those tools and training other developers on them.
· Communicate with business partners around Client to understand the needs of the user and implement those ideas in the code.
· Create documentation for developers as well as business users to help them understand your products.
· Maintain cloud-based platforms and environments of supported applications, troubleshooting and patching functional issues and data issues in lower or production environments when necessary.
· Perform other duties as assigned.
Experience:
· 7+ years of experience in Data Engineering
Skills:
· Strong understanding of Data warehousing concepts
· Proficient in Python for building UDFs and pre-processing scripts
· Proficient in sourcing data from APIs and cloud storage systems
· Proficient in SQL with analytical thought process
· Experience working on Airflow orchestration.
· Must have experience working on any of the cloud platforms - AWS would be preferred.
· Experience with CI/CD tools in a python tech stack.
· Experience working on Snowflake Datawarehouse would be nice to have.
· Competent working in secured internal network environments.
· Experience working in story and task-tracking tools for agile workflows
· Motivated and Self-Starting: able to think critically about problems, decipher user preferences versus hard requirements, and effectively use online and onsite resources to find an appropriate solution with little intervention.
· Passionate about writing clear, maintainable code that will be used and modified by others, and able to use and modify other developers’ work rather than recreate it
Education:
· Bachelor’s Degree in a related field
About US Tech Solutions:
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit www.ustechsolutions.com.
Recruiter Details:
Name: Saurabh
Email: [email protected]
Internal Id: 24-09222
#J-18808-Ljbffr