Big Data Engineer

Data EngineerLocation: TechM US Texas PlanoYears of Experience: 7-10 YearsJob Summary: We are seeking a highly skilled Data Engineer with a strong background in GCP Data Testing to join our team as a contractor. The ideal candidate will have 7-10 years of experience in data engineering, with a proven track record of designing, building, and maintaining data pipelines and architectures. You will play a critical role in ensuring the quality and reliability of our data systems, leveraging your expertise in Google Cloud Platform (GCP) to implement robust data testing strategies.Responsibilities:Design, develop, and maintain scalable data pipelines and ETL processes using GCP tools.Implement data testing frameworks to ensure data quality and integrity across various data sources.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.Monitor and optimize data workflows for performance and efficiency.Document data engineering processes, architectures, and testing methodologies.Stay updated with the latest trends and technologies in data engineering and GCP.Provide technical guidance and mentorship to junior team members.Mandatory Skills:Strong expertise in GCP Data Testing, including experience with tools such as Dataflow, BigQuery, and Cloud Storage.Proficient in SQL and data modeling techniques.Experience with ETL tools and frameworks, preferably within the GCP ecosystem.Solid understanding of data warehousing concepts and best practices.Ability to write clean, maintainable code in Python or Java.Preferred Skills:Familiarity with data visualization tools such as Tableau or Looker.Experience with machine learning workflows and data preparation.Knowledge of data governance and compliance standards.Experience with containerization technologies like Docker and orchestration tools like Kubernetes.Qualifications:Bachelor's degree in Computer Science, Information Technology, or a related field.7-10 years of experience in data engineering or a related role.Proven experience in GCP Data Testing and data pipeline development.Strong analytical and problem solving skills.Excellent communication and collaboration abilities.