Data Engineer - Remote (GCP/Teradata)

Integration Engineer – Cloud & Integration Platforms Team Best Buy IT has a contingent worker position available within our Cloud & Integration Platforms Team, focusing specifically on enterprise integration and data flow capabilities. The Integration Engineer will focus on providing engineering and operations for existing and future integration and dataflow platforms. They will work closely with the Best Buy application teams that leverage these platforms in both the data centers and public clouds. This position will serve on a broader team of technology professionals, cooperatively designing and enhancing systems, developing standards, and creating robust technology solutions that deliver real business value to Best Buy. The ideal candidate will possess demonstrated experience in managing and supporting an enterprise and will develop or have a very strong knowledge of cloud and integration technologies, automation and highly available and secure designs.

Key position responsibilities include:

Integration Platforms – Integration and dataflow: The Software Developer/Engineer will work as part of an Agile scrum team analyzing, planning, designing, developing, testing, debugging, optimizing, improving, documenting, and deploying complex/scalable/highly available software applications on Distributed Platforms

6 or more years of experience in performance tuning SQL queries on OLAP databases

4 or more years of experience in windows and unix based file transfer, data transfer systems used for ETL

2 or more years of experience in data modeling based on business use cases

2 or more year of experience to engineer distribute data processing systems using Apache Spark or similar

Strong knowledge of using data structures and algorithms to solve problems

Educational background in computer science

Basic knowledge of cloud computing with AWS, Azure or GoogleCloudPlatform

1+ years of integration experience on cloud platforms such as GCP, Azure, AWS. Experience in Google Data Flow, Google Data Proc, REST APIs, Google Publish/Subscribe and Java/Python scripting. Strong knowledge of GCP services and core features. Candidate should independently manage design, development, Testing, deployment and monitoring. Excellent understanding of Agile/CI/CD and SDLC processes and automated tools, spanning requirements/issue management, defect tracking, source control, build automation, test automation and release management. Provide consulting for app teams that require guidance on integration services and consumption. Define, provision and document proper security controls for integration platforms. Ensure that integration platforms are secured by monitoring security vulnerabilities and remediating. Provide operational support for use cases leveraging integration services in Best Buy private and public clouds. Participate in a rotating on call schedule

Automation: Automate and provision integration services in private and public clouds leveraged by Best Buy. Automate the installation, configuration operation and monitoring of integration systems using a wide variety of open source tools. Build, scale and secure Best Buy integration platforms focused specifically on a fully automated Linux environment. Develop scripts leveraging scripting technologies such as Chef, Ansible and cloud native API’s. Perform zero downtime deployments and configuration changes across multiple globally distributed origins

Basic Qualifications:

Bachelor's or advanced degree in IT, Computer Science or related field

4 or more years of development experience in language such as Java, Python

Minimum of 3 years of development experience on Cloud Platforms

Familiarity with Agile systems management processes and standards

Experience working in a cross functional team in an enterprise IT environment

Preferred Qualifications:

Bachelor's or advanced degree in IT, Computer Science or related field

Experience with event streaming technologies such as Apache Kafka, Confluent Kafka

Experience with messaging technologies such as RabbitMQ or IBM MQ

Experience with Elasticsearch, Logstash, Filebeat, Metricbeat and monitoring tools like Kibana, Grafana and Splunk

Experience utilizing industry standard technologies and methods to ensure integrity and recoverability of platforms

Familiarity with Agile systems management processes and standards

Conceptual understanding of Agile and DevOps culture

Experience leveraging development pipelines, DevOps philosophies and working with infrastructure-as-code

Experience working in a cross functional team in an enterprise IT environment

Experience collaborating and communicating across IT teams, departments and with internal and external customers

Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical