Senior Data Engineer

Columbus, OH, United States

At Acxiom, our vision is to transform data into value for everyone. Our data products and analytical services enable marketers to recognize, better understand, and then deliver highly applicable messages to consumers across any available channel. Our solutions enable true people-based marketing with identity resolution and rich descriptive and predictive audience segmentation. We are seeking an experienced Data Engineer with a versatile skill set to undertake data engineering efforts to build the next-generation ML infrastructure for Acxiom’s business.

As part of the Data Science and Analytics Team, the Sr. Data engineer will partner with Data Scientists, work hands-on with Big Data technologies and build scalable data pipelines/infrastructure to support development of health care propensity models. The Sr. Data engineer’s responsibilities include collaborating with internal and external stakeholders to identify data ingestion, processing, ETL, data warehousing requirements and develop appropriate solutions using modern data engineering stack in cloud. Success in this role comes from combining a strong data engineering background with product and business acumen to deliver scalable data pipeline and database solutions that can enable & support a high performant, large scale modeling infrastructure at Acxiom. The Sr. Data Engineer will be a champion of the latest Cloud database technologies & data engineering tools.

What you will do:

Partner with Cloud Architects, Data scientists to build scalable, next generation data pipelines for health care model development, model management and governance in Cloud

Be a thought leader and champion for adoption of new cloud-based database technologies and enable migration to new cloud-based modeling stack

Collaborate with other data scientists and team leads to define project requirements & build the next generation data source ingestion, ETL, data pipelining, data warehousing solutions in Cloud

Build data-engineering solutions by developing strong understanding of business and product data needs.

Develop close partnership with internal stakeholders and partners from Engineering, product, and business

Build expert knowledge across various data sources– Acxiom health data sources, Acxiom proprietary data (demographics, psychographics, lifestyle segments), Survey/Panel data, media content activity (TV, Digital, Mobile), and product purchase or transaction data and develop solutions for seamless ingestion and process of the data

Resolves defects/bugs in data pipelines during QA testing, pre-production, production, and post-release.

Contributes to the design and architecture of services across the data landscape

Participation in development of the integration team, contributing to reviews of methodologies, standards, and processes.

Comprehensive internal documentation of designs and service components

Required Skills:

6+ years of data engineering experience with at least 4+ years’ experience working with healthcare data sources and developing large-scale data pipelines in the healthcare vertical.

Experience Designing and implementing Large Scale Snowflake Data Pipelines involving Terabytes of data. Strong expertise in optimizing snowflake SQL queries, resource allocation, and improving query performance.

Knowledge of implementing role-based access controls and data encryption measures, ensuring the security and protection of data

Strong background in data pipelining, warehousing, ETL development solutions for data science and other Big Data applications

6+ years working with large-scale terabyte scale data sources. Ability to work independently, understand & develop complex data solutions

Knowledge of ML algorithms, model development processes, and prior experience creating data solutions to support large-scale modeling efforts.

Experience with distributed, columnar and/or analytic oriented databases or distributed data processing frameworks.

Minimum of 3 years of experience with Cloud databases – AWS Redshift, Snowflake, Azure SQL database, Google Cloud SQL or similar. Experience with NoSQL databases such as mongoDB, Cassandra or similar is a plus

Minimum of 4 years of experience in developing data ingestion, data processing and analytical pipelines for big data, relational databases, NoSQL, data lake and data warehouse solutions

Minimum of 4 years of hands-on experience in Big Data technologies such as, PySpark, Spark/SparkSQL, Dask or similar distributed compute frameworks. Knowledge of streaming technologies such as Kafka, Spark Streaming Ingestion API is a plus

Strong programming skills using Python, PySpark, Scala, Java or similar

Experience with container-based application deployment frameworks (Kubernetes, Docker, ECS/EKS or similar)

Experience with Data Visualization tools such as Tableau, Looker or similar

Outstanding troubleshooting, attention to detail, and communication skills (verbal/written) in a fast paced setting.

Bachelor’s degree in computer science or relevant discipline or 6-7 years of relevant work experience.

Solid communication skills: Demonstrated ability to explain complex technical issues to technical and non- technical audiences.

Strong understanding of the Software design/architecture process.

Experience with unit testing and data quality checks

What will set you apart:

Preferred Skills:

Snowflake Certification Preferred.

Ability to work in white space and be able to develop solutions independently.

Prior experience with Cloud based ETL tools such as AWS Glue, AWS Data pipeline or similar

Experience with building real-time and streaming data pipelines a plus

Experience with MLOps tools such as Apache MLFlow/KubeFlow is a plus

Exposure to E2E ML platform such as AWS Sagemaker, Azure ML studio, Google AI/ML, Datarobot, Databricks or similar a plus

Experience with ingestion, processing and management of 3rd party data

Primary Location City/State:

Homebased - Conway, Arkansas

Additional Locations (if applicable):

Conway

Acxiom is an affirmative action and equal opportunity employer (AA/EOE/W/M/Vet/Disabled) and does not discriminate in recruiting, hiring, training, promotion or other employment of associates or the awarding of subcontracts because of a person's race, color, sex, age, religion, national origin, protected veteran, military status, physical or mental disability, sexual orientation, gender identity or expression, genetics or other protected status.

Attention California Applicants: Please see our CCPA/CPRA Privacy Act notice here (https:////www.acxiom.com/wp-content/uploads/2023/01/CCPA-CPRA-Notice-for-Employees-Eff-01012023.pdf) .

Attention Colorado, California, Connecticut, Maryland, Nevada, New York City, Ohio, Rhode Island, and Washington Applicants: This position is not located in the aforementioned locations but applications for remote work may be considered. For information about this role under state or local equal pay or pay transparency laws, please contact [email protected] .

We are leaders in helping brands achieve the number one mantra for every business – know your customer. For fifty years, we’ve helped marketers deal with a fast-changing future of growing channels, data and technology. By understanding the customer, marketers can communicate with relevance everywhere and drive better customer experiences that build a better brand and, in turn, better business.

We’re one of the marketing industry’s most experienced, respected and forward-thinking leaders. For nearly fifty years, we’ve helped the world’s best marketers understand their customers so that they can reach people with relevance rather than randomness. Our products and solutions form the data foundation that make it possible for marketers to drive better customer experiences and meaningful interactions at scale across every channel.

Our job opportunities will give you the opportunity to showcase your talents, grow your skills, and expose you to cutting-edge technologies, whether you’re an engineer, developer, products guru, systems and security expert, sales and consulting executive, or an intern looking to gain real experience with a company that will make you stand out.

At Acxiom, our values begin with our associates, who are the single most important driver of our success. We’re looking to hire people who share our core values: collaboration, excellence, innovation, a focus on outcomes, and being empowered to make and own decisions that benefit our clients and our company. Our values represent our brand promise – to our clients and to our associates – and define our company culture.

If you are interested in applying for employment with Acxiom and need special assistance or an accommodation to apply for a posted position, contact our recruiting department at 1-877-314-2049.

We highly recommend you create an account to monitor your resume submissions. Click on the Sign In link above to create an account or sign up at the end of your application.

Interested in Acxiom? Learn about our Equal Opportunities, job postings, and more:

About Us (https://www.acxiom.com/about-us/)

Follow Us on Twitter

Find Us on Facebook (http://www.facebook.com/AcxiomRecruiting)

Careers Page

LinkedIn (http://www.linkedin.com/company/acxiom)

Internal applicants need to apply for open positions through their Workday account. Please log into Workday and use the Find Jobs report to search for and apply for positions posted internally. For questions, please contact the recruiter listed on the job posting.

Attention California Applicants: Please see our CCPA/CPRA Privacy Act notice here (https://www.acxiom.com/wp-content/uploads/2023/01/CCPA-CPRA-Notice-for-Employees-Eff-01012023.pdf) .

Attention Colorado, California, Connecticut, Maryland, Nevada, New York City, Ohio, Rhode Island, and Washington Applicants: This position is not located in the aforementioned locations but applications for remote work may be considered. For information about this role under state or local equal pay or pay transparency laws, please contact [email protected] .

Attention Mexico Applicants: Please see our Privacy Policy notice here (https://www.acxiom.com/wp-content/uploads/2023/07/ACXIOM_MX_AVISO_DE_PRIVACIDAD_EMPLEADOS_Privacy_Notice_Workday.pdf) .