Senior Data Engineer
Dallas, TX, United States
LTK is the largest influencer-driven platform used by millions of shoppers every month to find new styles and products curated by influencers all over the world. As a Staff Data Engineer, you will be part of a growth-hungry, acceleration-minded team of problem-solvers and product-builders. This is an opportunity to grow with a fast-growing organization. We thrive in an extremely dynamic competitive environment. We focus relentlessly on the needs of our influencers, brands, and consumers. We seek thought-leaders who can collaborate effectively with product managers, designers, and engineers to identify actionable insights to help us grow.Title: Staff Data Engineer Responsibilities Lead the technical definition, prototyping, and production-ready enablement of LTK’s data lakehouse, optimizing efficiencies, performance, scale, and cost
Establish reusable and scalable technical patterns and frameworks
Promote and support the governance of LTK’s data lakehouse
Participate in the overall strategic direction of the data engineering technology stack
Stay abreast of data engineering technical trends and emerging approaches
Evaluate new technologies and/or custom solutions
Define technical projects (“epics”) with clarity including scope, technical approach, and work estimations
Facilitate on-time delivery of technical work products
Effectively communicate, influence, and gain alignment both within team and with interdependent teams and stakeholders (including senior leadership)
Produce high quality technical documentation and artifacts that are easily consumable by data teams and other engineering teams
Build required infrastructure for optimal ETL processes for data from various data sources using AWS, SQL and orchestration technologies.
Ensure the reliability and quality of data across the data lake (at rest) and in the pipelines (in motion)
Qualifications 13-15+ years experience in building data pipelines, coding for data management, data warehousing, or other data environments, including, but not limited to Spark.
Bachelor’s degree in information systems, computer science, or a related field; Master’s preferred
Excellent expertise of system design and application architecture for data platforms;
Experience driving end to end ETL data pipelines, from ingestion of data to consumption by business intelligence, analytics and other data consumer teams
Experience driving production-grade, multi-million dollar data strategy
Experience in application design and implementation, as senior technical lead role, using agile practices;
Experience with Data management and Data governance processes and standards;
Experience working on a remote team and coaching / mentoring / leading data engineer team members;
Expertise in Scala, or Python programming at minimum, with demonstrated real-world experience building out data tools in Cloud environments
Extensive knowledge in SQL fine tuning, optimizers and execution plans;
Proven experience building complex data models to handle millions of transactions;
Proven extensive experience working with AWS cloud computing environment. Profound knowledge of AWS Data services (eg: Redshift, S3, EMR, Glue, RDS, Kinesis, etc.)
Demonstrated leadership and specialized expertise in at least 2 of the following:
Batch data ingestion
Big data pipeline engineering and optimization
Analytic/MPP data warehouse optimization
Analytical data modeling
Event streaming data processing
Data pipeline metadata observability
Data Platform Cost Optimization
DataOps
Specialized expertise designing and working with at least 2 of the following data domains:
Retail product data
Ecommerce data
Consumer profile data
Clickstream data
Consumer event data
Marketing channel/campaign data
Affiliate data
Retailer/Brand data
Preferred Qualifications AWS Certified Data Analytics - Specialty Certification
Expertise with multiple platform stacks and tooling (Databricks, Snowflake, DBT, Airflow Orchestration, etc.)
What We Offer The opportunity to be part of the leading global company in creator commerce
A remote-first, productivity-first environment
Competitive compensation and benefits package to meet the needs of you and your family
401(k) with LTK matching
Wellness reimbursement
Paid parental leave program
Summer Fridays, birthday PTO, and paid volunteerism days
In-person team events
Benefits package includes: Medical insurance, PPO, HSA, Wellness benefits, Vision insurance, Dental insurance, Paid maternity leave, Paid paternity leave, Family Bonding Time, Disability insurance, Life insurance, AD&D, Short-Term disability, Paid time off, Pet insurance benefits and more
#J-18808-Ljbffr