Data Engineer (Intermediate OR Senior)

Austin, TX, United States

Location:

1900 Aldrich Street

Austin, Texas, 78723

United States

Data Engineer (Intermediate OR Senior)

Requisition ID:

req1079

Employment Type:

Unclassified Regular Full-Time (URF)

Division:

Investment Data & Analytics

Compensation:

85,034.00 - 128,613.00, Annual Salary

Location:

Alpha

Job Closing:

July 31st at 5:00 pm CST

WHO WE ARE:

The Information Technology (IT) Division lays the foundation for TRS to deliver excellent service experiences across the organization and with our members. We serve with purpose through mentorship and collaboration across a diverse team unified by innovation to create technology and information solutions that have a positive impact on our members' lives.

We invite you to join one of Austin's Top Workplaces. TRS offers a best-in-class combination of technology and continuous learning opportunities to equip you to solve problems, expand your knowledge, and create impact for 1 in 20 Texans.

The Data Engineer is responsible for supporting the Enterprise Data & Analytics team by performing a wide range of data engineering and data management work. The incumbent will create reliable pipelines, combine data sources, architect data stores, assist in architecting distributed systems, and support data management platforms. This position will proactively work with the Data Engineer Team, IT staff, and agency employees.

The Data Engineer Senior is responsible for supporting the data pipeline and ensuring efficient flow of data. The incumbent will create reliable pipelines, combine data sources, architect data stores, and engineer data management platforms. This position will proactively work with the Data Engineering team, IT staff, and agency employees.

This is a hybrid position requiring onsite work conducted at our TRS office in Austin, TX approximately two to three times a week or as required for business needs.

Vacancy will be filled at one of two levels - Data Engineer OR Data Engineer Senior Selected applicant will be offered the position that most closely matches their education and experience.

Salary Range

Intermediate: $85,034 - $106,293

Senior: $102,891 - $128,613

WHAT YOU WILL DO:

Data Engineer

• Designs, builds, manages, and operationalizes data (ETL) pipelines that extract data from distributed sources and load into a data warehouse, data store, or other system to support data and analytics use cases.

• Designs, builds, and provides ongoing operational support of TRS enterprise data warehouses and other data stores, continued development and enhancement of the enterprise data warehouses/data stores, and automation of daily data extracts and external system feeds.

• Creates logical and physical data models (including dimensional patterns) using a modern ER diagramming tool, such as IDERA ER/Studio.

• Performs engineering and automation of data management platforms to support data pipeline management and efficient flow of data.

• Reviews pipeline code and manages related metadata.

• Adheres to established practices for data pipeline continuous integration and continuous delivery (CI/CD) processes.

• Manages data pipeline jobs throughout their lifecycle.

• Supports developing new and enhancing existing dashboards.

• Supports nontechnical users, data scientists, or IT resources and operationalizes data delivery for production level deployments.

• Supports the task of deploying analytics and data science outputs into existing business processes and applications.

• Uses innovative and modern tools, techniques, and architectures to automate data preparation and integration tasks in order to minimize manual processes and improve productivity.

• Assists in the identification and integration of potential new data sources.

• Performs related work as assigned.

Data Engineer Senior

• Performs engineering and automation of data management platforms to support data pipeline management and efficient flow of data.

• Establishes and documents standards for metadata management framework, data catalog framework and data pipeline control.

• Leads review of pipeline code and metadata framework changes.

• Responsible for the data pipeline continuous integration and continuous delivery (CI/CD) processes.

• Manages data pipeline jobs throughout their lifecycle.

• Designs, builds, manages and operationalizes data (ETL) pipelines that extract data from distributed sources and load into a data warehouse, data store or other system to support data and analytics use cases.

• Leads the curation of datasets and data pipelines created by nontechnical users, data scientists or IT resources and operationalizing data delivery for production level deployments.

• Designs, builds and provides ongoing operational support of TRS enterprise data warehouses and other data stores, continued development and enhancement of the enterprise data warehouses/data stores, automation of daily data extracts and external system feeds.

• Creates logical and physical data models (including dimensional patterns) using a modern ER diagramming tool, such as erwin or IDERA ER/Studio

• Uses innovative and modern tools, techniques and architectures to automate data preparation and integration tasks in order to minimize manual processes and improve productivity.

• Ensures data warehouse/data store implementations meet business expectations.

• Ensures compliance with data governance and data security requirements.

• Ensures that controls to verify the accuracy and consistency of data are implemented and monitored.

• Acts as the IT knowledge leader on architecting distributed systems, data platforms, data pipelines and data stores.

• Ensures the customer can exploit the data warehouse solutions and helps identify additional possible uses of information; anticipates future needs and opportunities.

• Assists in the identification and integration of potential new data sources.

• Supports the task of deploying analytics and data science outputs into existing business processes and applications.

• Supports development new and the enhancement of current dashboards.

• Performs related work as assigned.

WHAT YOU WILL BRING:

Required Education

• Bachelor's degree from an accredited college or university in computer information systems, computer science, data management, information systems, information science, mathematics, or a closely related field.

• Graduation from an accredited four-year college or university with major coursework in computer information systems, computer science, data management, information systems, information science, mathematics or a related field. (Senior)

• High school diploma or equivalent and additional full-time experience in data engineering or related experience may be substituted on an equivalent year-for-year basis.

Required Experience

Data Engineer

• Three (3) years of full-time directly related, progressively responsible experience in Data Engineering or related experience, including:

• ETL and pipeline design and development

• Data modeling

• Azure Synapse, SQL, CI/CD, Git, Snowflake, Databricks, and general programming

• Experience working with architects to design data warehouses, data lakes, and data pipelines

• Data lake, warehouse, and pipeline operations

• Supporting data and analytics teams

• Agile development & DevOps approach to maintaining pipelines and databases

• Experience in a team environment requiring substantial collaboration

• Experience may be concurrent.

• A master's degree or doctoral degree in a closely related field may be substituted on an equivalent year-for-year basis.

Data Engineer Senior

• Five (5) years of experience in:

• Data-related fields of work: data (ETL) pipeline design and build, data management platform support, data mining, data analytics, data warehousing (including dimensional modeling), ETL tools and cloud platforms

• Data pipeline builds and implementation

• Utilizing ETL tools or creating ETL scripts

• Data Warehouse solution implementations (design, implementation, and ongoing support/maintenance), including interaction with business users

• Working closely with business analytics teams and data analysts

• Experience may be concurrent.

Required Registration, Certification, or Licensure

• None.

Preferred Qualifications

• Experience with SSIS, Synapse Pipelines/Azure Data Factory, or similar data integration toolset

• Experience with Data Catalog and Data Stewardship tools and processes

• Creating logical and physical data models (including dimensional patterns) using a modern ER diagramming tool, such as Erwin or IDERA ER/Studio

• Power BI or equivalent data visualization

• Python or R knowledge

• Experienced in Agile methodologies & DevOps approach to maintaining pipelines and databases. (Senior)

• Experience with Talend Studio and Data Integration. (Senior)

• Experience with Talend Data Catalog and Data Stewardship (Senior)

• Creating logical and physical data models (including dimensional patterns) using a modern ER diagramming tool, such as erwin or IDERA ER/Studio (Senior)

• SQL, T-SQL and Power BI or equivalent modern data visualization package. (Senior)

• Experience with metadata driven ETL templates. ( Senior)

Knowledge Of:

• Data management disciplines: data architecture, data warehousing, data integration and interoperability, data modeling (including dimensional), and data storage and operations.

• Process management, and metrics management.

• Commonly used data and analytics technologies (Azure Synapse Analytics, SQL Server, etc.)

• Relational and non-relational data structures, theories, principles, and practices.

• Metadata management and associated processes.

• Web services (REST, SOAP, XML, WSDL, JSON, etc.).

• Emerging data and analytics technologies (i.e. Hadoop, Spark, MongoDB, Azure, Data Lake, etc.) (Senior)

• Cloud platforms and development patterns (i.e. AWS, Azure, MapReduce, etc.) (Senior)

• Machine-learning, statistical analysis, artificial intelligence, predictive analytics. (Senior)

• Relational and non-relational data structures, theories, principles, and practices. (Senior)

• Data encryption and secure transmission practices (SSL, SSH, SFTP, Certificates, PKI, OAUTH2). (Senior)

Skills In:

• Highly complex problem solving and critical thinking

• Planning, organizing, and coordinating work assignments to effectively meet frequent and/or multiple deadlines

• Highly complex problem solving and critical thinking, and operating computers and applicable computer software. (Senior)

• Planning, organizing, and coordinating work assignments to effectively meet frequent and/or multiple deadlines, handling multiple tasks simultaneously, and managing conflicting priorities and demands. (Senior)

• Project management and system development life cycle concepts.

• Client/user interaction to determine system requirements.

• Strong written and oral communication skills.

• Strong presentation and interpersonal skills.

• Strong technical zeal with a passion for solving complex problems.

Ability To:

• Present ideas in user-friendly language.

• Establish and maintain harmonious working relationships with co-workers, agency staff, and external contacts.

• Work effectively in a professional team environment.

• Work in an Agile development environment.

• Work in a cross-functional team environment; including utilization of business and technical resources.

Military Occupational Specialty (MOS) Codes:

Veterans, Reservists or Guardsmen with experience in the Military Occupational Specialty ( https://www.trs.texas.gov/files/trs-military-crosswalk.xlsx ) along with the minimum qualifications listed above may meet the minimum requirements and are highly encouraged to apply. Please contact Talent Acquisition at [email protected] with questions or for additional information.

To view all job vacancies, visit www.trs.texas.gov/careers or www.trs.csod.com/careersite.

For more information, visit www.trs.texas.gov.