Summary: The Data Engineer will work closely with the Data Architect and the Baseball Systems team to maintain, enhance, and extend the Brewers data pipelines. You will be responsible for collecting and transforming data from various sources as well as preparing and distributing data for consumption by the department’s systems and analysts. The ideal candidate is an experienced data pipeline builder who excels at automating and optimizing data systems, with a strong preference for cloud experience.
Essential Duties and Responsibilities include the following. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. Other duties may be assigned.
- Create, maintain and optimize data ETL pipelines
- Document, troubleshoot, and resolve issues with data processes
- Collaborate with the Development and Research teams
- Extend our AWS cloud platform initiative
- Identify, design, and implement internal process improvements
- Work with stakeholders to utilize data to create innovative solutions to baseball operations problems
- Prepare data sets for processing and research
Qualifications: To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required.
- Experience with programming languages such as Python, Java, C#
- Experience working with relational databases such as SQL Server and PostgreSQL
- Experience with SQL, including writing and maintaining queries
- Experience with SDLC, especially Agile or Kanban concepts
- Experience with source control and issue management, such as JIRA, Bitbucket, Github or similar
- Familiarity with advanced statistical baseball concepts, including advanced statistics and player evaluation metrics
Preferred skills: The skills listed below will help an individual perform the job, however they are not all required.
- Experience building visualizations with tools such as D3.js or similar
- Experience with data analysis tools including Tableau, Chartio or similar
- Experience with cloud services including AWS, Azure, Google Cloud or similar
- Experience with DevOps concepts such as Continuous Integration and Continuous Deployment, using TeamCity, Jenkins or similar
- Experience with job orchestration tools such as Airflow, Luigi, Hangfire or similar
- Experience with Docker or other containerization technologies
- Familiarity with Linux and non-Windows operating systems
Education and/or Experience
Bachelor’s degree (B. A.) in Computer Science, Information Systems, or related field from four-year college or university; and one to three years related experience and/or training; or equivalent combination of education and experience.
Other Skills and Abilities
Capable of working extended hours such as overtime, nights, and weekends when necessary.
Language Skills
Ability to read and comprehend simple instructions, short correspondence, and memos. Ability to effectively present information in one-on-one and small group situations to department members and non-technical baseball operations staff.
Mathematical Skills
Ability to add, subtract, multiply, and divide in all units of measure, using whole numbers, common fractions, and decimals. Ability to compute rate, ratio, and percent and to draw and interpret bar graphs.
Reasoning Ability
Ability to define problems, collect data, establish facts, and draw valid conclusions. Ability to apply common sense understanding to carry out detailed but uninvolved written or oral instructions. Ability to deal with problems involving a few concrete variables in standardized situations.
Physical Demands
The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
While performing the duties of this Job, the employee is regularly required to use hands to finger, handle, or feel and talk or hear. The employee is frequently required to reach with hands and arms. The employee is occasionally required to stand; walk; sit and stoop, kneel, crouch, or crawl. The employee must regularly lift and /or move up to 25 pounds. Specific vision abilities required by this job include close vision, distance vision, peripheral vision and ability to adjust focus.
Work Environment
The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
The noise level in the work environment is usually quiet.
Work Hours
Business hours are Monday – Friday 9am – 5pm, however, candidates must be capable of working extended hours such as overtime, nights, and weekends, when necessary.
Thank you for reading
This is a free article. If you enjoyed it, consider subscribing to Baseball Prospectus. Subscriptions support ongoing public baseball research and analysis in an increasingly proprietary environment.
Subscribe now