Senior Data Engineering Co-Op

About the Department

Position Duties

• Gain familiarity with OPMI’s data infrastructure and workflows, understanding data collection, transformation, and reporting processes at various development stages. Develop and maintain automated data pipelines for ingesting, transforming, and publishing transit-related data using GitHub Actions, Docker, and other CI/CD tools. Improve data quality control by implementing automated validation, anomaly detection, and monitoring systems. Monitor and troubleshoot data pipelines, proactively identifying and resolving failures, bottlenecks, or inconsistencies. Analyze and optimize data storage and processing workflows, recommending improvements for efficiency and scalability. Support version control best practices for data pipelines and scripts using GitHub and GitHub Actions. Perform ad hoc data cleaning, transformation, and integration using SQL, R, or Python, with optional analysis and visualization as needed. Assist in documentation and reporting, contributing to dashboards, reports, presentations, and technical protocols for internal and external stakeholders. Collaborate with the data team to present findings and support data-driven decision-making across MBTA and MassDOT. Engage in team meetings, knowledge-sharing sessions, and organizational events to support collaboration and workflow improvements. Participate in fieldwork efforts as needed, assisting in real-world data collection and integration into automated pipelines. Participate in team / staff meetings, organizational events, fieldwork, project teams, or other duties as assigned. Provide internal and external customers with courteous and professional experience. Additional responsibilities may focus on one or more specific departments or locations (refer to department-specific addendums or hiring manager guidance). Perform all other duties and projects assigned. * The statements contained in this job description are intended to describe the general nature and complexity of the work being performed by staff assigned to this job and do not represent an exhaustive list of all duties, tasks, and responsibilities required of staff assigned to this position. The physical demands and work environment characteristics described here-in are representative of those an employee may encounter while performing the essential functions of this job. Reasonable accommodations can be made to enable individuals with disabilities to perform essential functions.
• Gain familiarity with OPMI’s data infrastructure and workflows, understanding data collection, transformation, and reporting processes at various development stages.
• Develop and maintain automated data pipelines for ingesting, transforming, and publishing transit-related data using GitHub Actions, Docker, and other CI/CD tools.
• Improve data quality control by implementing automated validation, anomaly detection, and monitoring systems.
• Monitor and troubleshoot data pipelines, proactively identifying and resolving failures, bottlenecks, or inconsistencies.
• Analyze and optimize data storage and processing workflows, recommending improvements for efficiency and scalability.
• Support version control best practices for data pipelines and scripts using GitHub and GitHub Actions.
• Perform ad hoc data cleaning, transformation, and integration using SQL, R, or Python, with optional analysis and visualization as needed.
• Assist in documentation and reporting, contributing to dashboards, reports, presentations, and technical protocols for internal and external stakeholders.
• Collaborate with the data team to present findings and support data-driven decision-making across MBTA and MassDOT.
• Engage in team meetings, knowledge-sharing sessions, and organizational events to support collaboration and workflow improvements.
• Participate in fieldwork efforts as needed, assisting in real-world data collection and integration into automated pipelines.
• Participate in team / staff meetings, organizational events, fieldwork, project teams, or other duties as assigned.
• Provide internal and external customers with courteous and professional experience.
• Additional responsibilities may focus on one or more specific departments or locations (refer to department-specific addendums or hiring manager guidance).
• Perform all other duties and projects assigned.
• * The statements contained in this job description are intended to describe the general nature and complexity of the work being performed by staff assigned to this job and do not represent an exhaustive list of all duties, tasks, and responsibilities required of staff assigned to this position. The physical demands and work environment characteristics described here-in are representative of those an employee may encounter while performing the essential functions of this job. Reasonable accommodations can be made to enable individuals with disabilities to perform essential functions.

Minimum Qualifications

• Enrolled, for entire duration of employment, in the graduate / Master’s degree program of an accredited college / university in computer science, data analytics, math, physics, engineering, public policy, urban planning, government, or a related field (must have proof of enrollment). Problem-oriented thinking and comfort with ambiguity. Above average ability to break down broad problems into answerable questions and identify appropriate tools for addressing each step of answering such questions. Above average skills in at least one programming language (such as R or Python) and willingness to pick up new languages. At least one year of experience with DevOps technologies, such as Docker, GitHub Action, and Terraform. At least one year of experience with basic relational database operations and SQL querying. Above average quantitative / analytical perspective and talents. Above average ability to critically review data and communicate technical knowledge to a non-technical audience. Strong interest or experience with data governance, familiarity with some open data platforms. Above average proficiency with standard office software (e.g. Microsoft office) or relevant technical tools. Above average ability to communicate effectively in English, both in written and oral forms. Highly organized, self-motivated, and detail oriented. Demonstrated interest in public transportation, urban planning, engineering, public policy, or public service. Proven ability to work effectively both independently and collaboratively within diverse, fast-paced environments. Ability to commute independently to assigned work locations within the Greater Boston metro area, as required by the role. Authorized to work in the United States (international students in CPT, STEM, or OPT programs through a university are eligible to apply). The MBTA does not provide visa sponsorship, such as H1-B status. * The above statements are intended to describe the general nature and complexity of the work being performed by staff assigned to this job and do not represent an exhaustive list of all duties, tasks, and responsibilities required.
• Enrolled, for entire duration of employment, in the graduate / Master’s degree program of an accredited college / university in computer science, data analytics, math, physics, engineering, public policy, urban planning, government, or a related field (must have proof of enrollment).
• Problem-oriented thinking and comfort with ambiguity.
• Above average ability to break down broad problems into answerable questions and identify appropriate tools for addressing each step of answering such questions.
• Above average skills in at least one programming language (such as R or Python) and willingness to pick up new languages.
• At least one year of experience with DevOps technologies, such as Docker, GitHub Action, and Terraform.
• At least one year of experience with basic relational database operations and SQL querying.
• Above average quantitative / analytical perspective and talents.
• Above average ability to critically review data and communicate technical knowledge to a non-technical audience.
• Strong interest or experience with data governance, familiarity with some open data platforms.
• Above average proficiency with standard office software (e.g. Microsoft office) or relevant technical tools.
• Above average ability to communicate effectively in English, both in written and oral forms.
• Highly organized, self-motivated, and detail oriented.
• Demonstrated interest in public transportation, urban planning, engineering, public policy, or public service.
• Proven ability to work effectively both independently and collaboratively within diverse, fast-paced environments.
• Ability to commute independently to assigned work locations within the Greater Boston metro area, as required by the role.
• Authorized to work in the United States (international students in CPT, STEM, or OPT programs through a university are eligible to apply). The MBTA does not provide visa sponsorship, such as H1-B status.
• * The above statements are intended to describe the general nature and complexity of the work being performed by staff assigned to this job and do not represent an exhaustive list of all duties, tasks, and responsibilities required.

Benefits

• This position is not eligible for benefits through the MBTA. However, some positions might be eligible to incur paid sick time or to receive a complimentary pass for travel on the MBTA transit system. Please speak with the assigned recruiter or email [email protected] for more information.

Supplemental Questions