Lead Data Engineer

Responsibilities

• Design, implement, and maintain scalable and reliable data pipelines and ETL processes to support diverse business requirements. Continuously monitor data pipeline performance and reliability, optimizing workflows and proactively resolving issues. Integrate and connect various data sources, including structured and unstructured data from global platforms. Identify, evaluate, and integrate new data sources to broaden the scope and improve the quality of available data sets. Optimize indexing strategies for handling large-scale, multi-domain datasets efficiently. Ensure strict adherence to data quality, consistency, and enterprise compliance standards throughout data processing. Develop and implement monitoring and alerting mechanisms to track data pipeline health and SLA compliance. Partner with AI/ML engineers, data scientists, and product teams to enable seamless delivery of data-driven solutions. Collaborate with cross-functional teams to ensure data engineering initiatives align with strategic project objectives and deadlines. Qualifications & Skills Bachelor's or Master’s degree in Computer Science Engineering or related field, accompanied by 10+ years of professional experience in data engineering. Proficiency with programming languages including Python, PySpark, and SQL for developing efficient and scalable data solutions. Hands-on experience with leading data engineering tools such as Azure DataBricks, Azure DevOps, and Visual Studio Code. Strong knowledge of REST APIs, facilitating effective data integration and automation. Familiarity with Generative AI concepts and experience integrating Large Language Models (LLM) is highly desirable. Solid understanding of cloud-based data platforms and designing scalable data architectures. Success Behaviors The ideal candidate is a proactive team player who excels in transparent communication, providing consistent updates to both the team and stakeholders. A customer-focused and adaptable mindset is crucial to navigate a varied and fast-paced work environment. We value a collaborative, approachable, and transparent individual who remains calm and effective in handling critical and urgent situations. Demonstrating these behaviors will empower you to thrive within Epiroc’s inclusive and innovative culture. Why Work with Us? By joining Epiroc, you become part of a forward-thinking organisation with a strong commitment to innovation and digital transformation. You will engage with cutting-edge technologies, collaborate with global talent, and gain valuable exposure across multiple business functions. Epiroc fosters continuous learning and career growth, providing a stimulating environment where your expertise can flourish and make a tangible impact on our products and services. It all starts with people. The world needs metals and minerals for the energy transition and our cities and infrastructure must be developed to serve a growing population. To succeed, we need to speed up the shift towards more sustainable mining and construction industries. We at Epiroc accelerate this transformation, together with customers and business partners in more than 150 countries, by developing and providing innovative and safe equipment, digital solutions, and aftermarket support. All new thinkers are welcome. We are looking for those who want to develop, grow, and dare to think new. In Epiroc we attract, develop, and retain diverse talent valuing authenticity and unique perspectives, driving our spirit of innovation. We foster an inclusive culture where diversity isn't just a goal but a part of our values and way of working. This is how we do business for a sustainable future. Learn more at www.epiroc.com