Senior Data Engineering

Responsibilities

• Maintain/develop data pipelines required for the extraction, transformation, cleaning, pre-processing, aggregation and loading of data from a wide variety of data sources into Snowflake or Hive warehouses using Python, SQL, DBT, other data technologies
• Design, implement, test and maintain data pipelines/ new features based on stakeholders’ requirements
• Develop/maintain scalable, available, quality assured analytical building blocks/datasets by close coordination with data analysts
• Optimize/ maintain workflows/ scripts on present data warehouses and present ETL
• Design / develop / maintain components of data processing frameworks
• Basic Knowledge of using LLMs and using AI tools like Co-pilot for development purposes
• Build and maintain data quality and durability tracking mechanisms in order to provide visibility into and address inevitable disruptions in data ingestion, processing, and storage
• Translate deeply technical designs into business appropriate representations as well as analyze business needs and requirements ensuring implementation of data services directly correlates to the strategy and growth of the business
• Focus on automation use cases, CI/CD approaches and self-service modules relevant for data domains
• Address questions and concerns from downstream data consumers through appropriate channels
• Create data tools for analytics and BI teams that assist them in building and optimizing our product into an innovative industry leader
• Stay up to date with data engineering best practices, patterns, evaluate and analyze new technologies, capabilities, open-source software in context of our data strategy to ensure we are adapting, extending, or replacing our own core technologies to stay ahead of the industry
• Contribute to Analytics engineering process
• Minimum Qualifications
• Bachelor's degree in computer science, information systems, or a related discipline
• 5+ years in the Data Engineer role
• Built processes supporting data transformation, data structures, metadata, dependency, data quality, and workload management
• Working experience with Snowflake, Hands-on experience with Snowflake utilities, Snow SQL, Snow Pipe. Must have worked on Snowflake Cost optimization scenarios
• Overall solid programming skills, able to write modular, maintainable code, preferably Python & SQL
• Have experience with workflow management solutions like Airflow
• Have experience on Data transformation tools like DBT
• Basic understanding of how to use LLMs for data engineering purposes and tools like GitHub, Copilot, etc.
• Experience working with Git
• Experience working with big data stack environment, like, Hive, Spark and Presto
• Strong analytical, problem solving and interpersonal skills
• Familiar with Scrum
• Ready to work flexible European hours
• Preferred Qualifications
• Snowflake
• DBT
• Airflow
• CI/CD (Jenkins)
• Basic understanding of Power BI
• AWS environment, for example S3, Lambda, Glue, Cloud watch
• Experience working with remote teams spread across multiple time-zones
• Strong organizational skills and attention to detail
• Have a hunger to learn and the ability to operate in a self-guided manner
• Learn More
• About Autodesk
• Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.
• We take great pride in our culture here at Autodesk – it’s at the core of everything we do. Our culture guides the way we work and treat each other, informs how we connect with customers and partners, and defines how we show up in the world.
• When you’re an Autodesker, you can do meaningful work that helps build a better world designed and made for all. Ready to shape the world and your future? Join us!
• Salary transparency
• Belonging We take pride in cultivating a culture of belonging where everyone can thrive. Learn more here: https://www.autodesk.com/company/global-belonging
• In-Person Onboarding and Identity Verification
• This role may require in-person onboarding and/or in-person ID verification.