Senior Data Engineer

Role overview

Responsibilities

• Design and develop Snowflake data warehouses for integration, migration, and pipeline enhancement projects.
• Develop SQL, Snowflake stored procedures, and Python scripts for ETL and ELT workloads.
• Build and maintain pipelines supporting reporting, analytics, and application data needs.
• Create and maintain Snowflake tables, views, streams, tasks, file formats, and external stages.
• Collaborate with engineers, analysts, business users, and product owners on technical requirements.
• Write technical designs and document deployment, handover, monitoring, and operational procedures.
• Develop or review automated unit testing for SQL scripts, procedures, and data pipelines.
• Support real-time and batch architectures for AI analytics, recommendations, forecasting, and automation.
• Optimise cloud data platforms using lakehouse architectures, semantic layers, and high-performance retrieval patterns.
• Mentor junior developers and data engineers when required.

Knowledge and experience

• At least 5 years of professional experience in data engineering or database development.
• Strong hands-on experience with complex SQL queries, stored procedures, database functions, views, and schema design.
• Experience using Snowflake Streams, Tasks, Time Travel, and Cloning.
• Proficiency in database performance tuning, including clustering, warehouse sizing, and caching.
• Experience configuring external stages for AWS S3, Azure Blob, or similar cloud storage.
• Experience writing Python or Shell scripts for data processing.
• Expert knowledge of Snowflake and proficiency with Git.
• Experience working in Agile/Scrum software development lifecycle environments.
• A bachelor's degree in computer science, engineering, or a related field, or equivalent experience.
• Tidal experience is an added advantage.

Professional capabilities

• Strong analytical, decision-making, and problem-solving skills.
• Ability to multitask in a fast-paced environment while maintaining timeliness and documentation.
• Strong verbal and written communication skills for technical and non-technical audiences.

Additional expectations