Principal Snowflake Data Engineer - Contract (Manchester)

About Insight Investment

Qualifications

• Required
• Snowflake (Warehouses, Tasks/Streams, Snowpipe, Snowpark, Distributed UDF/Sproc, Time Travel, Cloning)
• Demonstratable experience of delivering end to end pipelines in Snowpark (transferable frameworks such as Pyspark, Polars or Dask are also welcome).
• DBT including Jinja templating or equivalent transformation frameworks
• Python including build tools, test automation frameworks and engineering best practices
• SQL (including Snowflake-optimised SQL)
• Experience with CI/CD pipelines (GitHub Actions / TeamCity / Artifactory).
• Demonstrate initiative and independence to solve problems.
• Be able to communicate abstract or complex ideas or solutions effectively.
• Stand by software engineering principles around quality and doing things the right way.
• Experience working in and with Agile teams performing iterative development.
• Ability to collaborate with end users, stakeholders, teams, and team members.
• Have a constant desire to improve knowledge and drive adoption of new tech or approaches within the teams.
• Own mistakes and work with your colleagues to redress them, learn from them and make improvements for the long-term.
• Docker
• Java / Scala
• Event streaming technologies such as Kafka, Pulsar, or Azure Event Hub
• Integration with Collibra
• Apache Iceberg
• Apache Arrow
• Pyspark
• AI engineering (Snowflake AI, Langchain, Llamaindex, Pinecone, etc)
• Insight is committed to being an inclusive employer and encourages applications from all suitably qualified applicants irrespective of background, circumstances, age, disability, gender identity, ethnicity, religion or belief, sexual orientation or other factors protected by federal, state and/or local laws. If you are a candidate with a disability, or are assisting a candidate with a disability, and require an accommodation to apply for one of our jobs, please email us at [email protected]