{bc}
workable

Senior Fabric Engineer

Methods
London, GBR
Full-time
Senior
Onsite
Discovered 1 weeks ago
azureazure-data-factorydatabricksicebergkafkapower-bi

Full Job Posting

Requirements

  • You Will Demonstrate:
  • Proficiency in SQL and Python: You are highly proficient in SQL and Python, enabling you to handle complex data problems with ease.
  • Understanding of Data Lakehouse Architecture: You have a strong grasp of the principles and implementation of Data Lakehouse architecture.
  • Hands-On Experience with Spark-Based Solutions: You possess experience with Spark-based platforms like Azure Synapse, Databricks, Microsoft Fabric, or even on-premise Spark clusters, using PySpark or Spark SQL to manage and process large datasets.
  • Expertise in Building ETL and ELT Pipelines: You are skilled in building robust ETL and ELT pipelines, mostly in Azure, utilising Azure Data Factory and Spark-based solutions to ensure efficient data flow and transformation.
  • Efficiency in Query Writing: You can craft and optimise queries to be both cost-effective and high-performing, ensuring fast and reliable data retrieval.
  • Experience in Power BI Dashboard Development: You possess experience in creating insightful and interactive Power BI dashboards that drive business decisions.
  • Proficiency in Dimensional Modelling: You are adept at applying dimensional modelling techniques, creating efficient and effective data models tailored to business needs.
  • CI/CD Mindset: You naturally work within Continuous Integration and Continuous Deployment (CI/CD) environments, ensuring automated builds, deployments, and unit testing are integral parts of your development workflow.
  • Business Requirements Translation: You have a knack for understanding business requirements and translating them into precise technical specifications that guide data solutions.
  • Strong Communication Skills: Ability to effectively translate complex technical topics into clear, accessible language for non-technical audiences
  • Continuous Learning and Development: Commitment to continuous learning and professional development, staying up to date with the latest industry trends, tools, and technologies.
  • You may also have some of the desirable skills and experience:
  • Exposure to Microsoft Fabric: Familiarity with Microsoft Fabric and its capabilities would be a significant advantage.
  • Experience with High-Performance Data Systems: Handling large-scale data systems with high performance and low latency, such as managing 1 billion+ records or terabyte-sized databases.
  • Knowledge of Delta Tables or Apache Iceberg: Understanding and experience with Delta Tables or Apache Iceberg for managing large-scale data lakes efficiently.
  • Knowledge of Data Governance Tools: Experience with data governance tools like Azure Purview, Unity Catalog, or Apache Atlas to ensure data integrity and compliance.
  • Exposure to Streaming/Event-Based Technologies: Experience with technologies such as Kafka, Azure Event Hub, and Spark Streaming for real-time data processing and event-driven architectures.
  • Understanding of SOLID Principles: Familiarity with the SOLID principles of object-oriented programming.
  • Understanding of Agile Development Methodologies: Familiarity with iterative and agile development methodologies such as SCRUM, contributing to a flexible and responsive development environment.
  • Familiarity with Recent Innovations: Knowledge of recent innovations such as GenAI, RAG, and Microsoft Copilot, as well as certifications with leading cloud providers and in areas of data science, AI, and ML.
  • Experience with Data for Data Science/AI/ML: Experience working with data tailored for data science, AI, and ML applications,
  • Experience with Public Sector Clients: Experience working with public sector clients and understanding their specific needs and requirements
  • This role will require you to have or be willing to go through Security Clearance. As part of the onboarding process candidates will be asked to complete a Baseline Personnel Security Standard; details of the evidence required to apply may be found on the government website Gov.UK. If you are unable to meet this and any associated criteria, then your employment may be delayed, or rejected. Details of this will be discussed with you at interview

Benefits

  • Working at MA
  • Methods Analytics (MA) exists to improve society by helping people make better decisions with data. Combining passionate people, sector-specific insight, and technical excellence to provide our customers an end-to-end data service.
  • We use a collaborative, creative and user centric approach to data to do good and solve difficult problems. Ensuring that our outputs are transparent, robust, and transformative. We value discussion and debate as part of our approach. We will question assumptions, ambition, and process – but do so with respect and humility. We relish difficult problems, and overcome them with innovation, creativity, and technical freedom to help us design optimum solutions. Ethics, privacy, and quality are at the heart of our work, and we will not sacrifice these for outcomes. We treat data with respect and use it only for the right purpose. Our people are positive, dedicated, and relentless. Data is a vast topic, but we strive for interactions that are engaging, informative and fun in equal measure. But maintain a steely focus on outcomes and delivering quality products for our customers.
  • We are passionate about our people; we want out colleagues to develop the things they are good at and enjoy.
  • By joining us you can expect
  • Autonomy to develop and grow your skills and experience
  • Be part of exciting project work that is making a difference in society
  • Strong, inspiring, and thought-provoking leadership
  • A supportive and collaborative environment
  • As well as this, we offer:
  • Development access to LinkedIn Learning, a management development programme and training
  • Wellness 24/7 Confidential employee assistance programme
  • Social - office parties, pizza Friday and commitment to charitable causes
  • Time off - 25 days of annual leave a year, plus bank holidays, with the option to buy 5 extra days each year
  • Volunteering - 2 paid days per year to volunteer in our local communities or within a charity organisation
  • Pension Salary Exchange Scheme with 4% employer contribution and 5% employee contribution
  • Life Assurance of 4 times base salary
  • Private Medical Insurance which is non-contributory (spouse and dependants included)
  • Worldwide Travel Insurance which is non-contributory (spouse and dependants included)

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Methods