Pyspark Data Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
Expert in Data Architecture and Strategy, transforming Data Warehousing to Big Data, with skills in Python, SQL, and cloud platforms.
Key Skills for This Role
Full Job Posting
Overview
Expertise in Data Architecture, Data Strategy and Roadmap for large and complex organization and systems and implemented large scale end-to-end Data Management & Analytics solutions Experience in transforming traditional Data Warehousing approaches to Big Data based approaches and proven track record of managing risks and data security Expertise with DW Dimensional modeling techniques, Star & Snowflake schemas, modeling slowly changing dimensions and role playing dimensions, dimensional hierarchies, and data classification Experiences in cloud native principals, designs and deployments. Extensive experience working with and enhancing Continuous Integration (CI) and Continuous Development (CD) environments Expertise in Data Quality, Data Profiling, Data Governance, Data Security, Metadata Management, and Data Archival Define workload migration strategies using appropriate tools Drive delivery in a matrixed environment working with various internal IT partners Demonstrated ability to work in a fast paced and changing environment with short deadlines, interruptions, and multiple tasks/projects occurring simultaneously Must be able to work independently and have skills in planning, strategy, estimation, scheduling, Strong problem solving, influencing, communication, and presentation skills, self-starter Experience with data processing frameworks and platforms (Hadoop, Presto, Tez, Hive, Spark etc.) Hands on experience in work with bigdata platforms and related programming languages (e.g. Linux, Python, PySpark, GIT, Jenkins).
Apply for this postion
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Virtusa Middle East FZ-LLC
Product Owner
, UAE
Oversee branch service development, prioritize product backlog, enhance user experience, and adapt to market trends with strong analytical skills.
Product Owner
, UAE
Seeking a passionate individual with strong analytical skills for stakeholder management, product backlog management, and agile methodologies in mobile banking.
Automation Testing (Arabic)
Dubai, UAE
Seeking a skilled QA Automation Engineer to design automated test suites, develop frameworks, and enhance testing strategies with Java or JavaScript expertise.
NodeJS Testing
Dubai, UAE
Design and maintain advanced Playwright automation for end-to-end testing, develop full stack features, and integrate AI-driven testing in CI/CD pipelines.
Technical Delivery Lead
, UAE
Responsible for digital delivery execution, dependency management, and technical risk mitigation, requiring strong experience in mobile app and API delivery.
Product Manager
, UAE
Assist in product strategy and development, provide technical support, and enhance user experience while leading cross-functional teams and analyzing data.
Data Governance
, UAE
Translate business data requirements into technical specifications, oversee data governance tools, and validate data quality in banking and financial services.
Program Delivery Lead
, UAE
Establish governance and delivery assurance, manage financials, drive accountability, and ensure agile execution in complex programme delivery.
