Senior Data Engineer
Job Fit Check
Base Career helps you apply smarter for this job.
Key skills for this role
About the Role
AIQ is seeking a Senior Data Engineer to build and maintain data infrastructure for AI solutions in the energy sector. You will design scalable data pipelines, manage data storage, and collaborate with data scientists and ML engineers.
Key Skills for This Role
Full Job Posting
About The Company
AIQ is an Abu Dhabi-based technology company that develops and deploys industrial artificial intelligence (AI) technologies at scale, focused on the energy sector. As a venture between Presight (G42) and ADNOC, AIQ has productized 15 AI-enabled solutions that support clients to perform better, protect teams and equipment, keep operations sustainable, and rapidly scale successes. The organization embraces an innovative and entrepreneurial spirit, looking to push boundaries and solve transformational challenges across industry. It welcomes professionals that share the desire to make meaningful and impactful contributions to the mission to deliver responsible AI to the heart of industrial processes. Always on the forefront of technology, AIQ provides its talent with an environment to thrive and excel. Working at AIQ includes participating in some of the most significant industrial transformation projects, interacting with massive data pools, utilizing sophisticated AI infrastructure that is powered by a NVIDIA GPU cloud computing platform, and access to abundant computing, storage, and network resources made available from across the G42 ecosystem.
About Aiq
AIQ is an Abu Dhabi based joint venture company between Presight and ADNOC, which focuses on developing artificial intelligence technologies.
AIQ develops and commercializes AI products and applications for energy world.
It aims in providing end-to-end solutions by using its data, cloud and talents to develop AI solutions that seek to reduce costs and generate revenue for its clients.
AIQ embodies an innovative and entrepreneurial spirit that embraces challenges to push boundaries and seeks to welcome professionals to its team that share the desire to make meaningful and impactful contributions to its mission.
Always on the cutting edge of technology, AIQ provides its talent all the opportunities to thrive and excel.
Working at AIQ includes dealing with massive data sets, an AI infrastructure that is powered by the latest NVIDIA GPU cloud computing platform and access to limitless computing, storage and network resources.
About The Role
As a Senior Data Engineer at AIQ, you will be responsible for building and maintaining the infrastructure that supports data collection, processing, and storage, workking closely with data scientists, analysts, and other stakeholders to ensure that data systems are reliable, scalable, and secure.
Your work will be crucial in enabling data-driven decision-making across the organization.
This is a key technical role focused on developing and optimizing the company's data infrastructure which involves designing and implementing data pipelines, ensuring data quality, and collaborating with cross-functional teams to support various data initiatives.
Responsibilities
- As a Senior Data Engineer, you will be responsible for developing and maintaining data systems to support the company’s strategic goals.
- Your role will encompass a range of activities focused on data pipeline development, data quality, and cross-functional collaboration.
- Data Pipeline Architecture and Development
- Design, construct, install, test, and maintain highly scalable data pipelines with a focus on machine learning models and analytics.
- Data Integration
- Work closely with data scientists, ML engineers, and stakeholders to ensure that data is accessible, consistent, and reliable for ongoing projects.
- API and Data Services
- Develop and maintain APIs for data access and manipulation, and integrate with external data services as needed.
- Data Storage
- Manage and optimize data storage solutions for both structured and unstructured data, where structured data includes relational databases and unstructured data includes Text Image Audio and Video, Search Engines like Elasticsearch and NoSQL databases, to support the requirements of machine learning models.
- Understand data engines and structure to effectively design solutions for transactional, analytics, and search purposes.
- Data Quality and Governance
- Implement processes to monitor data quality and ensure production data is always accurate and available for key stakeholders.
- Collaboration and Support
- Collaborate with ML engineers to assist in data-related technical issues and provide architectural guidance and solutions.
- Security and Compliance
- Ensure compliance with data security and privacy policies.
- Documentation
- Maintain clear and up-to-date documentation including data dictionaries, metadata, and architectural diagrams.
Skills And Attributes For Success
- Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field; or equivalent work experience.
- 7+ years of experience in a Data Engineering role.
- Programming languages like Python, Java, and Scala and managing huge scale data potentially Terabyte to Petabyte.
- Hands-on experience with big data technologies like Hadoop, Spark and Flink.
- Familiarity with machine learning frameworks such as TensorFlow, PyTorch, or similar.
- Strong understanding of data warehousing concepts, ETL processes, and data modeling.
- Experience with API development and integration with data services.
- Experience with cloud platforms like Azure.
- Knowledge in DevOps, CI/CD methods, and containerization technologies like Docker or Kubernetes.
- Experience with real-time / streaming data processing.
- Technical stack
- Programming Languages: Python, Java, Scala, SQL, Bash
• Big Data Technologies: Hadoop, Spark, Flink
- Unstructured Data: Text, Image, Audio & Video
- Databases: MySQL, PostgreSQL, MongoDB, Cassandra, HBase, Redis
What Working At Aiq Offers
Culture: Encouraging initiative, work in an environment that is fast-paced and varied, surrounded by talented peers from around the world, who are similarly attracted to applying their skills to solve transformational challenges.
Career: Join a team in which your contribution is recognized and rewarded, while you are supported to operate at your peak performance.
Rewards: An attractive renumeration package that includes healthcare, education support for dependents, leave benefits, and more.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at AIQ
Senior Developer - Full Stack
Abu Dhabi, UAE
About The Company AIQ is an Abu Dhabi-based technology company that develops and deploys industrial artificial intelligence (AI) technologies at scale, focused on the energy sector. As a venture between Presight (G42) an
Product Manager (Subsurface Domain)
Abu Dhabi, UAE
AIQ is an Abu Dhabi-based technology company that develops and deploys industrial artificial intelligence (AI) technologies at scale, focused on the energy sector. As a venture between Presight (G42) and ADNOC, AIQ has p
Product Manager (Subsurface Domain)
Abu Dhabi, UAE
AIQ is an Abu Dhabi-based technology company that develops and deploys industrial artificial intelligence (AI) technologies at scale, focused on the energy sector. As a venture between Presight (G42) and ADNOC, AIQ has p
Accounting Specialist
Abu Dhabi, UAE
AIQ is an Abu Dhabi-based technology company that develops and deploys industrial artificial intelligence (AI) technologies at scale, focused on the energy sector. As a venture between Presight (G42) and ADNOC, AIQ has p
Product Manager (Drilling Domain)
Abu Dhabi, UAE
AIQ is an Abu Dhabi-based technology company that develops and deploys industrial artificial intelligence (AI) technologies at scale, focused on the energy sector. As a venture between Presight (G42) and ADNOC, AIQ has p
Manager - Technical Project
Abu Dhabi, UAE
AIQ is an Abu Dhabi-based technology company that develops and deploys industrial artificial intelligence (AI) technologies at scale, focused on the energy sector. As a venture between Presight (G42) and ADNOC, AIQ has p
Senior Solution Architect
Abu Dhabi, UAE
AIQ is an Abu Dhabi-based technology company that develops and deploys industrial artificial intelligence (AI) technologies at scale, focused on the energy sector. As a venture between Presight (G42) and ADNOC, AIQ has p
Senior Developer - Full Stack
Abu Dhabi, UAE
Product Manager (Subsurface Domain)
Abu Dhabi, UAE
Product Manager (Subsurface Domain)
Abu Dhabi, UAE
Accounting Specialist
Abu Dhabi, UAE
Product Manager (Drilling Domain)
Abu Dhabi, UAE
Manager - Technical Project
Abu Dhabi, UAE
Senior Solution Architect
Abu Dhabi, UAE