workable
Data Engineer
Ocean Infinity
London, GBR
Full-time
Mid · 2+ years experience
Hybrid
GBP 65000-65000 yearly / year
Discovered 2 weeks ago
PythonSQLAWSGCPAzureS3
Key Skills for This Role
PythonSQLAWSGCPAzureS3
Full Job Posting
What you will do! 🚀
- Develop and implement scalable data pipelines that automate manual data processes and improve reliability and efficiency across the organization.
- Build and maintain end-to-end data transformation workflows (Bronze → Silver → Gold), focusing on implementing business logic, data validation, and reusable transformation components.
- Develop robust Python-based data processing solutions, including scripts, services, and automation tools that support ingestion, transformation, and data delivery.
- Implement data integration pipelines across a variety of sources, including operational databases, external APIs, and event/streaming data, using both batch and near-real-time approaches.
- Develop and maintain data quality checks, validation rules, and testing frameworks to ensure accuracy, consistency, and reliability of data products.
- Build backend data services and lightweight APIs that expose curated datasets to analytics tools, reporting systems, and downstream applications.
- Collaborate closely with data analysts, product teams, and AI engineers to translate data requirements into efficient, production-ready implementations.
- Optimize and refactor existing pipelines and processes to improve performance, reliability, and maintainability, with a strong focus on code quality and automation.
- Follow and contribute to engineering best practices, including version control standards, modular pipeline design, CI/CD for data workflows, and documentation of implemented solutions.
- Participate in code reviews and pairing, learning from more experienced engineers and sharing implementation knowledge and reusable patterns with the team.
What we look for!🔍
- A degree in Computer Science, Mathematics, Engineering, or a related field, or equivalent practical experience.
- Minimum 2 years of experience as a Data Engineer, Backend Engineer, or Software Engineer working with data-intensive systems and data pipelines.
- Solid software engineering skills in Python, with experience writing reliable, maintainable data processing code and automation workflows.
- Good SQL skills, with an understanding of query optimization and working with analytical datasets.
- Experience building and maintaining data pipelines and transformation workflows, ideally in cloud-based environments.
- Hands-on experience with at least one cloud platform (e.g., AWS, GCP, or Azure), particularly for building and running data pipelines, storage systems, and compute workloads.
- Familiarity with data lake and lakehouse environments, including object storage systems (e.g., S3 or equivalent) and structured transformation layers (e.g., Bronze/Silver/Gold patterns).
- Understanding of unstructured and semi-structured data storage patterns (e.g., JSON, logs, event data, files in object storage) and how to process them efficiently.
- Experience with relational and/or NoSQL databases (e.g., Postgres, MongoDB, Redis), including schema design and indexing.
- Working knowledge of containerization technologies such as Docker.
- Good understanding of data modelling principles and how to structure datasets for analytics and downstream consumption.
- Exposure to distributed systems concepts and large-scale data processing patterns, with emphasis on practical implementation and debugging.
- Strong problem-solving skills with a focus on reliability, performance, and automation in production systems.
- Ability to collaborate effectively with analysts, product teams, and engineers, translating requirements into robust, testable implementations.
- Interest in improving and refactoring existing pipelines and workflows to increase reliability, maintainability, and automation.
- Comfortable working in modern engineering practices including Git-based workflows, code reviews, CI/CD pipelines, and automated testing for data systems.
- Exposure to workflow orchestration tools such as Airflow, Prefect, or similar, including scheduling, dependency management, retries, and observability.
Nice to have! ✨
- Experience working with telemetry, sensor, location, and operational technology (OT) data workloads.
- Experience processing and managing large-scale video, image, and unstructured media datasets, including streaming ingestion and analytics workflows.
- Understanding of feature engineering patterns and data preparation workflows supporting machine learning systems.
- Experience working with maritime, fleet, vessel operations, logistics, or industrial operational domains, including telematics, tracking, asset monitoring, or operational analytics use cases.
Benefits
- *Salary: London £65,000 / Porto up to 55,000 EUR Per Annum*
About Ocean Infinity
Scientific Research & Development1624 employeesFounded 2017
Private marine robotics company delivering robotic ocean operations and data services to governments, energy companies, and scientists.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Ocean Infinity
Maritime Operations Managers (Autonomous Systems)
Southampton, GBR
Discovered TodayFull-time
Remote Vessel Operators (USV)
Southampton, GBR
Discovered TodayFull-time
Network Systems Lead
Southampton, GBR
Discovered 4 days agoFull-time
Technical Project Manager
Southampton, GBR
Discovered 4 days agoFull-time
Expeditor
Southampton, GBR
Discovered 4 days agoFull-time
Software Engineers
Southampton, GBR
Discovered 4 days agoFull-time
Category Manager
Southampton, GBR
Discovered 4 days agoFull-time
Chief Engineer (Marine Defence Systems)
Southampton, GBR
Discovered 6 days agoFull-time