Senior AI Software Engineer

About This Role

Company Description

Open Innovation AI is a global technology company that specializes in developing advanced solutions for managing AI workloads. Its flagship product, the Open Innovation Cluster Manager (OICM), orchestrates complex AI tasks efficiently across diverse infrastructures. The platform is hardware agnostic, optimized for various GPUs and accelerators hardware, and facilitates seamless integration and scalability for enterprise AI applications. Open Innovation AI focuses on optimizing and simplifying AI workload management and making AI technologies accessible to organizations of all sizes. With its innovative solutions, companies can reduce operational costs, accelerate time to value, and maximize their return on investment, ensuring that their AI strategies contribute directly to enhanced business outcome.

Role Overview

We are looking for a skilled Senior AI Software Engineer who will design, implement and test features and MLOps/DevOps tools for data scientists with focus on Large Language Models.

We work at every stage of software lifecycle including design, implementation, testing, CI/CD, deployment and production support.

Responsibilities

• Design, develop, and maintain Python code
• Enhance and optimize AI workloads
• Troubleshoot and provide DEV support for client installations
• Continuously improve code quality, system design, and process
• Research improvements and advancements in the LLM sphere
• Participate in code reviews

Qualifications

• 5+ years experience in software development
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
• Proven experience in 2+ industrial projects in different languages (C++/Java/Go/C#/Python) domains / software stacks
• Strong knowledge of Python
• Good knowledge of ML Libraries (Pytorch, Tensorflow or equivalent) or inference libraries (VLLM, llama.cpp, …)
• Experience in Finetuning and/or Deploying LLMs
• Working knowledge of operating systems (Linux) and computer networks
• Solid understanding of object-oriented programming and design patterns
• Experience with cloud services (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes or OpenShift)
• Working knowledge of CI/CD configuration (Gitlab, Argocd, etc)
• Solid understanding of full software lifecycle
• Practical knowledge on metrics, logging and production support

Nice to Have

• Experience with distributed systems/computation
• Working with compute accelerators (GPUs, TPUs)