greenhouse
Senior Software Engineer, Platform - Data + AI (Back-End)
C3 AI
Redwood City, USA
Senior · 5+ years experience
Discovered 1 months ago
awsazurecassandracpluspluscsharpgcp
Key Skills for This Role
awsazurecassandracpluspluscsharpgcp
Full Job Posting
Responsibilities:
- Design and develop infrastructure and services to enable data pipelines for petabyte level scale and more.
- Design and develop abstractions over datastores such as Cassandra, PostgreSQL, Snowflake, etc.
- Design and develop file system abstractions over AWS S3, Azure Blobs, HDFS, etc.
- Design and develop connectors to various external data stores.
- Design and develop distributed system components for stream processing, queueing, batch processing, analytics engines, etc.
- Develop and maintain industry-leading, high-performance APIs for AL/ML applications.
- Develop and maintain features for distributed computations over large-scale data for ML workflows.
- Design and develop ML-specific data-systems such as feature stores and behavioral frameworks such as recommendation engines.
- Design and develop integrations with distributed computing technologies such as Apache Spark, Ray, etc. for data exploration and ML workload orchestration.
- Design and develop integrations with data analysis libraries such as Pandas, Koalas, etc.
- Develop and production AI/ML models for failure prediction, data schema inferencing, etc.
- Work on frameworks for performance, scalability, and reliability tracking over different components of a highly extensible AI/ML platform.
- Work with architects, product managers, and software engineers across teams in a highly collaborative environment.
- Participate and provide insights in technical discussions.
- Write clean code following a test-driven methodology.
- Deliver commitments promptly following agile software development methodology.
Qualifications:
- Bachelor of Science in Computer Science, Computer Engineering, or related fields.
- A minimum of 5 years of work experience in a fast-paced software company.
- Strong understanding of Computer Science fundamentals.
- High proficiency in coding with Java, C++, C#, or some other compiled language. Python would also be acceptable.
- Strong competency in object-oriented programming, data structures, algorithms, and software design patterns.
- Experience with version control systems such as Git.
- Experience with large-scale distributed systems.
- Experience with any public cloud platform (AWS, Azure, GCP).
- Some familiarity with distributed computing technologies (e.g., Hadoop, Spark, Kafka). Familiarity with managed versions of these technologies on public cloud platforms is also acceptable.
- Familiarity with technologies in the modern data science/analysis and engineering ecosystem (e.g., Pandas, Koalas).
- Good verbal and written technical communication ability to facilitate collaboration.
- Thrive in a fast-paced, dynamic environment and value end-to-end ownership of components.
- Intellectually curious and open to challenges.
- Preferred Qualifications:
- Advanced degree in engineering, sciences, or related field.
- Experience with Agile development methodology.
- Experience developing and working with REST and/or GraphQL APIs.
- Experience building scalable and reliable data pipelines.
- Experience with integration of data from multiple sources.
- Experience working with analytics and/or data processing engines.
- Experience developing distributed computation over large-scale data.
- Experience working with distributed computing frameworks (e.g., Hadoop, Spark, Kafka).
- Experience with data science/analysis libraries (e.g., Pandas, Koalas).
- Experience with task schedulers in distributed computing (e.g., Spark, Ray, Dask).
- Familiarity with machine learning workload orchestration in a distributed computing environment.
- Familiarity with workflow execution and/or optimization using DAGs, ideally for machine learning use-cases.
- Conceptual understanding of orchestration and resource provisioning systems (Kubernetes)
- C3 AI provides excellent benefits, a competitive compensation package and generous equity plan.
- C3 AI is proud to be an Equal Opportunity and Affirmative Action Employer. We do not discriminate on the basis of any legally protected characteristics, including disabled and veteran status.
About C3 AI
Technology
C3 AI (NYSE: AI) is an enterprise AI software company that provides a platform for developing and deploying large-scale AI applications across industries including energy, manufacturing, and defense.
Visit company websiteJobs and hiring trendsApply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at C3 AI
Front Desk Coordinator
Redwood City, USA
Discovered Yesterday
Forward Deployed Engineer - Federal, New Grad 2027
Tysons, USA
Discovered 5 days ago
Payroll Analyst
Redwood City, USA
Discovered 2 weeks agoFull-time
Director/Senior Director, Strategic Solutions - Energy
London, GBR
Discovered 2 weeks ago
Associate Site Reliability Engineer/Site Reliability Engineer
Redwood City, USA
Discovered 2 weeks ago
Senior Technical Writer
Redwood City, USA
Discovered 3 weeks ago
Technical Curriculum Developer
Redwood City, USA
Discovered 3 weeks ago
Communications Manager
Redwood City, USA
Discovered 3 weeks ago
