{bc}
Apply
greenhouse

Cloud Compute Engineer

Castelion Corporation
Allen, USA
Mid
Onsite
Discovered 5 days ago
azurekubernetespythonpytorch

Full Job Posting

Responsibilities

  • Build a shared compute platform: Develop and operate distributed compute infrastructure supporting batch processing, custom jobs, simulation, calibration, preprocessing, and ML training.
  • Automate data processing: Build event-driven workflows that automatically process newly ingested data, including flight-test and chamber calibration data.
  • Scale compute-intensive workloads: Enable scalable ML training, Foxglove RDL preprocessing, data preparation, replay, and other user-submitted jobs.
  • Integrate compute with CI/CD: Enable simulation and regression tests to run automatically in CI/CD pipelines, expanding test coverage beyond standard runner limitations.
  • Optimize performance and cost: Profile and improve Python workloads, data flows, memory usage, concurrency, and resource utilization—not just the underlying infrastructure.
  • Improve the developer experience: Provide simple interfaces, APIs, or SDKs for engineers to submit, monitor, debug, and rerun jobs without managing infrastructure manually.
  • Ensure reliability and observability: Implement logging, metrics, alerting, job traceability, and cost monitoring to make failures easy to diagnose and recover from.
  • Enable reproducible workflows: Track code versions, inputs, configurations, and outputs so compute jobs can be reliably reproduced and audited.
  • Support large-scale data movement: Design efficient approaches to storage, data transfer, caching, partitioning, and preprocessing.
  • Drive adoption across teams: Work directly with engineers to understand their workflows and establish consistent compute patterns across unclassified and classified networks.

Basic Qualifications

  • Experience building and operating distributed compute platforms used by multiple engineering teams.
  • Strong Python skills, including profiling, concurrency, memory management, and performance optimization.
  • Production experience with Ray and Kubernetes.
  • Experience designing batch-processing, event-driven, and user-submitted job systems.
  • Experience with Azure compute, storage, networking, identity, and monitoring services.
  • Demonstrated ability to optimize application code and data pipelines for performance, reliability, and cost.
  • Experience implementing observability, automated job recovery, and reproducible processing workflows.
  • Ability to build simple developer interfaces and work directly with users to automate complex workflows.

Preferred Skills and Experience

  • Strong PyTorch experience, including distributed training, data loading, checkpointing, and GPU utilization.
  • Experience scaling ML training across large datasets and distributed compute resources.
  • Experience integrating simulation and regression workloads into CI/CD pipelines.
  • Familiarity with large-scale engineering datasets, flight-test data, calibration, or scientific computing workflows.
  • Experience building compute platforms that support both classified and unclassified environments.
  • Experience improving processing throughput and turnaround time through workload optimization and infrastructure scaling.
  • Castelion offers a generous benefits package. Please refer to the bottom of our Careers page for more details.
  • Other Duties
  • Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities and activities may change at any time with or without notice.
  • Additional Eligibility Requirements
  • This position may require access to classified information or restricted U.S. Government sites, systems, or information, as determined by the Company and/or applicable U.S. Government requirements. If the position is so designated, your employment in the role may be contingent upon your ability to obtain and maintain the required U.S. Government security clearance or other government authorization, and to satisfy any citizenship or other eligibility requirements imposed by applicable law, regulation, executive order, or government contract requirements. You will be notified if and when such requirements apply.
  • Affirmative Action/EEO Statement
  • Castelion is an Equal Opportunity Employer. We are committed to providing equal employment opportunities to all applicants and employees without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, genetic information, protected veteran status, or any other characteristic protected by applicable federal, state, or local law.
  • Castelion is committed to providing reasonable accommodations to qualified individuals with disabilities throughout the application and hiring process. If you require a reasonable accommodation to complete an application, participate in the interview process, or otherwise participate in the hiring process, please contact [email protected]. Requests for accommodation will be considered on an individual basis and handled in accordance with applicable law.
  • Castelion is committed to fostering a workplace where employment decisions are based on qualifications, business needs, and the ability to perform the essential functions of the role, with or without reasonable accommodation.
  • EAR/ITAR Requirements
  • This position requires access to export-controlled information, and as such, employment (or hiring of a contractor) is contingent upon the candidate’s ability to access all applicable export-controlled information without additional export licensing being required by the Bureau of Industry and Security and/or the Directorate of Defense Trade Controls.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Sarah M.James T.Maya R.

Trusted by over 500,000 job seekers on Base Career

Start Free Today

More from this employer

More jobs at Castelion Corporation

Director, International Business Development

Washington, USA

Discovered Yesterday

Facilities Technician

Midland, USA

Discovered YesterdayFull-time

Facilities Maintenance Technician

Rio Rancho, USA

Discovered Yesterday

Facilities Construction Project Manager

Rio Rancho, USA

Discovered 5 days ago

Lead Facilities Technician

Midland, USA

Discovered 5 days agoFull-time

Senior GNC Engineer

Rio Rancho, USA

Discovered 5 days ago

Senior Web Developer

Allen, USA

Discovered 5 days ago

Database/Python Generalist

Allen, USA

Discovered 5 days ago