paylocity

Senior Software Engineer, Applied AI

Post Acute Analytics

Remote, USA

Full-time

Senior · 6+ years experience

Remote

Discovered 1 months ago

Apply

Full Job Posting

What You Will Do

Own a production clinical AI model end to end: iteration, releases, accuracy, and production incident response.
Collaborate with other engineers and clinical team members to design and maintain the evaluation systems that prove model correctness.
Partner directly with our clinical team on model audits and requirements, translating clinical rules into system behavior and explaining model output to clinical and product stakeholders.
Evaluate and integrate new foundation models, including open-weight alternatives, balancing accuracy against latency and cost.
Act as the internal escalation point when a client or clinician reports issues or has questions about a model.
Maintain the runtime inference infrastructure in partnership with other engineers.
Collaborate within an Agile team, engaging in sprint planning, daily standups, backlog refinement, code review, and design discussions. Partner with Product, DevOps, InfoSec, and other engineering teams to align development efforts with business goals.

Technical Experience

6 or more years of professional software engineering experience.

Strong Python skills building and maintaining production services and pipelines.

Demonstrated experience designing evaluations for AI systems.

Practical depth in prompt and context engineering.

Experience with Docker and Kubernetes.

Experience with PostgreSQL or similar relational databases.

Experience with event-driven architecture patterns (Kafka or similar).

Requirements

Nice To Have

Experience with agentic AI patterns and coding tools.

Experience with AWS and AWS Bedrock.

Node.js, TypeScript, React experience.

LLM fine-tuning experience.

Advanced statistics, NLP, feature engineering, and/or classical machine learning.

Professional Skills

Strong collaboration skills with a team-oriented mindset.
Demonstrated interest / experience in the health care industry.
Excellent communication, including the ability to explain model behavior and its limitations to non-technical clinical and product stakeholders.
Comfort with ambiguity.
Ownership mindset with a track record of being accountable for a system in production rather than delivering tickets.
Passion for best practices and continuous improvement in software engineering and applied AI.

What We Provide

Competitive compensation commensurate with experience.

401K.

Health, dental, and disability insurance.

Flexible, results-oriented work schedule and time off.

Platform for rapid career growth.

PAA is based out of Dallas, TX and this role will be performed remotely. This role will require 0-5% travel

for internal meetings or client interactions.

Apply for this job in 1 click

Skip the repetitive application forms

Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.

Trusted by over 500,000 job seekers on Base Career

Start Free Today