Clinical AI Evaluator - Physician
About the role
Location: Flexible / Remote Timeframe: PT contractor Apply: [email protected]
About Us
Altitude is the partner for clinical performance — uplifting how clinicians learn, practice, and grow so they can thrive in a new era of care where technology strengthens human judgment and delivers safer, more humane outcomes. Our platform combines performance insights, adaptive guidance, and extension of customer capacity. By operating at the level of clinicians and clinician practice, we help organizations improve quality and economics — and ensure patients receive safer, more consistent, and more compassionate care.
Our Team
We’re a team of experienced clinical leaders and operators with deep experience in healthcare delivery and technology
- Prabhjot Singh, MD, PhD (Co-founder, former Chief Medical Officer of CHW Cares, Senior Advisor at the Peterson Health Technology Institute)
- Abhishek Gupta (Co-founder, previously NY Market Lead at Oak Street Health, early team at Zus Health, investor at MVP Ventures)
- Brett Ives, NP, DrPH (Chief Clinical Officer, former VP of Care Product at Diverge Health, VP of Care Product at CHW Cares, Mount Sinai Health System)
- Margaret McKenna (Tech advisor, former CTO at Devoted Health) We are supported by top-tier VCs in healthcare and AI, including Lerer Hippeau, AlleyCorp, Tau Ventures, Chrysalis, MVP Ventures and Sequel, along with notable angels such as Aaron Patzer (Co-founder Vital.io, founder of Mint.com), Ankit Jain (CEO Infinitus, founder of Gradient Ventures), Jordan Schlain (Founder of Private Medical, America's top concierge medicine service), Kavita Patel (Venture Partner at NEA and former Obama senior policy advisor), Ashwin Vasan (former NYC Health Commissioner), Duncan Greenburg (former SVP Product at Oscar Health), Prabhdeep Singh (former Chief Growth Officer at Clover Health), and Saharsh Patel (CEO Noble, former COO Canvas Medical).
About the Role
The Physician Evaluator partners with clinical leadership to evaluate clinical AI outputs, and includes refining care pathways, and evolving the organization’s clinical guidelines. This is a part-time, flexible role. Reporting to the Director of Clinical Performance (DCP) and Chief Clinical Officer (CCO), you will play a pivotal role in driving client success and guiding Altitude’s future direction.
What You’ll Do
- Input on clinical guidelines and logic for existing and new builds, with attention to clinical guideline updates, quality, and safety
- Audit and label key data sets for R&D, new customer implementations, and existing customers, following Altitude’s methodology and failure mode ontology.
- Partner with the clinical performance team to continuously improve logic rules and validation criteria.
- Carry out feedback loops through regular case review and quality audits
- Timely review and response to sampled clinical escalations from the clinical AI judge and clinical team.
- Stay current with primary care and specialty-specific guidelines (e.g., AAFP, ADA, AHA/ACC, USPSTF) and changes to payor / organization specific measures and incorporate these updates into Altitude clinical guidelines and logic with Director of Clinical Performance (DCP) and CCO.
- Serve as a clinical resource across the company, and particularly to clinical team members.
What We’re Looking For
- Required qualifications
- Key qualities
Why Altitude?
- Tackle a once-in-a-generation shift: Play a key role in supporting clinicians as they take on a larger share of care delivery.
- Drive measurable impact: Strengthen clinician confidence, improve organizational performance, and deliver safer care for patients.
- Help shape the standard: Help define how clinical performance is measured and developed across the U.S. healthcare system.
- Collaborate with an experienced team: Work shoulder-to-shoulder with leaders from healthcare and technology, supported by top-tier investors in AI and health.
- Grow with us: Join early and help shape both Altitude’s trajectory and your own role within it.
Interested?
We’d love to hear from you. Email us at [email protected] with your resume and a brief note about your interest in Altitude.
- MD with active or eligible U.S.-based licensure
- Board certification in Family Medicine or Internal Medicine
- Active or recent clinical practice (within past 5 years)
- Tech forward, experience with clinical AI to maximize quality and productivity
- Comfort with analyzing and interpreting quantitative data
- Informatics certification or training a plus
- Familiarity with clinical AI governance, monitoring, and safety evaluation a plus
- Clinician builder mindset
- Technically oriented problem solving orientation
- High clinical rigor
- Durable judgment in complex, ambiguous environments
- Shared leadership with clear clinical accountability
- Track record of ownership, bias toward action, and independent decision-making
About Altitude
Altitude is building the clinical AI execution platform for risk-bearing care organizations. We help care teams Perform — getting every primary care clinician to specialist-level decisions in the room, and executing the operational follow-through that gets chronic patients to goal faster. Where organizations need more capacity, we Extend it — delivering care directly through our medical group, under their brand and rules, to the patients they can't reach.
Underneath both is a network of agents, working the same longitudinal patient context graph from both sides of the visit. On the clinician side, condition-specific subagents continuously read the chart, extract clinical signal, and generate structured recommendations through our in-EHR conversational agent. On the patient side, agents reach out directly, gather updates, and triage concerns. The two sides hand off to each other in real time: a patient agent escalates the moment something needs judgment, a clinician agent (or a human) picks up with full context, and control passes back once the visit's follow-through is handled.
Other roles at Altitude
Refer someone
Know someone great for this role?
Share your link. If they get hired through Standout, you get $3,000.
Job details
Funding
Total raised
$12.3M
Last stage
Seed
Investors
Founders
Prabhjot Singh
Co-Founder & CEO
What happens next.
No applications, no recruiter spam. Just the intro.
Confirm the fit
A few questions to make sure this role is the right shape for you. Two minutes.
I pitch you to the company
I write the intro, send it to the founder, and handle the back-and-forth.
A meeting lands on your calendar
If they’re a yes, I book the chat. You show up — that’s the whole job-hunt.
