Emergency Medicine Physician (AI Clinical Evaluation)

Location: United States Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs. Role Overview We are looking for an experienced Emergency Medicine Physician to contribute to an AI training and evaluation project focused on high-fidelity clinical reasoning, emergency decision-making, longitudinal chart review, and patient safety. The role involves creating and reviewing complex emergency-medicine scenarios, clinical tasks, long-chart cases, gold-standard answers, and evaluation rubrics . You will assess whether outputs reflect sound emergency medicine judgment, appropriate prioritization, safe disposition, accurate documentation, and evidence-aligned clinical decisions. CONTRACT: Contractor assignment, 12 weeks COMMITMENT: Part-time or Full-time (20-40h/week) LOCATIONS: Remote - USA PROCESS: The selection will be made based on an online questionnaire and resume/education/certification NOTES: Candidates must be fully licensed and actively practicing medicine in the US. Key Responsibilities Develop high-difficulty Emergency Medicine clinical cases and benchmark tasks . Create realistic scenarios involving triage, stabilization, diagnostics, treatment, disposition, and handoffs. Review fragmented or longitudinal medical records and identify important trends, contradictions, omissions, and safety risks. Evaluate AI-generated clinical outputs for accuracy, patient safety, practical applicability, and quality of reasoning . Produce gold-standard answers and clinically defensible reference solutions. Apply structured rubrics to score medical reasoning, terminology, documentation, and safety. Review emergency decision-making involving differential diagnosis, escalation, treatment priorities, and discharge/admission decisions. Evaluate transitions of care and EMS / paramedic handoffs where relevant. Incorporate calibration feedback and refine tasks through iterative review cycles. Support quality calibration and review of other contributors' work where appropriate. Requirements MD or DO with active US medical license. Board certification or board eligibility in Emergency Medicine . Approximately 8+ years of professional Emergency Medicine experience . Current or recent clinical practice within the last 3 years. Strong experience with emergency assessment, stabilization, diagnosis, treatment, and disposition. Strong clinical reasoning and ability to synthesize complex or fragmented medical records. Experience reviewing clinical documentation and identifying missing, unsafe, or inconsistent actions. Strong written communication and ability to produce clear, clinically defensible reasoning.