Job Req ID:  109804

Senior Machine Learning Operations Engineer

IT@JH Technology Innovation Center (TIC) is seeking a Senior Machine Learning Operations Engineer who will be primarily responsible for managing and documenting pipelines to deploy AI/ML algorithms into production. In select cases, the Engineer will work on the algorithms directly, by measuring performance, refining, and optimizing them. The Engineer may also need to provide a limited amount of customer support to researchers preparing their own algorithms for deployment.

The Johns Hopkins Precision Medicine initiative is building an environment to deploy new operational and healthcare interventions. We are doing this at scale and across a broad range of disciplines, with interventions designed by researchers, clinicians, and operational staff.

Job Scope/Complexity

  • The Senior Machine Learning Operations Engineer will be part of the Johns Hopkins Medicine Technology Innovation Center and will work full-time with the Precision Medicine team (as well as clients, data stewards, project/program managers, and other IT teams). This position will be a critical member of the Precision Medicine initiative’s data science team, helping to translate new science into improved operations and clinical practice across a range of health conditions.

Specific Duties & Responsibilities

  • Develops, deploys, and maintains machine learning models and systems.
  • Collaborates with data scientists, software engineers, and other stakeholders to develop, test, and improve machine learning models.
  • Designs and implements infrastructure and data preparation processes to support machine learning development and deployment.
  • Monitors and optimizes machine learning performance, including model accuracy, efficiency, and scalability.
  • Develops and maintains machine learning pipelines, including data ingestion, preprocessing, feature engineering, model training, and deployment.
  • Builds monitoring and altering systems for pipeline metrics and model results.
  • Identifies and resolves issues related to machine learning model performance and data quality.
  • Develops and maintains documentation for machine learning systems and processes.
  • Provides customer support to data scientists who use the processes and tools described above.

Scale/Size of Area, Project and/or System Supported

  • Precision Medicine Analytics Platform

                    o Developing pipelines and deploying algorithms within the hospital administration and

                       operations segment of the Platform, including regulatory and hospital finance.

  • Precision Medicine Delivery Platform

                    o Developing pipelines and deploying algorithms into clinical workflows.

Special Knowledge, Skills, & Abilities

  • Experience with machine learning frameworks such as TensorFlow, PyTorch, or Scikit-learn.
  • Microsoft Azure and/or Amazon Web Services cloud management and administration including environment provisioning, configuration, performance monitoring and security.
  • Experience with containers and container orchestration using Kubernetes (Docker, Helm, kubectl, linkerd).
  • Experience with data engineering tools and languages such as Apache Spark, Python, Java, and Scala.
  • Proven track record of delivering AI/ML deployments and cloud-native applications using Infrastructure-as-Code (IaC) and GitOps technologies (e.g., Terraform, ARM templates, Bicep).
  • Excellent problem-solving and analytical skills.
  • Strong written and verbal communication skills.
  • Ability to work independently and in a team environment.

Work Location:

  • Remote or Hybrid, East Baltimore

About the Team

The Precision Medicine Initiative is a strategic priority for the Johns Hopkins University and School of Medicine. We are combining data from around the institution, to make it possible for researchers from medicine, operations, and health economics to discover potential new healthcare interventions. We also help them build a path for implementation of these interventions. We are doing this at scale and across a broad range of disciplines.

The TIC is uniquely positioned within Johns Hopkins to help design, build, and deploy novel enterprise, departmental, and clinical applications that strive to improve workflow, outcomes, and patient care. Our applications focus on turning data and algorithms into useful visualization tools, improving workflows such as patient hand-off, rounding, and cross-team collaboration, and helping patients with medication adherence, data gathering, and overall clinical education. Our team frequently works with data from multiple sources including our Enterprise EMR (Epic), researcher curated data, and other IT systems. The applications we design, build, and support are critical to our healthcare operations and require high-availability, 24/7 monitoring, and on-call support.

Minimum Qualifications
  • Bachelor's Degree.
  • Six years of related experience.
  • Additional education may substitute for required experience and additional related experience may substitute for required education, to the extent permitted by the JHU equivalency formula.

Preferred Qualifications
  • Bachelor's or Master's Degree in computer science, Data Science, or a related field.
  • At least 3 years of experience in machine learning development, model testing, and deployment.
  • Experience setting up operations and pipelines for new and existing projects and/or familiarity with version control (i.e., Git, GitHub), CI/CD tooling (e.g., Azure DevOps Pipelines artifact repositories (e.g., Azure Container Registry, JFrog Artifactory), monitoring tools (e.g., Grafana, Prometheus), model monitoring tools (e.g. Weights & Biases, mlflow), and associated process automation (e.g. Apache Airflow).
  • Familiarity with complex Data Lakehouse and data management tools, standards, and techniques that support various modes of data ingestion and curation such as: Azure Data Factory, Azure Data Lake Storage Gen2 (ADLS), Azure Databricks, Delta Lake, Azure Event Hubs, and Snowflake.
  • Experience in healthcare IT.
  • Familiarity with healthcare data standards including Fast Healthcare Interoperability Resources (FHIR), Observational Medical Outcomes Partnership (OMOP) and Observational Health Data Sciences and Informatics (ODHSI) Common Data Model, and/or HL7 Clinical Document Architecture (CDA).



Classified Title: Sr. Software Engineer 
Working Title: Senior Machine Learning Operations Engineer   
Role/Level/Range: ATP/04/PF  
Starting Salary Range: Min $83,100 - Max $145,360 Annually (Commensurate with experience) 
Employee group: Full Time 
Schedule: Mon-Fri 8:30am-5:00pm 
Exempt Status: Exempt 
Location: School of Medicine Campus 
Department name: IT@JH Technology Innovation Center  
Personnel area: University Administration 


Total Rewards
The referenced salary range is based on Johns Hopkins University’s good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training and skill level. Johns Hopkins offers a total rewards package that supports our employees' health, life, career and retirement. More information can be found here:


Please refer to the job description above to see which forms of equivalency are permitted for this position. If permitted, equivalencies will follow these guidelines:
JHU Equivalency Formula: 30 undergraduate degree credits (semester hours) or 18 graduate degree credits may substitute for one year of experience. Additional related experience may substitute for required education on the same basis. For jobs where equivalency is permitted, up to two years of non-related college course work may be applied towards the total minimum education/experience required for the respective job.

**Applicants who do not meet the posted requirements but are completing their final academic semester/quarter will be considered eligible for employment and may be asked to provide additional information confirming their academic completion date.

The successful candidate(s) for this position will be subject to a pre-employment background check. Johns Hopkins is committed to hiring individuals with a justice-involved background, consistent with applicable policies and current practice. A prior criminal history does not automatically preclude candidates from employment at Johns Hopkins University. In accordance with applicable law, the university will review, on an individual basis, the date of a candidate’s conviction, the nature of the conviction and how the conviction relates to an essential job-related qualification or function.


The Johns Hopkins University values diversity, equity and inclusion and advances these through our key strategic framework, the JHU Roadmap on Diversity and Inclusion.


Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.


EEO is the Law
Learn more:


Accommodation Information

If you are interested in applying for employment with The Johns Hopkins University and require special assistance or accommodation during any part of the pre-employment process, please contact the Talent Acquisition Office at For TTY users, call via Maryland Relay or dial 711. For more information about workplace accommodations or accessibility at Johns Hopkins University, please visit


Johns Hopkins has mandated COVID-19 and influenza vaccines, as applicable. Exceptions to the COVID and flu vaccine requirements may be provided to individuals for religious beliefs or medical reasons. Requests for an exception must be submitted to the JHU vaccination registry. For additional information, applicants for SOM positions should visit and all other JHU applicants should visit


The following additional provisions may apply, depending on campus. Your recruiter will advise accordingly.

The pre-employment physical for positions in clinical areas, laboratories, working with research subjects, or involving community contact requires documentation of immune status against Rubella (German measles), Rubeola (Measles), Mumps, Varicella (chickenpox), Hepatitis B and documentation of having received the Tdap (Tetanus, diphtheria, pertussis) vaccination. This may include documentation of having two (2) MMR vaccines; two (2) Varicella vaccines; or antibody status to these diseases from laboratory testing. Blood tests for immunities to these diseases are ordinarily included in the pre-employment physical exam except for those employees who provide results of blood tests or immunization documentation from their own health care providers. Any vaccinations required for these diseases will be given at no cost in our Occupational Health office.


Note: Job Postings are updated daily and remain online until filled.



Equal Opportunity Employer
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

EEO is the Law:

School of Medicine - East Baltimore Campus