Senior CV/ML Engineer

East Bay, CA, United States, Los Angeles, CA, United States, New York, NY, United States, Remote, Seattle, WA, United States, San Francisco, CA, United States, Silicon Valley, CA, United States • $160k - $180k • 0.50% - 0.75%

Virgo Surgical Video Solutions, Inc.

Role Locations

  • East Bay, CA, United States
  • Los Angeles, CA, United States
  • New York, NY, United States
  • Remote
  • Seattle, WA, United States
  • San Francisco, CA, United States
  • Silicon Valley, CA, United States


  • $160k - $180k
  • 0.50% - 0.75%


< 10 people


1111 Kearny St # 15
San Francisco, CA, 94133-4013, US

Tech Stack

  • Python
  • Google Cloud
  • Tensorflow
  • Go
  • PostgreSQL
  • Django
  • JavaScript
  • Vue.js
  • OpenCV
  • Ffmpeg
  • Numpy
  • Keras
  • GStreamer
  • PyTorch

Role Description

Virgo is looking for a Senior CV/ML Engineer to lead the development of our expanding ML-based features and products. Virgo has amassed the world's largest dataset of endoscopy videos — 130K+ videos, growing 20K+ videos per quarter — which we are now leveraging for a variety of machine learning applications.

In this role, you will be responsible for developing and deploying new ML-based features into our production system. Some of the ML features currently existing in our platform include:

  • Automated start/stop of procedure video recording using frame-level classification
  • Detection of surgical instruments present in the video
  • Proof-of-concept real-time polyp detection
  • Proof-of-concept inflammatory bowel disease scoring algorithm

Top priorities for development:

  • Automated text redaction from videos
  • Procedure type classification
  • Development and productization of novel disease scoring algorithms
  • Improved processes for video annotation

At Virgo, we prioritize practicality over novelty when it comes to computer vision and machine learning. We view CV/ML as tools to help solve problems for our customers. We are looking for an engineer who can help us tackle these complex problems, train new models, and deploy them in our production systems.

As our first dedicated ML hire, you will be responsible for setting our data annotation strategy, which may include a combination of both internally generated or externally sourced video annotations. Each year, we also bring on 2-3 interns from the University of San Francisco Data Science MS program who will report to you.

Knowledge of the following preferred: Python, Go, GCP, Tensorflow, OpenCV, ffmpeg, GStreamer

No clinical knowledge required...we'll get you trained up to speed with our Colon Class :)

About Virgo Surgical Video Solutions, Inc.

Virgo is the leading cloud video capture, management, and AI analysis platform for endoscopic medical procedures. Since launching in 2018, we've helped physicians from leading medical centers including The Mayo Clinic, Northwestern, and Mass General capture over 130,000 procedure videos — the largest data set of its kind.

Our platform consists of a small device — similar in form factor to an AppleTV — that connects to any existing endoscopy system. The Virgo capture device automatically and securely captures procedure videos and transfers them to our HIPAA compliant cloud storage and web portal.

We're currently expanding the Virgo platform to include tools that automatically identify patients who are good candidates for clinical trials — starting with Inflammatory Bowel Disease (IBD). These tools incorporate AI analysis of procedure videos, coupled with information from the clinical medical record. The typical IBD trial site recruits only 1 patient per year. Virgo is working with leading pharma companies to accelerate trial site recruitment to 2 patients per month, which will help get new treatments to market faster and generate hundreds of millions of dollars in additional revenue for pharma companies.

Long-term, we are building the most comprehensive longitudinal dataset of endoscopy videos and will continue to leverage this dataset for new AI applications. One such example is in the space of real-time polyp detection for colorectal cancer screening (see case study with Google's Coral EdgeTPU system:

Company Culture

We're a hard working bunch, yet flexible when needed to respect the importance of personal time. We're very open about our successes and the challenges facing the company, highlighted by a bi-weekly strategy meeting. More than anything, we really care about improving healthcare. All new employees go through an 8 week Colon Class to learn about anatomy, pathology, procedures, and health technology!

Interested in this role?
Skip straight to final-round interviews by applying through Triplebyte.