Introduction
The Allen Cell Structure Segmenter is a Python-based open source toolkit developed at the Allen Institute for Cell Science for 3D segmentation of intracellular structures in fluorescence microscope images. This toolkit brings together classic image segmentation and iterative deep learning workflows first to generate initial high-quality 3D intracellular structure segmentations and then to easily curate these results to generate the ground truths for building robust and accurate deep learning models. The toolkit takes advantage of the high replicate 3D live cell image data collected at the Allen Institute for Cell Science of over 30 endogenous fluorescently tagged human induced pluripotent stem cell (hiPSC) lines. Each cell line represents a different intracellular structure with one or more distinct localization patterns within undifferentiated hiPS cells and hiPSC-derived cardiomyocytes.
Overview
The Allen Cell Structure Segmenter consists of two complementary elements, a classic image segmentation workflow, with a restricted set of algorithms and parameters, and an iterative deep learning segmentation workflow. We created a collection of 20 classic image segmentation workflows based on 20 distinct and representative intracellular structure localization patterns as a “lookup table” reference and starting point for users. The iterative deep learning workflow can take over when the classic segmentation workflow is insufficient. Two straightforward “human-in-the-loop” curation strategies convert a set of classic image segmentation workflow results into a set of 3D ground truth images for iterative model training without the need for manual painting in 3D. The Allen Cell Structure Segmenter thus leverages state of the art computer vision algorithms in an accessible way to facilitate their application by the experimental biology researcher.
To access the toolkit, please check out our Github repositories for the Machine Learning Code & the Classic Code, as well as the accompanying paper on bioRxiv.
To access the toolkit, please check out our Github repositories for the Machine Learning Code & the Classic Code, as well as the accompanying paper on bioRxiv.
Video tutorials
To assist biologists and computational scientists with using the Allen Cell Structure Segmenter, take a look at our two video tutorials:
|
Allen Cell Structure Segmenter: Creating a new classic image segmentation workflow
Our Scientific Data Engineer, Ruian Yang, walks users through the steps to create a new classic segmentation workflow for 3D image processing. |
Allen Cell Structure Segmenter: Using Iterative Deep Learning
Our Scientist, Melissa Hendershott describes the steps to combine the classic segmentation steps with deep learning, and provides helpful tips throughout the demonstration. |
Lookup table of classic image segmentation worksflows for 20 intracellular structure localization patterns
Click on thumbnail to view video
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Full z-stack examples
*Note: all scale bars in these movies are 10μm
*Note :
- Due to the lag between development and production cycles, the segmentation results on Data Download page are continuously being updated using our new toolkit. In the meantime, applying our ML code or Classic code on Github can produce our most recent segmentation results.
- We appreciate your feedback. Please sign-up on our Allen Cell Discussion Forum for community questions and comments.