Celldetective is a python package and graphical user interface to perform single-cell analysis on multimodal time lapse microscopy images.

• Check the full documentation
• Report a bug or request a new feature
• Explore the datasets, models and demos

Celldetective was designed to analyze time-lapse microscopy images in difficult situations: mixed cell populations that are only separable through multimodal information. This software provides a toolkit for the analysis of cell population interactions.

Key features:

• Achieve single-cell description (segment / track / measure) for up to two populations of interest
• Signal annotation and traditional or Deep learning automation
• Mask annotation in napari¹ and retraining of Deep learning models
• Neighborhood linking within and across populations and interaction annotations
• Everything is done graphically, no coding is required!

Check out the highlights in the documentation!

Instead of reinventing the wheel and out of respect for the amazing work done by these teams, we chose to build around StarDist² & Cellpose³⁴ (BSD-3 license) for the Deep-learning segmentation and the Bayesian tracker bTrack⁵ (MIT license) for tracking. If you use these models or methods in your Celldetective workflow, don't forget to cite the respective papers!

Target Audience: The software is targeted to scientists who are interested in quantifying dynamically (or not) cell populations from microscopy images. Experimental scientists who produce such images can also analyze their data, thanks to the graphical interface, that completely removes the need for coding, and the many helper functions that guide the user in the analysis steps. Finally, the modular structure of Celldetective welcomes users with a partial need.

The software was tested on several machines, including:

• An Intel(R) Core(TM) i9-10850K CPU @ 3.60GHz, with a single NVIDIA GeForce RTX 3070 (8 Gb of memory) and 16 Gb of memory
• An Intel(R) Core(TM) i7-9750H CPU @ 2.60 GHz, with 16 Gb of memory

In GPU mode, succesive segmentation and DL signal analysis could be performed without saturating the GPU memory thanks to the subprocess formulation for the different modules. The GPU can be disabled in the startup window. The software does not require a GPU (but model inference will be longer).

A typical analysis of a single movie with a GPU takes between 3 to 15 minutes. Depending on the number of cells and frames on the images, this computation time can increase to the order of half an hour on a CPU.

Processing is performed frame by frame, therefore the memory requirement is extremely low. The main bottleneck is in the visualization of segmentation and tracking output. Whole stacks (typically 1-9 Gb) have to be loaded in memory at once to be viewed in napari.

The software was developed simulateously on Ubuntu 20.04 and Windows 11. It was tested on MacOS, but Tensorflow installation can require extra steps.

• Linux: Ubuntu 20.04.6 LTS (Focal Fossa)
• Windows: Windows 11 Home 23H2

To use the software, you must install python, e.g. through Anaconda. Celldetective is routinely tested on both Ubuntu and Windows for Python versions 3.9, 3.10 and 3.11.

Celldetective requires a version of Python between 3.9 and 3.11 (included). If your Python version is older or more recent, consider using conda to create an environment as described below.

With the proper Python version, Celldetective can be directly installed with pip:

pip install celldetective

We recommend that you create an environment to use Celldetective, to protect your package versions and fix the Python version e.g. with conda:

conda create -n celldetective python=3.11 pyqt
conda activate celldetective
pip install celldetective

Need an update? Simply type the following in the terminal (in your environment):

pip install --upgrade celldetective

For more installation options, please check the documentation.

You can launch the GUI by 1) opening a terminal and 2) typing the following:

# conda activate celldetective
python -m celldetective

For more information about how to get started, please check the documentation.

If you use this software in your research, please cite the Celldetective paper (currently preprint):

@article {Torro2024.03.15.585250,
    author = {Torro, R{\'e}my and D{\'\i}az-Bello, Beatriz and Arawi, Dalia El and Dervanova, Ksenija and Ammer, Lorna and Dupuy, Florian and Chames, Patrick and Sengupta, Kheya and Limozin, Laurent},
    title = {Celldetective: an AI-enhanced image analysis tool for unraveling dynamic cell interactions},
    elocation-id = {2024.03.15.585250},
    year = {2024},
    doi = {10.1101/2024.03.15.585250},
    publisher = {Cold Spring Harbor Laboratory},
    abstract = {A current challenge in bioimaging for immunology and immunotherapy research lies in analyzing multimodal and multidimensional data that capture dynamic interactions between diverse cell populations. Here, we introduce Celldetective, an open-source Python-based software designed for high-performance, end-to-end analysis of image-based in vitro immune and immunotherapy assays. Purpose-built for multicondition, 2D multichannel time-lapse microscopy of mixed cell populations, Celldetective is optimized for the needs of immunology assays. The software seamlessly integrates AI-based segmentation, Bayesian tracking, and automated single-cell event detection, all within an intuitive graphical interface that supports interactive visualization, annotation, and training capabilities. We demonstrate its utility with original data on immune effector cell interactions with an activating surface, mediated by bispecific antibodies, and further showcase its potential for analyzing extensive sets of pairwise interactions in antibody-dependent cell cytotoxicity events.Competing Interest StatementThe authors have declared no competing interest.},
    URL = {https://www.biorxiv.org/content/early/2024/11/13/2024.03.15.585250},
    eprint = {https://www.biorxiv.org/content/early/2024/11/13/2024.03.15.585250.full.pdf},
    journal = {bioRxiv}
}

Make sure you to cite the papers of any segmentation model (StarDist, Cellpose) or tracker (bTrack) you used through Celldetective.