phenotypic.prefab.FilamentousFungiPipeline#
- class phenotypic.prefab.FilamentousFungiPipeline(bm3d_block_size: int = 4, bm3d_stage_arg: Literal['all_stages', 'hard_thresholding'] = 'all_stages', homo_sigma: float = 300.0, homo_gamma_low: float = 0.5, homo_gamma_high: float = 1.5, inoculum_min_diameter: float = 30.0, inoculum_max_diameter: float = 100.0, inoculum_detector: ObjectDetector | ImagePipeline | None = None, max_colony_radius_px: float = 250.0, min_branch_width_px: int = 3, ignore_borders: bool = True, edge_noise_threshold: float = 6.0, reconnection_tolerance: float = 2.5, max_gap_length: int = 30, border_margin_px: int = 50, frag_reach_px: int = 10, gap_crossing_penalty: float = 4.0, gauss_sigma: float | None = None, pct_min_wavelength: float | None = None, coherence_window_radius: int | None = None, mad_window: int | None = None, snr_margin: int | None = None, path_dilation_radius: int | None = None, tile_size: int | None = None, tile_overlap: int | None = None, texture_scale: int = 5, texture_warn: bool = False, benchmark: bool = False, verbose: bool = False)[source]#
Bases:
PrefabPipelineReady-to-use pipeline for filamentous fungi detection with DenoiseBlockMatch denoising and spatial measurements.
- Pipeline Steps:
DenoiseBlockMatch– Variance-stabilized BM3D denoising for Poisson-Gaussian noise removal on gray and detect_mat channels.FlattenIllumination– Illumination normalization via frequency-domain filtering on detect_mat.FilamentousFungiDetector– Two-stage detection (inoculum + dual-mask reconnection) with Euclidean Voronoi partition and Dijkstra branch reconnection.
- Measurements:
MeasureGridSpatial– Grid-level spatial statistics.MeasureShape– Per-colony shape descriptors.MeasureIntensity– Per-colony intensity statistics.MeasureTexture– Haralick texture features.
- Parameters:
bm3d_block_size (int) – BM3D patch size for denoising. Default 8.
bm3d_stage_arg (Literal['all_stages', 'hard_thresholding']) – BM3D processing mode.
'all_stages'gives best quality;'hard_thresholding'is faster.homo_sigma (float) – Gaussian cutoff sigma for the homomorphic filter.
homo_gamma_low (float) – Gain for low-frequency (illumination) components.
homo_gamma_high (float) – Gain for high-frequency (reflectance) components.
inoculum_min_diameter (float) – Smallest expected inoculum diameter in pixels for the default InoculumDetector. Ignored when
inoculum_detectoris provided. Default 30.0.inoculum_max_diameter (float) – Largest expected inoculum diameter in pixels for the default InoculumDetector. Ignored when
inoculum_detectoris provided. Default 100.0.inoculum_detector (Union[ObjectDetector, ImagePipeline, None]) – Custom ObjectDetector or ImagePipeline that identifies fungal centers/nuclei. When None, builds a default pipeline of
InoculumDetector+KeepSectionLargest.max_colony_radius_px (float) – Largest colony radius (in pixels) the detector should handle. Sizes scene-derived spatial parameters for this worst case. Default 250.
min_branch_width_px (int) – Narrowest hyphal branch width (in pixels) to detect. Sizes signal-scale parameters. Default 3.
ignore_borders (bool) – If True, drops objects touching the image border.
edge_noise_threshold (float) – Noise threshold scaling factor for phase congruency edge detection.
reconnection_tolerance (float) – IQR multiplier for path quality threshold calibration (higher = more permissive).
max_gap_length (int) – Maximum acceptable length (pixels) of a suspicious cost stretch along a reconnection path.
border_margin_px (int) – Border penalty buffer width in pixels.
frag_reach_px (int) – Maximum 2D distance (pixels) from a fragment’s boundary to the nearest routable pixel; fragments more isolated than this are dropped before Dijkstra routing.
gap_crossing_penalty (float) – Distance-gap penalty strength during Dijkstra routing.
gauss_sigma (Optional[float]) – Override for SubtractGaussian sigma; None auto-derives.
pct_min_wavelength (Optional[float]) – Override for log-Gabor minimum wavelength; None auto-derives.
coherence_window_radius (Optional[int]) – Override for orientation coherence radius; None auto-derives.
mad_window (Optional[int]) – Override for local MAD window (odd); None auto-derives.
snr_margin (Optional[int]) – Override for SNR ring radius; None auto-derives.
path_dilation_radius (Optional[int]) – Override for path dilation radius; None auto-derives.
tile_size (Optional[int]) – Override for tile side length; None auto-derives.
tile_overlap (Optional[int]) – Override for tile overlap; None auto-derives.
texture_scale (int) – Scale parameter for Haralick texture features.
texture_warn (bool) – Whether to warn on texture computation errors.
benchmark (bool) – Enable per-step timing and memory benchmarks.
verbose (bool) – Enable verbose logging during pipeline execution.
See also
Tutorial 10: Detecting Filamentous Fungi for a visual walkthrough of filamentous fungi detection. The Filamentous Fungi Detection Algorithm for the theory behind the reconnection algorithm. Prefab Pipelines: Which One for Which Organism for guidance on choosing a prefab pipeline.
Methods
__init__Create a new model by parsing and validating input data from keyword arguments.
Run the analysis chain (filters then model) against an aggregate frame.
The class provides an interface to process and apply a series of operations on an Image.
Applies processing to the given image and measures the results.
Apply the pipeline and progressively add layers to a napari viewer.
Apply the pipeline and capture a snapshot of the image after each operation.
Return execution times and memory usage for operations and measurements.
Returns a copy of the model.
Deserialize a PrefabPipeline from JSON.
Get a copy of the analysis filter chain.
Get a copy of the measurements dictionary.
Get the analysis endpoint model, if configured.
Get a copy of the operations dictionary.
Get a copy of the post-measurement transforms dictionary.
Get a copy of the QC config entry list.
Measures properties of a given image and optionally includes metadata.
Creates a new instance of the Model class with validated data.
!!! abstract "Usage Documentation"
!!! abstract "Usage Documentation"
!!! abstract "Usage Documentation"
Generates a JSON schema for a model class.
Compute the class name for parametrizations of generic classes.
Initialize logging and memory tracking after model construction.
Try to rebuild the pydantic-core schema for the model.
Validate a pydantic model instance.
!!! abstract "Usage Documentation"
Validate the given object with string data against the Pydantic model.
Set the analysis filter chain.
Sets the measurements to be used for further computation.
Set the analysis endpoint model.
Sets the operations to be performed.
Set the post-measurement transforms.
Set the QC config entry list.
Serialize the pipeline configuration to JSON format.
Return (and optionally display) the root widget.
Attributes
Get pipeline description.
Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].
Get extra fields set during validation.
Returns the set of fields that have been explicitly set on this model instance.
- __del__()#
Automatically stop tracemalloc when the object is deleted.
- classmethod __get_pydantic_json_schema__(core_schema: CoreSchema, handler: GetJsonSchemaHandler, /) JsonSchemaValue#
Hook into generating the model’s JSON schema.
- Parameters:
core_schema (CoreSchema) – A pydantic-core CoreSchema. You can ignore this argument and call the handler with a new CoreSchema, wrap this CoreSchema ({‘type’: ‘nullable’, ‘schema’: current_schema}), or just call the handler with the original schema.
handler (GetJsonSchemaHandler) – Call into Pydantic’s internal JSON schema generation. This will raise a pydantic.errors.PydanticInvalidForJsonSchema if JSON schema generation fails. Since this gets called by BaseModel.model_json_schema you can override the schema_generator argument to that function to change JSON schema generation globally for a type.
- Returns:
A JSON schema, as a Python object.
- Return type:
JsonSchemaValue
- __pretty__(fmt: Callable[[Any], Any], **kwargs: Any) Generator[Any]#
Used by devtools (https://python-devtools.helpmanual.io/) to pretty print objects.
- classmethod __pydantic_init_subclass__(**kwargs: Any) None#
Populate field descriptions from the subclass docstring.
Runs once per concrete subclass after pydantic has built its model. Copies parameter descriptions parsed from the Google-style
Args:docstring block onto each field’sdescriptionslot so they surface inmodel_json_schema()— the machine-readable contract used by downstream tooling (e.g. an MCP server).- Parameters:
**kwargs (Any) – Class-keyword arguments forwarded by pydantic.
- Return type:
None
- classmethod __pydantic_on_complete__() None#
This is called once the class and its fields are fully initialized and ready to be used.
This typically happens when the class is created (just before [__pydantic_init_subclass__()][pydantic.main.BaseModel.__pydantic_init_subclass__] is called on the superclass), except when forward annotations are used that could not immediately be resolved. In that case, it will be called later, when the model is rebuilt automatically or explicitly using [model_rebuild()][pydantic.main.BaseModel.model_rebuild].
- Return type:
None
- __rich_repr__() RichReprResult#
Used by Rich (https://rich.readthedocs.io/en/stable/pretty.html) to pretty print objects.
- Return type:
RichReprResult
- __str__() str#
Return a JSON-formatted string representation of the pipeline.
The generated JSON string provides a structured representation of the object’s current state, including its operations and measurements. This output can be used for logging, debugging, or to recreate the object’s configuration in another context.
- Returns:
A JSON-formatted string that encodes the object’s current configuration in a human-readable manner. This includes the phenotypic version, pipeline name, description, and the lists of operations and measurements.
- Return type:
- analyze(df: pandas.DataFrame) pandas.DataFrame#
Run the analysis chain (filters then model) against an aggregate frame.
Applies each filter in order — each transforms a DataFrame into another DataFrame — then runs the configured terminal model to produce a fit summary (typically one row per group).
The expected input is the post-applied, aggregated DataFrame the CLI seeds into
measurements.parquet.analyzedoes not apply post itself: by defaultmeasure()runsself._postbefore returning, and the CLI applies post explicitly to a copy of the aggregated master before invokinganalyze. Callers passingapply_post=Falsetomeasure()are responsible for applying post (or accepting that filters/model see pre-post data) before callinganalyze.- Parameters:
df (pandas.DataFrame) – The aggregate measurements DataFrame.
- Returns:
- The model-fit output (one row per group, plus shared
MODEL_METRICScolumns for fit quality).
- Return type:
pd.DataFrame
- Raises:
ValueError – If no model is configured. Configure via
set_model()(or passmodel=at construction).
- apply(image: Image, inplace: bool = False, reset: bool | None = None) GridImage | Image#
The class provides an interface to process and apply a series of operations on an Image. The operations are maintained in a queue and executed sequentially when applied to the given Image.
- Parameters:
image (Image) – The arr Image to be processed. The type Image refers to an instance of the Image object to which transformations are applied.
inplace (bool, optional) – A flag indicating whether to apply the transformations directly on the provided Image (True) or create a copy of the Image before performing transformations (False). Defaults to False.
reset (bool, optional) – Whether to reset the image before applying the pipeline. If None (default), uses the pipeline’s reset setting from __init__. If explicitly set to True or False, overrides the pipeline setting.
- Return type:
Union[GridImage, Image]
- apply_and_measure(image: Image, inplace: bool = False, reset: bool | None = None, include_metadata: bool = True, apply_post: bool = True) pd.DataFrame#
Applies processing to the given image and measures the results.
This function first applies a processing method to the supplied image, adjusting it based on the given parameters. After processing, the resulting image is measured, and a DataFrame containing the measurement data is returned.
- Parameters:
image (Image) – The image to process and measure.
inplace (bool) – Whether to modify the original image directly or work on a copy. Default is False.
reset (bool, optional) – Whether to reset any previous processing on the image before applying the current method. If None (default), uses the pipeline’s reset setting. If explicitly set, overrides the pipeline setting.
include_metadata (bool) – Whether to include metadata in the measurement results. Default is True.
apply_post (bool) – Forwarded to
measure(). WhenFalse, the returned DataFrame skipsPostMeasurementops. Defaults to True.
- Returns:
A DataFrame containing measurement data for the processed image.
- Return type:
pd.DataFrame
- apply_napari(image: Image, inplace: bool = False, reset: bool | None = None, viewer: napari.Viewer | None = None) NapariPipelineResult#
Apply the pipeline and progressively add layers to a napari viewer.
Creates (or reuses) a napari viewer and adds the original image layers as a baseline, then adds the modified layer after each operation completes. Layer names follow the pattern
{step:02d}_{OperationName}_{accessor}.- Parameters:
image (Image) – The input image to process.
inplace (bool) – If
Truethe image is modified in place; otherwise a copy is made first. Defaults toFalse.reset (bool | None) – Whether to reset the image before applying operations.
None(default) uses the pipeline-level setting.viewer (napari.Viewer | None) – An existing napari viewer to add layers to. If
None(default), a new viewer is created.
- Returns:
Named tuple with the final image and the napari viewer reference.
- Return type:
NapariPipelineResult
- Raises:
ImportError – If napari is not installed.
- apply_with_intermediates(image: Image, inplace: bool = False, reset: bool | None = None, output_dir: str | Path | None = None) IntermediateResult#
Apply the pipeline and capture a snapshot of the image after each operation.
Behaves identically to
apply()(respecting inplace, reset, benchmark timing, and verbose/tqdm progress) but additionally records the image state after every operation completes.- Parameters:
image (Image) – The input image to process.
inplace (bool) – If
Truethe image is modified in place; otherwise a copy is made first. Defaults toFalse.reset (Optional[bool]) – Whether to reset the image before applying operations.
None(default) uses the pipeline-level setting.output_dir (Optional[Union[str, Path]]) – Optional directory path. When provided, each intermediate image is persisted to an HDF5 file inside this directory (created automatically) and the corresponding dict value is set to
Noneto conserve memory. WhenNone, intermediates are kept in memory asImagecopies.
- Returns:
A named tuple containing the final image and a dictionary mapping operation names to intermediate snapshots (or
Nonewhen output_dir is used).- Return type:
IntermediateResult
- benchmark_results() pandas.DataFrame#
Return execution times and memory usage for operations and measurements.
This method should be called after applying the pipeline on an image to get the execution times and memory consumption of the different processes.
When an operation is itself an
ImagePipelineCore(nested pipeline), its sub-operations are expanded as indented sub-rows beneath the parent entry with names like"ParentOp > ChildOp".- Returns:
- A DataFrame with columns
Process Type, Process Name,Execution Time (s),Memory Delta (MB), andRSS After (MB).
- A DataFrame with columns
- Return type:
pd.DataFrame
- copy(*, include: AbstractSetIntStr | MappingIntStrAny | None = None, exclude: AbstractSetIntStr | MappingIntStrAny | None = None, update: Dict[str, Any] | None = None, deep: bool = False) Self#
Returns a copy of the model.
- !!! warning “Deprecated”
This method is now deprecated; use model_copy instead.
If you need include or exclude, use:
`python {test="skip" lint="skip"} data = self.model_dump(include=include, exclude=exclude, round_trip=True) data = {**data, **(update or {})} copied = self.model_validate(data) `- Parameters:
include (AbstractSetIntStr | MappingIntStrAny | None) – Optional set or mapping specifying which fields to include in the copied model.
exclude (AbstractSetIntStr | MappingIntStrAny | None) – Optional set or mapping specifying which fields to exclude in the copied model.
update (Dict[str, Any] | None) – Optional dictionary of field-value pairs to override field values in the copied model.
deep (bool) – If True, the values of fields that are Pydantic models will be deep-copied.
- Returns:
A copy of the model with included, excluded and updated fields as specified.
- Return type:
Self
- dict(*, include: set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None = None, exclude: set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None = None, by_alias: bool = False, exclude_unset: bool = False, exclude_defaults: bool = False, exclude_none: bool = False) Dict[str, Any]#
- Parameters:
include (set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None)
exclude (set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None)
by_alias (bool)
exclude_unset (bool)
exclude_defaults (bool)
exclude_none (bool)
- Return type:
- classmethod from_json(json_data: str | Path | dict, benchmark: bool = False, verbose: bool = False) PrefabPipeline#
Deserialize a PrefabPipeline from JSON.
PrefabPipeline subclasses build their ops/meas inside
__init__, so the basefrom_json(which passesops=directly) would conflict. This override deserializes viaImagePipelineand re-tags the instance as the correct PrefabPipeline subclass.- Parameters:
- Returns:
A PrefabPipeline (or subclass) instance with the loaded configuration.
- Return type:
- get_filters() Dict[str, SetAnalyzer]#
Get a copy of the analysis filter chain.
Returns a shallow copy to prevent accidental mutation of internal state.
- Returns:
- Ordered dict mapping filter names to
SetAnalyzerinstances. Empty when no filters configured.
- Return type:
Dict[str, SetAnalyzer]
- get_meas() Dict[str, MeasureFeatures]#
Get a copy of the measurements dictionary.
Returns a shallow copy to prevent accidental mutation of internal state.
- Returns:
- Dictionary mapping measurement names to
MeasureFeatures instances.
- Return type:
Dict[str, MeasureFeatures]
- get_model() ModelFitter | None#
Get the analysis endpoint model, if configured.
- Returns:
- The configured
ModelFitterinstance, or
Nonewhen no model is set.
- The configured
- Return type:
Optional[ModelFitter]
- get_ops() Dict[str, ImageOperation | ImagePipelineCore]#
Get a copy of the operations dictionary.
Returns a shallow copy to prevent accidental mutation of internal state.
- Returns:
- Dictionary mapping
operation names to
ImageOperationinstances (or nested pipelines).
- Return type:
Dict[str, ImageOperation | ImagePipelineCore]
- get_post() Dict[str, PostMeasurement]#
Get a copy of the post-measurement transforms dictionary.
Returns a shallow copy to prevent accidental mutation of internal state.
- Returns:
- Dictionary mapping post-measurement
names to
PostMeasurementinstances.
- Return type:
Dict[str, PostMeasurement]
- get_qc() List[QcRecipeEntry]#
Get a copy of the QC config entry list.
Returns a shallow copy so callers cannot mutate the pipeline’s internal list by appending/removing. The entries themselves are shared (they are lightweight config dataclasses);
run_qcand the GUI only read them and instantiate fresh checks from their params.- Returns:
- Ordered QC config entries. Empty when no
checks are configured.
- Return type:
List[QcRecipeEntry]
- json(*, include: set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None = None, exclude: set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None = None, by_alias: bool = False, exclude_unset: bool = False, exclude_defaults: bool = False, exclude_none: bool = False, encoder: Callable[[Any], Any] | None = PydanticUndefined, models_as_dict: bool = PydanticUndefined, **dumps_kwargs: Any) str#
- Parameters:
include (set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None)
exclude (set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None)
by_alias (bool)
exclude_unset (bool)
exclude_defaults (bool)
exclude_none (bool)
models_as_dict (bool)
dumps_kwargs (Any)
- Return type:
- measure(image: Image, include_metadata: bool = True, apply_post: bool = True) pd.DataFrame#
Measures properties of a given image and optionally includes metadata. The method performs measurements using a set of predefined measurement operations. If benchmarking is enabled, the execution time of each measurement is recorded. When verbose mode is active, detailed logging of the measurement process is displayed. A progress bar is used to track progress if the tqdm library is available.
- Parameters:
image (Image) – The image object for which measurements are performed. It must support the info method and optionally a grid or objects attribute.
include_metadata (bool, optional) – Indicates whether metadata should be included in the measurements. Defaults to True.
apply_post (bool, optional) – Whether to apply the configured
PostMeasurementoperations to the merged frame before returning. Defaults to True. PassFalseto obtain the pre-post merged DataFrame — useful when the caller (e.g. the CLI) wants to persist a clean copy and apply post separately.
- Returns:
- A DataFrame containing the results of all performed measurements combined
on the same index.
- Return type:
pd.DataFrame
- Raises:
Exception – An exception is raised if a measurement operation fails while being applied to the image.
- model_computed_fields = {}#
- model_config: ClassVar[ConfigDict] = {'arbitrary_types_allowed': True, 'extra': 'forbid', 'validate_assignment': True, 'validate_by_name': True}#
Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].
- classmethod model_construct(_fields_set: set[str] | None = None, **values: Any) Self#
Creates a new instance of the Model class with validated data.
Creates a new model setting __dict__ and __pydantic_fields_set__ from trusted or pre-validated data. Default values are respected, but no other validation is performed.
- !!! note
model_construct() generally respects the model_config.extra setting on the provided model. That is, if model_config.extra == ‘allow’, then all extra passed values are added to the model instance’s __dict__ and __pydantic_extra__ fields. If model_config.extra == ‘ignore’ (the default), then all extra passed values are ignored. Because no validation is performed with a call to model_construct(), having model_config.extra == ‘forbid’ does not result in an error if extra values are passed, but they will be ignored.
- Parameters:
_fields_set (set[str] | None) – A set of field names that were originally explicitly set during instantiation. If provided, this is directly used for the [model_fields_set][pydantic.BaseModel.model_fields_set] attribute. Otherwise, the field names from the values argument will be used.
values (Any) – Trusted or pre-validated data dictionary.
- Returns:
A new instance of the Model class with validated data.
- Return type:
- model_copy(*, update: Mapping[str, Any] | None = None, deep: bool = False) Self#
- !!! abstract “Usage Documentation”
[model_copy](../concepts/models.md#model-copy)
Returns a copy of the model.
- !!! note
The underlying instance’s [__dict__][object.__dict__] attribute is copied. This might have unexpected side effects if you store anything in it, on top of the model fields (e.g. the value of [cached properties][functools.cached_property]).
- model_dump(*, mode: Literal['json', 'python'] | str = 'python', include: set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None = None, exclude: set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None = None, context: Any | None = None, by_alias: bool | None = None, exclude_unset: bool = False, exclude_defaults: bool = False, exclude_none: bool = False, exclude_computed_fields: bool = False, round_trip: bool = False, warnings: bool | Literal['none', 'warn', 'error'] = True, fallback: Callable[[Any], Any] | None = None, serialize_as_any: bool = False) dict[str, Any]#
- !!! abstract “Usage Documentation”
[model_dump](../concepts/serialization.md#python-mode)
Generate a dictionary representation of the model, optionally specifying which fields to include or exclude.
- Parameters:
mode (Literal['json', 'python'] | str) – The mode in which to_python should run. If mode is ‘json’, the output will only contain JSON serializable types. If mode is ‘python’, the output may contain non-JSON-serializable Python objects.
include (set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None) – A set of fields to include in the output.
exclude (set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None) – A set of fields to exclude from the output.
context (Any | None) – Additional context to pass to the serializer.
by_alias (bool | None) – Whether to use the field’s alias in the dictionary key if defined.
exclude_unset (bool) – Whether to exclude fields that have not been explicitly set.
exclude_defaults (bool) – Whether to exclude fields that are set to their default value.
exclude_none (bool) – Whether to exclude fields that have a value of None.
exclude_computed_fields (bool) – Whether to exclude computed fields. While this can be useful for round-tripping, it is usually recommended to use the dedicated round_trip parameter instead.
round_trip (bool) – If True, dumped values should be valid as input for non-idempotent types such as Json[T].
warnings (bool | Literal['none', 'warn', 'error']) – How to handle serialization errors. False/”none” ignores them, True/”warn” logs errors, “error” raises a [PydanticSerializationError][pydantic_core.PydanticSerializationError].
fallback (Callable[[Any], Any] | None) – A function to call when an unknown value is encountered. If not provided, a [PydanticSerializationError][pydantic_core.PydanticSerializationError] error is raised.
serialize_as_any (bool) – Whether to serialize fields with duck-typing serialization behavior.
- Returns:
A dictionary representation of the model.
- Return type:
- model_dump_json(*, indent: int | None = None, ensure_ascii: bool = False, include: set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None = None, exclude: set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None = None, context: Any | None = None, by_alias: bool | None = None, exclude_unset: bool = False, exclude_defaults: bool = False, exclude_none: bool = False, exclude_computed_fields: bool = False, round_trip: bool = False, warnings: bool | Literal['none', 'warn', 'error'] = True, fallback: Callable[[Any], Any] | None = None, serialize_as_any: bool = False) str#
- !!! abstract “Usage Documentation”
[model_dump_json](../concepts/serialization.md#json-mode)
Generates a JSON representation of the model using Pydantic’s to_json method.
- Parameters:
indent (int | None) – Indentation to use in the JSON output. If None is passed, the output will be compact.
ensure_ascii (bool) – If True, the output is guaranteed to have all incoming non-ASCII characters escaped. If False (the default), these characters will be output as-is.
include (set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None) – Field(s) to include in the JSON output.
exclude (set[int] | set[str] | Mapping[int, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | Mapping[str, set[int] | set[str] | Mapping[int, IncEx | bool] | Mapping[str, IncEx | bool] | bool] | None) – Field(s) to exclude from the JSON output.
context (Any | None) – Additional context to pass to the serializer.
by_alias (bool | None) – Whether to serialize using field aliases.
exclude_unset (bool) – Whether to exclude fields that have not been explicitly set.
exclude_defaults (bool) – Whether to exclude fields that are set to their default value.
exclude_none (bool) – Whether to exclude fields that have a value of None.
exclude_computed_fields (bool) – Whether to exclude computed fields. While this can be useful for round-tripping, it is usually recommended to use the dedicated round_trip parameter instead.
round_trip (bool) – If True, dumped values should be valid as input for non-idempotent types such as Json[T].
warnings (bool | Literal['none', 'warn', 'error']) – How to handle serialization errors. False/”none” ignores them, True/”warn” logs errors, “error” raises a [PydanticSerializationError][pydantic_core.PydanticSerializationError].
fallback (Callable[[Any], Any] | None) – A function to call when an unknown value is encountered. If not provided, a [PydanticSerializationError][pydantic_core.PydanticSerializationError] error is raised.
serialize_as_any (bool) – Whether to serialize fields with duck-typing serialization behavior.
- Returns:
A JSON string representation of the model.
- Return type:
- property model_extra: dict[str, Any] | None#
Get extra fields set during validation.
- Returns:
A dictionary of extra fields, or None if config.extra is not set to “allow”.
- model_fields = {'benchmark': FieldInfo(annotation=bool, required=False, default=False, description='Whether to enable execution time tracking for operations and measurements.'), 'desc_value': FieldInfo(annotation=Union[str, NoneType], required=False, default=None, alias='desc', alias_priority=2), 'filters': FieldInfo(annotation=Dict[str, SetAnalyzer], required=False, default={}), 'meas': FieldInfo(annotation=Dict[str, MeasureFeatures], required=False, default={}), 'model': FieldInfo(annotation=Union[ModelFitter, NoneType], required=False, default=None), 'name': FieldInfo(annotation=str, required=False, default_factory=<lambda>, description='A unique identifier for this pipeline. Defaults to a randomly generated UUID4 string if not provided during initialization.'), 'ncols': FieldInfo(annotation=Union[int, NoneType], required=False, default=None), 'nrows': FieldInfo(annotation=Union[int, NoneType], required=False, default=None), 'ops': FieldInfo(annotation=Dict[str, Union[ImageOperation, ImagePipelineCore]], required=False, default_factory=dict, alias_priority=2, validation_alias=AliasChoices(choices=['ops', 'pipe_cfgs'])), 'post': FieldInfo(annotation=Dict[str, PostMeasurement], required=False, default={}), 'qc': FieldInfo(annotation=List[QcRecipeEntry], required=False, default_factory=list, exclude=True), 'reset': FieldInfo(annotation=bool, required=False, default=False), 'verbose': FieldInfo(annotation=bool, required=False, default=False, description='Whether to enable verbose logging during pipeline execution.')}#
- property model_fields_set: set[str]#
Returns the set of fields that have been explicitly set on this model instance.
- Returns:
- A set of strings representing the fields that have been set,
i.e. that were not filled from defaults.
- classmethod model_json_schema(by_alias: bool = True, ref_template: str = '#/$defs/{model}', schema_generator: type[~pydantic.json_schema.GenerateJsonSchema] = <class 'pydantic.json_schema.GenerateJsonSchema'>, mode: ~typing.Literal['validation', 'serialization'] = 'validation', *, union_format: ~typing.Literal['any_of', 'primitive_type_array'] = 'any_of') dict[str, Any]#
Generates a JSON schema for a model class.
- Parameters:
by_alias (bool) – Whether to use attribute aliases or not.
ref_template (str) – The reference template.
union_format (Literal['any_of', 'primitive_type_array']) –
The format to use when combining schemas from unions together. Can be one of:
’any_of’: Use the [anyOf](https://json-schema.org/understanding-json-schema/reference/combining#anyOf)
keyword to combine schemas (the default). - ‘primitive_type_array’: Use the [type](https://json-schema.org/understanding-json-schema/reference/type) keyword as an array of strings, containing each type of the combination. If any of the schemas is not a primitive type (string, boolean, null, integer or number) or contains constraints/metadata, falls back to any_of.
schema_generator (type[GenerateJsonSchema]) – To override the logic used to generate the JSON schema, as a subclass of GenerateJsonSchema with your desired modifications
mode (Literal['validation', 'serialization']) – The mode in which to generate the schema.
- Returns:
The JSON schema for the given model class.
- Return type:
- classmethod model_parametrized_name(params: tuple[type[Any], ...]) str#
Compute the class name for parametrizations of generic classes.
This method can be overridden to achieve a custom naming scheme for generic BaseModels.
- Parameters:
params (tuple[type[Any], ...]) – Tuple of types of the class. Given a generic class Model with 2 type variables and a concrete model Model[str, int], the value (str, int) would be passed to params.
- Returns:
String representing the new class where params are passed to cls as type variables.
- Raises:
TypeError – Raised when trying to generate concrete names for non-generic models.
- Return type:
- model_post_init(_BaseOperation__context: Any) None#
Initialize logging and memory tracking after model construction.
Replaces the legacy
__init__body: creates the per-class logger and, when that logger is enabled for INFO level or higher, startstracemallocso per-operation memory usage can be logged.- Parameters:
__context – Pydantic post-init context (unused).
_BaseOperation__context (Any)
- Return type:
None
- classmethod model_rebuild(*, force: bool = False, raise_errors: bool = True, _parent_namespace_depth: int = 2, _types_namespace: MappingNamespace | None = None) bool | None#
Try to rebuild the pydantic-core schema for the model.
This may be necessary when one of the annotations is a ForwardRef which could not be resolved during the initial attempt to build the schema, and automatic rebuilding fails.
- Parameters:
force (bool) – Whether to force the rebuilding of the model schema, defaults to False.
raise_errors (bool) – Whether to raise errors, defaults to True.
_parent_namespace_depth (int) – The depth level of the parent namespace, defaults to 2.
_types_namespace (MappingNamespace | None) – The types namespace, defaults to None.
- Returns:
Returns None if the schema is already “complete” and rebuilding was not required. If rebuilding _was_ required, returns True if rebuilding was successful, otherwise False.
- Return type:
bool | None
- classmethod model_validate(obj: Any, *, strict: bool | None = None, extra: Literal['allow', 'ignore', 'forbid'] | None = None, from_attributes: bool | None = None, context: Any | None = None, by_alias: bool | None = None, by_name: bool | None = None) Self#
Validate a pydantic model instance.
- Parameters:
obj (Any) – The object to validate.
strict (bool | None) – Whether to enforce types strictly.
extra (Literal['allow', 'ignore', 'forbid'] | None) – Whether to ignore, allow, or forbid extra data during model validation. See the [extra configuration value][pydantic.ConfigDict.extra] for details.
from_attributes (bool | None) – Whether to extract data from object attributes.
context (Any | None) – Additional context to pass to the validator.
by_alias (bool | None) – Whether to use the field’s alias when validating against the provided input data.
by_name (bool | None) – Whether to use the field’s name when validating against the provided input data.
- Raises:
ValidationError – If the object could not be validated.
- Returns:
The validated model instance.
- Return type:
- classmethod model_validate_json(json_data: str | bytes | bytearray, *, strict: bool | None = None, extra: Literal['allow', 'ignore', 'forbid'] | None = None, context: Any | None = None, by_alias: bool | None = None, by_name: bool | None = None) Self#
- !!! abstract “Usage Documentation”
[JSON Parsing](../concepts/json.md#json-parsing)
Validate the given JSON data against the Pydantic model.
- Parameters:
json_data (str | bytes | bytearray) – The JSON data to validate.
strict (bool | None) – Whether to enforce types strictly.
extra (Literal['allow', 'ignore', 'forbid'] | None) – Whether to ignore, allow, or forbid extra data during model validation. See the [extra configuration value][pydantic.ConfigDict.extra] for details.
context (Any | None) – Extra variables to pass to the validator.
by_alias (bool | None) – Whether to use the field’s alias when validating against the provided input data.
by_name (bool | None) – Whether to use the field’s name when validating against the provided input data.
- Returns:
The validated Pydantic model.
- Raises:
ValidationError – If json_data is not a JSON string or the object could not be validated.
- Return type:
- classmethod model_validate_strings(obj: Any, *, strict: bool | None = None, extra: Literal['allow', 'ignore', 'forbid'] | None = None, context: Any | None = None, by_alias: bool | None = None, by_name: bool | None = None) Self#
Validate the given object with string data against the Pydantic model.
- Parameters:
obj (Any) – The object containing string data to validate.
strict (bool | None) – Whether to enforce types strictly.
extra (Literal['allow', 'ignore', 'forbid'] | None) – Whether to ignore, allow, or forbid extra data during model validation. See the [extra configuration value][pydantic.ConfigDict.extra] for details.
context (Any | None) – Extra variables to pass to the validator.
by_alias (bool | None) – Whether to use the field’s alias when validating against the provided input data.
by_name (bool | None) – Whether to use the field’s name when validating against the provided input data.
- Returns:
The validated Pydantic model.
- Return type:
- classmethod parse_file(path: str | Path, *, content_type: str | None = None, encoding: str = 'utf8', proto: DeprecatedParseProtocol | None = None, allow_pickle: bool = False) Self#
- classmethod parse_raw(b: str | bytes, *, content_type: str | None = None, encoding: str = 'utf8', proto: DeprecatedParseProtocol | None = None, allow_pickle: bool = False) Self#
- classmethod schema_json(*, by_alias: bool = True, ref_template: str = '#/$defs/{model}', **dumps_kwargs: Any) str#
- set_filters(filters: List[SetAnalyzer] | Dict[str, SetAnalyzer]) None#
Set the analysis filter chain.
- Parameters:
filters (List[SetAnalyzer] | Dict[str, SetAnalyzer]) – A list or dictionary of
SetAnalyzerinstances. If a list, class names (deduplicated by suffix) are used as keys.- Raises:
TypeError – If
filtersis neither a list nor a dictionary.- Return type:
None
- set_meas(measurements: List[MeasureFeatures] | Dict[str, MeasureFeatures])#
Sets the measurements to be used for further computation. The input can be either a list of MeasureFeatures objects or a dictionary with string keys and MeasureFeatures objects as values.
The method processes the given input to construct a dictionary mapping measurement names to MeasureFeatures instances. If a list is passed, unique class names of the MeasureFeatures instances in the list are used as keys.
- Parameters:
measurements (List[MeasureFeatures] | Dict[str, MeasureFeatures]) – A collection of measurement features either as a list of MeasureFeatures objects, where class names are used as keys for dictionary creation, or as a dictionary where keys are predefined strings and values are MeasureFeatures objects.
- Raises:
TypeError – If the measurements argument is neither a list nor a dictionary.
- set_model(model: ModelFitter | None) None#
Set the analysis endpoint model.
Only one model can be configured per pipeline; assigning a new value replaces any prior model. Pass
Noneto clear.- Parameters:
model (ModelFitter | None) – A
ModelFitterinstance, orNoneto clear.- Raises:
TypeError – If
modelis not aModelFitterinstance and notNone.- Return type:
None
- set_ops(ops: List[ImageOperation | ImagePipeline] | Dict[str, ImageOperation | ImagePipeline])#
Sets the operations to be performed. The operations can be passed as either a list of ImageOperation or ImagePipeline instances or a dictionary mapping operation names to ImageOperation or ImagePipeline instances. This method ensures that each operation in the list has a unique name. Raises a TypeError if the input is neither a list nor a dictionary.
- Parameters:
ops (List[ImageOperation | ImagePipeline] | Dict[str, ImageOperation | ImagePipeline]) – A list of ImageOperation or ImagePipeline objects, or a dictionary where keys are operation names and values are ImageOperation or ImagePipeline objects.
- Raises:
TypeError – If the input is not a list or a dictionary.
- set_post(post: List[PostMeasurement] | Dict[str, PostMeasurement])#
Set the post-measurement transforms.
- Parameters:
post (List[PostMeasurement] | Dict[str, PostMeasurement]) – A list or dictionary of PostMeasurement objects. If a list, class names are used as keys.
- Raises:
TypeError – If post is neither a list nor a dictionary.
- set_qc(qc: List[QcRecipeEntry] | None) None#
Set the QC config entry list.
Mirrors
set_post()/set_filters()but the QC section is an ordered list ofQcRecipeEntry(carrying stableinstance_id/enabledmetadata), not a name-keyed dict.
- to_json(filepath: str | Path | None = None) str | None#
Serialize the pipeline configuration to JSON format.
This method captures the pipeline’s operations and measurements. It excludes internal state (pydantic
PrivateAttrfields) and pandas DataFrames to keep the serialization clean and focused on reproducible configuration.- Parameters:
filepath (str | Path | None) – Optional path to save the JSON. If None, returns JSON string. Can be a string or Path object.
- Returns:
JSON string representation of the pipeline configuration.
- Return type:
Example
Serialize a pipeline to JSON format:
>>> from phenotypic import ImagePipeline >>> from phenotypic.detect import OtsuDetector >>> from phenotypic.measure import MeasureShape >>> pipe = ImagePipeline(pipe_cfgs=[OtsuDetector()], meas=[MeasureShape()]) >>> json_str = pipe.to_json() >>> pipe.to_json('my_pipeline') # Save to typed config file
- widget(image: Image | None = None, show: bool = False) Widget#
Return (and optionally display) the root widget.
- Parameters:
image (Image | None) – Optional image to visualize. If provided, visualization controls will be added to the widget.
show (bool) – Whether to display the widget immediately. Defaults to False.
- Returns:
The root widget.
- Return type:
ipywidgets.Widget
- Raises:
ImportError – If ipywidgets or IPython are not installed.
- ops: Dict[str, ImageOperation | 'ImagePipelineCore']#
- meas: Dict[str, MeasureFeatures]#
- post: Dict[str, PostMeasurement]#
- filters: Dict[str, SetAnalyzer]#
- model: ModelFitter | None#
- qc: List[QcRecipeEntry]#