Skip to content

Estimation of state degeneracy - panel "Kinetic model" - 2D-vbFRET - Linux compatibility - divers bug fixes#74

Merged
pflanzenhueter merged 214 commits into
masterfrom
MASH-FRET-1.3.2
Sep 20, 2021
Merged

Estimation of state degeneracy - panel "Kinetic model" - 2D-vbFRET - Linux compatibility - divers bug fixes#74
pflanzenhueter merged 214 commits into
masterfrom
MASH-FRET-1.3.2

Conversation

@mca-sh
Copy link
Copy Markdown
Collaborator

@mca-sh mca-sh commented Feb 2, 2021

Here is a release note:

New functionalities

  • Estimation of state degeneracy via exponential fit allows to estimate the optimum fitting model complexity and perform bootstrap fit for all dwell time histograms in one click. Please refer to the dedicated doc sections Workflow and Dwell time histograms for more information.

  • Estimation of state degeneracy via DPH selection allows to obtain an optimum configuration of states including state degeneracy by performing BIC-based model selection on discrete-phase type distributions. Please refer to the dedicated doc sections Workflow and Kinetic model for more information.

    pullrequ-mash-132-04

  • Kinetic model: This new panel belongs to module Transition analysis and allows to infer the most probable transition rate matrix and associated errors for a given state configuration. It uses the state configuration established from TDP clustering and state degeneracy analysis, and applies the Baum-Welch algorithm to infer the transition probabilities. A set of state sequences is simulated a posteriori to compare with experimental dwell times and validate the given kinetic model. Please refer to the dedicated doc sections Workflow and Kinetic model for more information.

    pullrequ-mash-132-01

Fixed bugs

Routines

Interface testing
  • correct testing of project merging

Simulation

  • correct yes/no typo in simulation logs

Video processing

  • fix error occurring when importing a .gif file

Trace processing

Project management
  • fix error occurring when importing FRET state sequences for more than 1 pair
  • correct import of project-associated video (was ignored due to an error in file path)
Single molecule images
  • fix error occurring when refocusing on a video that has an uneven number of frames
Plot
  • correct empty plot when importing one ASCII file

Transition analysis

State configuration
  • correct axes limits when only one BIC value was inferred

Improvements

General

  • make compatible with Linux Ubuntu 20.04 distribution

Video processing

Edit and export video
  • make unavailable the image filters that use the ITALS library (MATLAB freezes every time: there's an issue with the library)

Routines

Kinsoft challenge analysis
  • adapt the Kinsoft challenge analysis routine to the new kinetic model analysis

  • adapt the Kinsoft challenge analysis routine to known number of states and/or non-gaussian noise

    pullrequ-mash-132-02 pullrequ-mash-132-03

Simulation

Export options

Trace processing

Project management
  • improve communication by handling ill-sized project
Find states
  • improve deblurr option by only removing the 1-data-point dwell dwell times that are caught between a higher and a lower state values
  • add method vbFRET-2D which analyze donor and acceptor intensity as 2D data

Transition analysis

Export
State configuration
  • modify GUI to add a "Set" button in order to pick a color for the current cluster (as a replacement to the old *Transition" list)

    pullrequ-mash-132-05

Dwell time histograms
  • modify GUI to transform the old "State transition rates" panel into the "Dwell time histogram" panel

  • modify parameter structure to store fit parameters for each and all state transitions (fields kin_start and kin_res become lft_start and lft_res to identify the rupture in down-compatibility)

  • make available the option to bin state values after clustering

  • improve workflow by making the option to exclude/include first & last dwell times available as a general checkbox rather than in a fit-specific popup

    pullrequ-mash-132-06

Kinetic model
  • improve transformation from dwell times in state sequences by taking into account time averaging

mca-sh added 30 commits October 16, 2020 12:49
The new kinetic analysis intend to:
1) resolve models with degenerated states
2) use the HMM state definition:  single lifetime for each state and different transition probabilities
3) export the whole model with proper transition rate constants

- **modify GUI** to separate  the "State transition rates" panel into "State lifetimes" and "Kinetic model"
- **modify parameter structure** according to the kinetic analysis new procedure
- **adapt** dwell time histogram fitting to new procedure (fit all dwell times to get the lifetimes and transition-specific dwell times to estimate the transition probabilities)
- **make available** the option to bin state values after clustering
- **improve communication** by offering the option to exclude/include  first & last dwell times as a general checkbox rather than in a fit-specific popup
- **Automated dwell time histogram fitting** allows to fit all data in one click: estimates automatically the optimum number of exponential decays in the model and perform subsequently the model optimization for a particular state (Fit current) or for each of the dwell time histograms (Fit all)
- **Estimation of the final kinetic model** allows to obtain an optimum configuration of states and state transitions for the data: optimizes the transition probabilities by comparing experimental distributions and number of transitions with simulation.
- **modify GUI** to add a "Set" button in order to pick a color for the current cluster
- **improve** exponential fit by using amplitudes normalized by the sum and managing infinitely negative gof
- **manage error** occurring when using processing an ill-sized project
- **fix error** occurring when refocusing on a video that has an uneven number of frames
- **improve** state sequence calcualtion from dwell times by taking into accoutnt ime averaging
- **correct** axes limits when only one BIC value was inferred
save function to separate file (commited previously)
- **fix error** occurring when importing FRET state sequences for more than 1 pair
Calculate state sequences from dwell times and pass it to model optimization
create backup ot kinMdlGOF
- compare experimental state sequences to one large simulated sequence with countSeqProb
- compare experimental state sequences to one large simulated sequence with calcSeqError
- calculate forward probabilities (works well!)
- **correct** how intensities ae improted from ASCII files
use frame-wise simulation instead of dwell time wise and return initial state probabibilties (used for forward ptobabilities calculatons)
correct variable name "rate" into "expT"
adapt script to dwell time matrix having 4 columns
always use crosshair cursor on TDP axes
manage the visibility of the crosshair cursor coordinates on TDP
display logs when starting MASH
update script spec
@mca-sh mca-sh added new functionality add a new functionality to MASH-FRET bugfix Bugs were fixed improvement Improve existing functionalities, scripts or workflow labels Feb 2, 2021
@mca-sh mca-sh requested a review from pflanzenhueter February 2, 2021 22:05
@mca-sh mca-sh assigned mca-sh and unassigned mca-sh Feb 2, 2021
@pflanzenhueter pflanzenhueter merged commit b7db508 into master Sep 20, 2021
@mca-sh mca-sh deleted the MASH-FRET-1.3.2 branch April 15, 2022 14:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bugfix Bugs were fixed improvement Improve existing functionalities, scripts or workflow new functionality add a new functionality to MASH-FRET

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants