Papers

Field

Top tools here

Open problems in Image segmentation

Lack of whole-slide image generation for histopathology1 paper raises it · 1 addresses it
Current generative models only produce small patches, but clinical labels and reports operate at the whole-slide level, limiting alignment with real-world supervision.
- BigCell: Generating Gigapixel Whole-Slide Imagesraises · addresses
Limited longitudinal multimodal reasoning benchmarks1 paper raises it · 1 addresses it
Most medical benchmarks assess reasoning over preselected evidence, not the ability to seek and integrate evidence across longitudinal clinical records and imaging.
- From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoningraises · addresses
Frozen models cannot learn from deployment experience1 paper raises it · 1 addresses it
Deployed models in medicine do not adapt to new clinical evidence or updated guidelines without retraining, which is often impractical.
- Frozen Models, Evolving Expertise: Model-Agnostic Learning from Deployment Experience for Multimodal Medical AIraises · addresses
Benchmark misalignment with real-world clinical use1 paper raises it · 1 addresses it
Public benchmarks often do not reflect the tasks, intents, or constraints of actual clinician queries, reducing their predictive value for deployment performance.
- Clinician use of language models diverges from how the models are evaluatedraises · addresses
Sensitivity to incidental information in clinical reasoning1 paper raises it · 1 addresses it
Models may incorporate or misattribute irrelevant details (e.g., small talk, background noise) in clinical documentation or reasoning, risking contamination.
- Large language models are vulnerable to incidental information in clinical documentation and reasoningraises · addresses

Named by an AI from these papers' abstracts.

Open problems

Recently funded

Topics in this field

image segmentation · volumetric · medical image403 papers59 this week
radiology report generation · medical vision language · vision language models127 papers38 this week
clinical reasoning · question answering · language models205 papers30 this week
patient history · clinical data · health records109 papers26 this week
eeg foundation models · electroencephalography eeg · eeg foundation155 papers24 this week
electrocardiogram ecg · electrocardiogram · ecgs145 papers15 this week

Topics in this field

Active contributors · 90 days

Active contributors

Activity · 12 weeks

Activity

Recent papers

All papers in Research

arXiv stat.MLSep 30
CAMOS: Coupled Oscillatory State-Space Model for Multimodal Clinical Time-Series
Maxx Richard Rahman, Mostafa Hammouda, Wolfgang Maass
Longitudinal clinical cohorts are multimodal, irregularly sampled and pervasively incomplete: in ADNI, positron emission tomography and cerebrospinal fluid assays are absent from roughly half of all visits. Linear state-space models handle irregular sampling gracefully but treat a missing modality by masking the input, leaving the transition operator untouched. We prove that this is a representational limitation: the latent state of any linear state-space layer whose transition operator does not depend on the availability pattern is an additive function of the availability indicators, so no such layer can represent an interaction between two modalities being jointly present or jointly absent. We propose CAMOS, which gives each modality a bank of second-order oscillators coupled through a matrix that sits inside the differential equation and is gated by availability, so the transition operator itself becomes a function of which measurements were taken. Coupling invalidates the analysis of uncoupled oscillatory models, and we restore it: a per-channel Gershgorin budget makes the effective stiffness positive definite uniformly over all $2^M$ availability patterns and all gaps, an…
PDF arXiv
arXiv cs.CVSep 30
Towards Trustworthy AI for Glioma Diagnosis: A Task-Aware Evaluation of Uncertainty Quantification
Gonzalo Esteban Mosquera Rojas, Sebastian R. van der Voort, Carolin M. Pirkl, Sandeep Kaushik, Marion Smits +1
Uncertainty Quantification (UQ) is a key requirement for trustworthy AI in high-stakes medical image analysis. In this work, we evaluate UQ in a multi-task Deep Learning framework for MRI-based glioma diagnosis that performs tumor segmentation and predicts IDH mutation status, 1p/19q co-deletion status, and tumor grade. Monte Carlo Dropout (MCD) is used for a detailed task-aware analysis of predictive, aleatoric, and epistemic uncertainty. We assess MC sample convergence, calibration, error detection, selective prediction, associations with segmentation performance, and the effect of voxel-wise uncertainty aggregation on case-level reliability. We also compare MCD with Deep Ensembles (DE) and Monte Carlo Deep Ensembles (MCDE), examine interactions between segmentation quality and classification, and evaluate a composite trust score integrating segmentation and classification uncertainty. Across tasks, uncertainty estimates supported meaningful error detection, while calibration depended on the dropout rate, with moderate rates yielding the most reliable probabilities. Uncertainty decomposition provided task-dependent interpretability but did not consistently improve error…
PDF arXiv
arXiv eess.IVSep 30
RIQE: a NIQE-style reference model for Computed Tomography
Fabio Mattiussi
The Natural Image Quality Evaluator (NIQE) scores an image by its statistical distance from a model fitted on pristine images, and its distributed model is fitted on photographs. We release the Radiology Image Quality Evaluator (RIQE), a NIQE-style model fitted on 3,792 full-dose slices from 158 patients of the public LDCT-and-Projection-data collection, with a declared intensity mapping, a manifest of every slice and a script that reproduces the fit. On 40 held-out patients, RIQE ranks reduced-dose reconstructions, simulated by projection-domain noise insertion, worse than the full-dose reconstruction of the same slice in 240 of 240 chest and 230 of 240 abdominal pairs, and ranks images with 20% more noise worse than their source in 97.5-100% of cases. Its preferences among filtered images, however, do not follow lesion signal. With a 4 mm, +10 HU lesion inserted in noisy abdominal slices, RIQE prefers bilateral filtering to the unfiltered image in every image up to a 32 HU residual, at which 29% of the lesion's matched-filter signal remains and its detectability index falls from 0.51 to 0.33; it never prefers Gaussian smoothing, which at the same 32 HU residual leaves 70% of…
PDF arXiv
arXiv cs.AISep 30
EHR-RobustGym: Benchmarking and Training Agents for Robust Clinical Reasoning
Yitong Qiao, Yancheng Jin, Lei Liu, Yue Shen, Jian Wang +2
In hospital workflows, electronic health records (EHRs) are often noisy, and may not contain the evidence needed to confirm events or measurements referenced in a clinical query. Even when database retrieval succeeds, clinical agents can overlook such discrepancies and return plausible but unsupported answers. We introduce EHR-RobustGym, a scalable and interactive environment for evaluating and training robust clinical agents grounded in noisy EHRs. Built on MIMIC-IV hospital records (365K patients, 31 tables, and over 500M records), EHR-RobustGym comprises 5,486 Clean-Noise pairs spanning six clinical intents and both patient-level and population-level queries. The pairs test robustness to Record-level, Value-level, and Query-level noise, while interactive SQL/Python execution and outcome verification support trajectory collection and training. Evaluating multiple LLMs reveals substantial robustness gaps: average task success across proprietary and large-scale open-weight models drops from 62.2% on Clean questions to 37.9% on Noise questions. At k=4, pass^k consistency falls below 50% for most evaluated models, exposing instability in clinical task completion. Supervised…
PDF arXiv
arXiv cs.LGSep 30
OmniMed-Jev: Calibrating LVLM Confidence for Trustworthy Medical Multimodal Decisions via System One
Luyao Tang, Cheng Chen
Medical models are judged not only on correctness, but on whether reported confidence matches actual accuracy. Generalist multimodal medical models have expanded what a single model can perceive, yet they still express bounded decisions such as diagnoses, findings or cell counts as generated text, so the reported probability reflects the next token rather than the decision itself. Motivated by decision-native interfaces such as Jev, we introduce OmniMed-Jev, which represents each medical decision as a Choice, Noul or Score decision over a runtime-supplied candidate set and returns a full distribution over that set: mutually exclusive classes, binary presence of a finding, or a bounded ordered value. The design is omni in three respects: it accepts diverse imaging modalities, covers different prediction tasks, and expresses them through one candidate-conditioned probability model, so heterogeneous outputs become comparable probabilities rather than task-specific strings. In an interface-controlled comparison against a generative baseline trained on the same backbone, data and schedule, OmniMed-Jev's reported probabilities track observed correctness far more closely, reducing…
PDF arXiv
arXiv cs.LGSep 30
Fusion techniques of time frequency-based images to predict the outcome of rTMS depression therapy
Wael Korani, Md Fahimul Kabir Chowdhury, Mohammed Aledhari, Reza Rostami, Reza Kazemi
Depression is a mental condition that can lead to suicide and self-harm. Predicting the outcome of depression treatment is one of the most difficult tasks for clinicians. Among various treatment options, repetitive Transcranial Magnetic Stimulation (rTMS) is a widely used non-invasive method. Predicting rTMS response using Electroencephalogram (EEG) data is difficult because of high inter-subject variability and limited features from single-domain analysis. We introduce two fusion techniques, montage and blending, to overcome these limitations and extract richer features from EEG-derived Time-Frequency (TF) images. We then propose a lightweight custom Convolutional Neural Network (CNN) trained on fused TF representations. \textcolor{black}{We use a primary dataset of 15 patients and a secondary dataset of 46 patients. We run two sets of experiments. The first set uses segment-level 10-fold cross-validation. In this setup segments from the same patient can appear in both training and testing. The Montage CWT\_ST fusion reaches 99.90\% accuracy on the primary dataset and 91.90\% on the secondary dataset. The second set uses strict subject-disjoint cross-validation. All segments of…
PDF arXiv

Papers

Topics in this field

image segmentation · volumetric · medical image403 papers59 this week
radiology report generation · medical vision language · vision language models127 papers38 this week
clinical reasoning · question answering · language models205 papers30 this week
patient history · clinical data · health records109 papers26 this week
eeg foundation models · electroencephalography eeg · eeg foundation155 papers24 this week
electrocardiogram ecg · electrocardiogram · ecgs145 papers15 this week

Active contributors · 90 days

Recent papers

All papers in Research

arXiv stat.MLSep 30
CAMOS: Coupled Oscillatory State-Space Model for Multimodal Clinical Time-Series
Maxx Richard Rahman, Mostafa Hammouda, Wolfgang Maass
Longitudinal clinical cohorts are multimodal, irregularly sampled and pervasively incomplete: in ADNI, positron emission tomography and cerebrospinal fluid assays are absent from roughly half of all visits. Linear state-space models handle irregular sampling gracefully but treat a missing modality by masking the input, leaving the transition operator untouched. We prove that this is a representational limitation: the latent state of any linear state-space layer whose transition operator does not depend on the availability pattern is an additive function of the availability indicators, so no such layer can represent an interaction between two modalities being jointly present or jointly absent. We propose CAMOS, which gives each modality a bank of second-order oscillators coupled through a matrix that sits inside the differential equation and is gated by availability, so the transition operator itself becomes a function of which measurements were taken. Coupling invalidates the analysis of uncoupled oscillatory models, and we restore it: a per-channel Gershgorin budget makes the effective stiffness positive definite uniformly over all $2^M$ availability patterns and all gaps, an…
PDF arXiv
arXiv cs.CVSep 30
Towards Trustworthy AI for Glioma Diagnosis: A Task-Aware Evaluation of Uncertainty Quantification
Gonzalo Esteban Mosquera Rojas, Sebastian R. van der Voort, Carolin M. Pirkl, Sandeep Kaushik, Marion Smits +1
Uncertainty Quantification (UQ) is a key requirement for trustworthy AI in high-stakes medical image analysis. In this work, we evaluate UQ in a multi-task Deep Learning framework for MRI-based glioma diagnosis that performs tumor segmentation and predicts IDH mutation status, 1p/19q co-deletion status, and tumor grade. Monte Carlo Dropout (MCD) is used for a detailed task-aware analysis of predictive, aleatoric, and epistemic uncertainty. We assess MC sample convergence, calibration, error detection, selective prediction, associations with segmentation performance, and the effect of voxel-wise uncertainty aggregation on case-level reliability. We also compare MCD with Deep Ensembles (DE) and Monte Carlo Deep Ensembles (MCDE), examine interactions between segmentation quality and classification, and evaluate a composite trust score integrating segmentation and classification uncertainty. Across tasks, uncertainty estimates supported meaningful error detection, while calibration depended on the dropout rate, with moderate rates yielding the most reliable probabilities. Uncertainty decomposition provided task-dependent interpretability but did not consistently improve error…
PDF arXiv
arXiv eess.IVSep 30
RIQE: a NIQE-style reference model for Computed Tomography
Fabio Mattiussi
The Natural Image Quality Evaluator (NIQE) scores an image by its statistical distance from a model fitted on pristine images, and its distributed model is fitted on photographs. We release the Radiology Image Quality Evaluator (RIQE), a NIQE-style model fitted on 3,792 full-dose slices from 158 patients of the public LDCT-and-Projection-data collection, with a declared intensity mapping, a manifest of every slice and a script that reproduces the fit. On 40 held-out patients, RIQE ranks reduced-dose reconstructions, simulated by projection-domain noise insertion, worse than the full-dose reconstruction of the same slice in 240 of 240 chest and 230 of 240 abdominal pairs, and ranks images with 20% more noise worse than their source in 97.5-100% of cases. Its preferences among filtered images, however, do not follow lesion signal. With a 4 mm, +10 HU lesion inserted in noisy abdominal slices, RIQE prefers bilateral filtering to the unfiltered image in every image up to a 32 HU residual, at which 29% of the lesion's matched-filter signal remains and its detectability index falls from 0.51 to 0.33; it never prefers Gaussian smoothing, which at the same 32 HU residual leaves 70% of…
PDF arXiv
arXiv cs.AISep 30
EHR-RobustGym: Benchmarking and Training Agents for Robust Clinical Reasoning
Yitong Qiao, Yancheng Jin, Lei Liu, Yue Shen, Jian Wang +2
In hospital workflows, electronic health records (EHRs) are often noisy, and may not contain the evidence needed to confirm events or measurements referenced in a clinical query. Even when database retrieval succeeds, clinical agents can overlook such discrepancies and return plausible but unsupported answers. We introduce EHR-RobustGym, a scalable and interactive environment for evaluating and training robust clinical agents grounded in noisy EHRs. Built on MIMIC-IV hospital records (365K patients, 31 tables, and over 500M records), EHR-RobustGym comprises 5,486 Clean-Noise pairs spanning six clinical intents and both patient-level and population-level queries. The pairs test robustness to Record-level, Value-level, and Query-level noise, while interactive SQL/Python execution and outcome verification support trajectory collection and training. Evaluating multiple LLMs reveals substantial robustness gaps: average task success across proprietary and large-scale open-weight models drops from 62.2% on Clean questions to 37.9% on Noise questions. At k=4, pass^k consistency falls below 50% for most evaluated models, exposing instability in clinical task completion. Supervised…
PDF arXiv
arXiv cs.LGSep 30
OmniMed-Jev: Calibrating LVLM Confidence for Trustworthy Medical Multimodal Decisions via System One
Luyao Tang, Cheng Chen
Medical models are judged not only on correctness, but on whether reported confidence matches actual accuracy. Generalist multimodal medical models have expanded what a single model can perceive, yet they still express bounded decisions such as diagnoses, findings or cell counts as generated text, so the reported probability reflects the next token rather than the decision itself. Motivated by decision-native interfaces such as Jev, we introduce OmniMed-Jev, which represents each medical decision as a Choice, Noul or Score decision over a runtime-supplied candidate set and returns a full distribution over that set: mutually exclusive classes, binary presence of a finding, or a bounded ordered value. The design is omni in three respects: it accepts diverse imaging modalities, covers different prediction tasks, and expresses them through one candidate-conditioned probability model, so heterogeneous outputs become comparable probabilities rather than task-specific strings. In an interface-controlled comparison against a generative baseline trained on the same backbone, data and schedule, OmniMed-Jev's reported probabilities track observed correctness far more closely, reducing…
PDF arXiv
arXiv cs.LGSep 30
Fusion techniques of time frequency-based images to predict the outcome of rTMS depression therapy
Wael Korani, Md Fahimul Kabir Chowdhury, Mohammed Aledhari, Reza Rostami, Reza Kazemi
Depression is a mental condition that can lead to suicide and self-harm. Predicting the outcome of depression treatment is one of the most difficult tasks for clinicians. Among various treatment options, repetitive Transcranial Magnetic Stimulation (rTMS) is a widely used non-invasive method. Predicting rTMS response using Electroencephalogram (EEG) data is difficult because of high inter-subject variability and limited features from single-domain analysis. We introduce two fusion techniques, montage and blending, to overcome these limitations and extract richer features from EEG-derived Time-Frequency (TF) images. We then propose a lightweight custom Convolutional Neural Network (CNN) trained on fused TF representations. \textcolor{black}{We use a primary dataset of 15 patients and a secondary dataset of 46 patients. We run two sets of experiments. The first set uses segment-level 10-fold cross-validation. In this setup segments from the same patient can appear in both training and testing. The Montage CWT\_ST fusion reaches 99.90\% accuracy on the primary dataset and 91.90\% on the secondary dataset. The second set uses strict subject-disjoint cross-validation. All segments of…
PDF arXiv

Activity · 12 weeks

Open problems in Image segmentation

Lack of whole-slide image generation for histopathology1 paper raises it · 1 addresses it
Current generative models only produce small patches, but clinical labels and reports operate at the whole-slide level, limiting alignment with real-world supervision.
- BigCell: Generating Gigapixel Whole-Slide Imagesraises · addresses
Limited longitudinal multimodal reasoning benchmarks1 paper raises it · 1 addresses it
Most medical benchmarks assess reasoning over preselected evidence, not the ability to seek and integrate evidence across longitudinal clinical records and imaging.
- From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoningraises · addresses
Frozen models cannot learn from deployment experience1 paper raises it · 1 addresses it
Deployed models in medicine do not adapt to new clinical evidence or updated guidelines without retraining, which is often impractical.
- Frozen Models, Evolving Expertise: Model-Agnostic Learning from Deployment Experience for Multimodal Medical AIraises · addresses
Benchmark misalignment with real-world clinical use1 paper raises it · 1 addresses it
Public benchmarks often do not reflect the tasks, intents, or constraints of actual clinician queries, reducing their predictive value for deployment performance.
- Clinician use of language models diverges from how the models are evaluatedraises · addresses
Sensitivity to incidental information in clinical reasoning1 paper raises it · 1 addresses it
Models may incorporate or misattribute irrelevant details (e.g., small talk, background noise) in clinical documentation or reasoning, risking contamination.
- Large language models are vulnerable to incidental information in clinical documentation and reasoningraises · addresses

Named by an AI from these papers' abstracts.

Fields · AI · updated 12m ago

Image segmentation

Found by the topic model: image segmentation, clinical reasoning, eeg foundation models.

192papers this week−7.2% vs last week

All papers · 1.1k With code · 4

Newest Most relevant

1k papers this month