Papers

Field

Top tools here

Open problems in 3D scene

3D consistency in generated scenes3 papers raise it · 3 address it
Generated videos and scenes often lack geometric and multi-view consistency, breaking immersion and realism.
- OuroWorld: Bringing Any 3D World Alive as Diverse, Endlessly Looping 3D Cinemagraphsraises · addresses
- Orbia: Do Generated Videos Form a Consistent 3D World?raises · addresses
- GeoFix: Geometry Fixing for 4D Consistent Generationraises · addresses
High-quality novel view synthesis under large viewpoint changes3 papers raise it · 3 address it
Feed-forward methods struggle to render high-quality scenes when camera poses differ significantly from training views.
- InfiniSplat v2: Analyzing and Improving Feed-Forward 3DGS from Any Viewsraises · addresses
- LEGO: A Lifting-Free Approach for Exocentric-to-Egocentric Video Generationraises · addresses
- NAMVIS: Next-Scale Autoregressive Multi-View Image Synthesisraises · addresses
Physics and geometry coherence in scene generation1 paper raises it · 1 addresses it
Generated 3D scenes often lack physically plausible object interactions and spatial compatibility.
- Tetris3D: 3D Scene Generation With Objects That Fit Togetherraises · addresses
Dense correspondence matching beyond rigid motion1 paper raises it · 1 addresses it
Existing correspondence methods fail when transformations break physical continuity but preserve identity.
- Beyond Spatio-Temporal Priors: A Generalizable Approach for Dense Correspondence Matchingraises · addresses
Metric distance estimation in 3D reconstruction1 paper raises it · 1 addresses it
Current benchmarks do not directly evaluate point-to-point distance accuracy in reconstructed 3D geometry.
- Pumpire: Unified Benchmark for Metric Distance Estimationraises · addresses

Named by an AI from these papers' abstracts.

Open problems

Recently funded

Topics in this field

3d scene · 3d reconstruction · depth estimation262 papers44 this week
gaussian splatting 3dgs · 3d gaussian splatting · feed forward 3d209 papers40 this week
remote sensing · satellite imagery · earth observation127 papers25 this week
small target detection · infrared small target · target detection114 papers21 this week
point cloud registration · 3d point clouds · point cloud69 papers19 this week
camera lidar · 3d object detection · point clouds95 papers14 this week

Topics in this field

Active contributors · 90 days

Active contributors

Activity · 12 weeks

Coming with more sources: repos

Activity

Recent papers

All in Research →

arXiv cs.LGOct 13
Exploring Interpretability in Deep Learning-Based Forest Classification - Separating Similar Forest Classes using Sentinel-2 Time Series
Maximilian Kirsch, Christine Preisach
The ecological insurance theory posits that diverse forests are more resilient and better able to adapt to changing environmental conditions. Increasing drought and heat stress in Central Europe promotes mixed forests for maintaining ecosystem services. However, a diverse species distribution complicates remote sensing-based species mapping, as distinguishing pure from mixed species compositions at the pixel level remains challenging. We evaluated the potential of recurrent neural networks (RNNs) for tree-species classification from Sentinel-2 time series and investigated the spectral-temporal features underlying class discrimination, with particular emphasis on separating pure from mixed Norway spruce pixels. We compared RNN classification models with Random Forest (RF) and Extreme Gradient Boosting (XGBoost) and used Integrated Gradients (IG) to quantify feature attributions across spectral bands and time. The best-performing RNN achieved a Macro-F1 score of 0.851 on the test data, outperforming XGBoost by 0.012 and Random Forest by 0.103. Beyond classification performance, the attribution analysis revealed distinct spectral-temporal patterns associated with the separation of…
PDF arXiv
arXiv cs.CVOct 13
LAMP: 3D Source-Aware Lighting Estimation at Multiple Points
Yanqiao Wang, Jin Sun
Existing illumination estimation methods primarily recover lighting distributions for rendering, but typically leave the contributions of individual physical light sources at specific scene locations implicit. We address this gap by leveraging the scene understanding capabilities of vision-language models (VLMs) to connect local illumination with its physical sources. We introduce LAMP, a framework for point-conditioned, source-aware illumination reasoning from a single RGB image with marked query points. LAMP constructs a shared inventory of active light sources, ranks contributing sources for each query, and predicts their 3D query-to-source directions. We supervise these relationships using procedurally controlled indoor scenes, reusing independently rendered source responses to derive contribution targets across lighting configurations and obtaining exact directions from source and query positions. On the Infinigen test set, fine-tuning Qwen3-VL-8B increases dominant-source 3D PCK@0.5m from 0% to 70.6%, with 94.5% of directions within 12.5 degrees of ground truth among correctly localized sources. Combined with a lightweight network predicting dense RGB irradiance, LAMP…
PDF arXiv
arXiv cs.CVOct 13
Into the LidarVerse: A Real-Time Unified LiDAR World Model Across Tasks and Sensors
Henry Che, Xuanchi Ren, Sanja Fidler, Shenlong Wang, Laura Leal-Taixé +1
We present LidarVerse, a real-time unified LiDAR world model for sensor simulation across tasks and sensors. Existing LiDAR simulators largely follow one of two complementary paradigms: reconstruction-based methods preserve the geometry of a captured scene but require lengthy per-scene optimization, whereas generative methods amortize learning across data but lack the consistency needed for long-horizon rollouts. LidarVerse brings both paradigms into a single, unified conditional generative framework. A universal tokenizer maps LiDAR range sequences into a shared latent space, where a bidirectional teacher learns a common interface for conditioning on a LiDAR prefix, an HD-Map, a persistent spatial cache, and optionally, text. Varying the available scene evidence turns the same model into a generator of new worlds, a point-cloud forecaster, or a generalizable resimulator of observed scenes without per-scene optimization. We distill the teacher into a four-step autoregressive causal student and maintain both a rolling temporal K/V cache and a world-aligned spatial cache, enabling persistent long-horizon rollouts with real-time inference at 11 FPS on a single H100 GPU. LidarVerse…
PDF arXiv
arXiv cs.LGOct 13
FireGraphNet: Sub-daily wildfire spread prediction with directed graph neural networks
Aiyshwariya Paulvannan Kanmani, Miguel Esparza, Ali Mostafavi
Wildfire decisions are made in hours, yet most learned spread models predict daily on targets including burned area. We propose FireGraphNet which formulates 12-hour growth as node classification on directed H3 graphs, with candidates ahead of the front and wind alignment, terrain, fuel continuity and barriers on edges. On satellite perimeters it achieves average precision 1.7-1.9x the strongest distance baseline on test California fires and 1.62x out of state. We show this skill comes from message passing rather than cell features or the aggregator, is highest on young fires in state, is carried deep along the wind by its edges, and is hidden by pooling. A convolutional network matches this ranking once trained on new growth, at worse calibration, so candidate construction, target definition, and aggregation shape conclusions about model skill. Editing fuel and barrier attributes reduces predicted spread more under guided than random placement, extending FireGraphNet to operational intervention analysis.
PDF arXiv
arXiv cs.ROOct 13
Learning in Orbit: Onboard Training and Closed-Loop Attitude Control with a Thermal Segmentation Model on a Spacecraft
Elena Sorina Lupu, Hannah Grauer, Phaedrus Leeds, Nikhil Ranganathan, Connor Lee +7
Deep space missions increasingly require spacecraft capable of autonomously operating in environments with communication delays and bandwidth limitations. A key enabler of such autonomy is the ability to run learning-based algorithms directly onboard. In this work, we present a flight deployment on a 6U CubeSat that demonstrates (1) onboard training and inference of a thermal segmentation model on an NVIDIA Jetson TX2 NX GPU in space and (2) closed-loop attitude control using the segmentation model on a real-time, thermal image feed to track the Moon. In addition to this demonstration, we implement ROS 2 Foxy as a data transport middleware and integrate an open-source file system that provides strong data integrity guarantees and self-healing features. Over the course of approximately one year, we performed 12 experiments on the spacecraft, advancing the state of the art in autonomous spacecraft systems by showing how modern learning-based pipelines, commercially available hardware, and open-source software can operate reliably under the compute and environmental constraints of Low Earth Orbit (LEO).
PDF arXiv
arXiv cs.CVOct 13
MonoMIP: Multi-Height Inverse Perspective Mapping for Monocular 3D Object Detection
Emir Ulurak, Furkan Kıraç
Monocular 3D object detection methods increasingly rely on depth-guided transformers, but they operate entirely in the perspective image plane where spatial relationships are distorted by foreshortening. We propose MonoMIP, a dual-decoder framework that adds complementary 3D geometric reasoning through Bird's-Eye View (BEV) features constructed via Multi-Height Inverse Perspective Mapping. We perform IPM at K elevation planes spanning ground to rooftop, producing an ordered stack of height-conditioned metric BEV features that reduces above-ground misprojection and exposes depth-dependent appearance variation across planes. A BEV decoder with multi-scale deformable attention aggregates this multi-height evidence per query, while a depth-guided 3D decoder provides complementary perspective-space predictions. Without extra training data, MonoMIP attains 25.84% Moderate AP3D|R40 on KITTI val and 21.66% on the official test set for Car, outperforming recent published monocular methods on both the KITTI and Waymo benchmarks.
PDF arXiv

Papers

Topics in this field

3d scene · 3d reconstruction · depth estimation262 papers44 this week
gaussian splatting 3dgs · 3d gaussian splatting · feed forward 3d209 papers40 this week
remote sensing · satellite imagery · earth observation127 papers25 this week
small target detection · infrared small target · target detection114 papers21 this week
point cloud registration · 3d point clouds · point cloud69 papers19 this week
camera lidar · 3d object detection · point clouds95 papers14 this week

Active contributors · 90 days

Recent papers

All in Research →

arXiv cs.LGOct 13
Exploring Interpretability in Deep Learning-Based Forest Classification - Separating Similar Forest Classes using Sentinel-2 Time Series
Maximilian Kirsch, Christine Preisach
The ecological insurance theory posits that diverse forests are more resilient and better able to adapt to changing environmental conditions. Increasing drought and heat stress in Central Europe promotes mixed forests for maintaining ecosystem services. However, a diverse species distribution complicates remote sensing-based species mapping, as distinguishing pure from mixed species compositions at the pixel level remains challenging. We evaluated the potential of recurrent neural networks (RNNs) for tree-species classification from Sentinel-2 time series and investigated the spectral-temporal features underlying class discrimination, with particular emphasis on separating pure from mixed Norway spruce pixels. We compared RNN classification models with Random Forest (RF) and Extreme Gradient Boosting (XGBoost) and used Integrated Gradients (IG) to quantify feature attributions across spectral bands and time. The best-performing RNN achieved a Macro-F1 score of 0.851 on the test data, outperforming XGBoost by 0.012 and Random Forest by 0.103. Beyond classification performance, the attribution analysis revealed distinct spectral-temporal patterns associated with the separation of…
PDF arXiv
arXiv cs.CVOct 13
LAMP: 3D Source-Aware Lighting Estimation at Multiple Points
Yanqiao Wang, Jin Sun
Existing illumination estimation methods primarily recover lighting distributions for rendering, but typically leave the contributions of individual physical light sources at specific scene locations implicit. We address this gap by leveraging the scene understanding capabilities of vision-language models (VLMs) to connect local illumination with its physical sources. We introduce LAMP, a framework for point-conditioned, source-aware illumination reasoning from a single RGB image with marked query points. LAMP constructs a shared inventory of active light sources, ranks contributing sources for each query, and predicts their 3D query-to-source directions. We supervise these relationships using procedurally controlled indoor scenes, reusing independently rendered source responses to derive contribution targets across lighting configurations and obtaining exact directions from source and query positions. On the Infinigen test set, fine-tuning Qwen3-VL-8B increases dominant-source 3D PCK@0.5m from 0% to 70.6%, with 94.5% of directions within 12.5 degrees of ground truth among correctly localized sources. Combined with a lightweight network predicting dense RGB irradiance, LAMP…
PDF arXiv
arXiv cs.CVOct 13
Into the LidarVerse: A Real-Time Unified LiDAR World Model Across Tasks and Sensors
Henry Che, Xuanchi Ren, Sanja Fidler, Shenlong Wang, Laura Leal-Taixé +1
We present LidarVerse, a real-time unified LiDAR world model for sensor simulation across tasks and sensors. Existing LiDAR simulators largely follow one of two complementary paradigms: reconstruction-based methods preserve the geometry of a captured scene but require lengthy per-scene optimization, whereas generative methods amortize learning across data but lack the consistency needed for long-horizon rollouts. LidarVerse brings both paradigms into a single, unified conditional generative framework. A universal tokenizer maps LiDAR range sequences into a shared latent space, where a bidirectional teacher learns a common interface for conditioning on a LiDAR prefix, an HD-Map, a persistent spatial cache, and optionally, text. Varying the available scene evidence turns the same model into a generator of new worlds, a point-cloud forecaster, or a generalizable resimulator of observed scenes without per-scene optimization. We distill the teacher into a four-step autoregressive causal student and maintain both a rolling temporal K/V cache and a world-aligned spatial cache, enabling persistent long-horizon rollouts with real-time inference at 11 FPS on a single H100 GPU. LidarVerse…
PDF arXiv
arXiv cs.LGOct 13
FireGraphNet: Sub-daily wildfire spread prediction with directed graph neural networks
Aiyshwariya Paulvannan Kanmani, Miguel Esparza, Ali Mostafavi
Wildfire decisions are made in hours, yet most learned spread models predict daily on targets including burned area. We propose FireGraphNet which formulates 12-hour growth as node classification on directed H3 graphs, with candidates ahead of the front and wind alignment, terrain, fuel continuity and barriers on edges. On satellite perimeters it achieves average precision 1.7-1.9x the strongest distance baseline on test California fires and 1.62x out of state. We show this skill comes from message passing rather than cell features or the aggregator, is highest on young fires in state, is carried deep along the wind by its edges, and is hidden by pooling. A convolutional network matches this ranking once trained on new growth, at worse calibration, so candidate construction, target definition, and aggregation shape conclusions about model skill. Editing fuel and barrier attributes reduces predicted spread more under guided than random placement, extending FireGraphNet to operational intervention analysis.
PDF arXiv
arXiv cs.ROOct 13
Learning in Orbit: Onboard Training and Closed-Loop Attitude Control with a Thermal Segmentation Model on a Spacecraft
Elena Sorina Lupu, Hannah Grauer, Phaedrus Leeds, Nikhil Ranganathan, Connor Lee +7
Deep space missions increasingly require spacecraft capable of autonomously operating in environments with communication delays and bandwidth limitations. A key enabler of such autonomy is the ability to run learning-based algorithms directly onboard. In this work, we present a flight deployment on a 6U CubeSat that demonstrates (1) onboard training and inference of a thermal segmentation model on an NVIDIA Jetson TX2 NX GPU in space and (2) closed-loop attitude control using the segmentation model on a real-time, thermal image feed to track the Moon. In addition to this demonstration, we implement ROS 2 Foxy as a data transport middleware and integrate an open-source file system that provides strong data integrity guarantees and self-healing features. Over the course of approximately one year, we performed 12 experiments on the spacecraft, advancing the state of the art in autonomous spacecraft systems by showing how modern learning-based pipelines, commercially available hardware, and open-source software can operate reliably under the compute and environmental constraints of Low Earth Orbit (LEO).
PDF arXiv
arXiv cs.CVOct 13
MonoMIP: Multi-Height Inverse Perspective Mapping for Monocular 3D Object Detection
Emir Ulurak, Furkan Kıraç
Monocular 3D object detection methods increasingly rely on depth-guided transformers, but they operate entirely in the perspective image plane where spatial relationships are distorted by foreshortening. We propose MonoMIP, a dual-decoder framework that adds complementary 3D geometric reasoning through Bird's-Eye View (BEV) features constructed via Multi-Height Inverse Perspective Mapping. We perform IPM at K elevation planes spanning ground to rooftop, producing an ordered stack of height-conditioned metric BEV features that reduces above-ground misprojection and exposes depth-dependent appearance variation across planes. A BEV decoder with multi-scale deformable attention aggregates this multi-height evidence per query, while a depth-guided 3D decoder provides complementary perspective-space predictions. Without extra training data, MonoMIP attains 25.84% Moderate AP3D|R40 on KITTI val and 21.66% on the official test set for Car, outperforming recent published monocular methods on both the KITTI and Waymo benchmarks.
PDF arXiv

Activity · 12 weeks

Coming with more sources: repos

Fields · AI · updated 33m ago

3D scene

Found by the topic model: 3d scene, gaussian splatting 3dgs, remote sensing.

163papers this week−11.4% vs last week

All papers · 876 With code · 26

Newest Most relevant

810 papers this month

Open problems in 3D scene

3D consistency in generated scenes3 papers raise it · 3 address it
Generated videos and scenes often lack geometric and multi-view consistency, breaking immersion and realism.
- OuroWorld: Bringing Any 3D World Alive as Diverse, Endlessly Looping 3D Cinemagraphsraises · addresses
- Orbia: Do Generated Videos Form a Consistent 3D World?raises · addresses
- GeoFix: Geometry Fixing for 4D Consistent Generationraises · addresses
High-quality novel view synthesis under large viewpoint changes3 papers raise it · 3 address it
Feed-forward methods struggle to render high-quality scenes when camera poses differ significantly from training views.
- InfiniSplat v2: Analyzing and Improving Feed-Forward 3DGS from Any Viewsraises · addresses
- LEGO: A Lifting-Free Approach for Exocentric-to-Egocentric Video Generationraises · addresses
- NAMVIS: Next-Scale Autoregressive Multi-View Image Synthesisraises · addresses
Physics and geometry coherence in scene generation1 paper raises it · 1 addresses it
Generated 3D scenes often lack physically plausible object interactions and spatial compatibility.
- Tetris3D: 3D Scene Generation With Objects That Fit Togetherraises · addresses
Dense correspondence matching beyond rigid motion1 paper raises it · 1 addresses it
Existing correspondence methods fail when transformations break physical continuity but preserve identity.
- Beyond Spatio-Temporal Priors: A Generalizable Approach for Dense Correspondence Matchingraises · addresses
Metric distance estimation in 3D reconstruction1 paper raises it · 1 addresses it
Current benchmarks do not directly evaluate point-to-point distance accuracy in reconstructed 3D geometry.
- Pumpire: Unified Benchmark for Metric Distance Estimationraises · addresses

Named by an AI from these papers' abstracts.