Latest Projects
Master Thesis: Explainable Multimodal 3D Object Detection for Autonomous vehicles.
![Screenshot from 2024-05-02 21-41-20.png](https://static.wixstatic.com/media/b16149_69ca90cdf0094e32b091a4aa834e36d0~mv2.png/v1/fill/w_276,h_155,al_c,q_85,usm_0.66_1.00_0.01,enc_auto/Screenshot%20from%202024-05-02%2021-41-20.png)
Safe and effective autonomous vehicles rely heavily on advanced multi-modal perception systems. This thesis proposes the development of such a system, with a focus on explainability. The goal is to understand the system’s reasoning behind its predictions and to enhance its interpretability for various stakeholders.
Detection using transformers can capture global context using the attention mechanisms. These architectures not only provide more concise detection results, but also allow to extract the attention weights as source of explainability. The basis of this thesis are an existing transformer-based 3D object detector for LiDAR point clouds and existing 2D object detectors for multi-view cameras.
I will be adding more details as the thesis during the course of the thesis.
TerraWatch: Multimodal AI for Deforestation Detection
![satelllite_segment.png](https://static.wixstatic.com/media/b16149_8e5c6517daf94b868c44160d6b2d788a~mv2.png/v1/fill/w_36,h_36,al_c,q_85,usm_0.66_1.00_0.01,blur_2,enc_auto/satelllite_segment.png)
TerraWatch combines computer vision with multimodal LLM models to detect deforestation from satellite images and predict their causes and possible environmental effects.
This was a prototype that was built in 48 hours during the TUM AI Hackathon 2024. Further contributions are welcome.