Master Thesis – Enhanced Reasoning in Vision-Language Models Using Structured Visual Representations

Job Title Master Thesis – Enhanced Reasoning in Vision-Language Models Using Structured Visual Representations Job Description Category Machine Learning, Computer Vision, Computer Science Scope 2 Master students, 30 hp each Background Vision-Language Models (VLMs) have demonstrated strong capabilities in combining visual information with natural-language reasoning. However, most VLMs perform their reasoning primarily in the language space after encoding the visual input, which can make it difficult to explicitly preserve and access fine-grained visual information such as object locations, identities, shapes, and movements. Structured visual representations could provide additional information that the model can utilize throughout its reasoning process.…