ZurichCV #5

Julian Eisenschlos (from Google Deepmind) will talk about: "Visual language: how generation can drive understanding of charts and plots"

"Large amounts of content both online and offline relies on structure to organize and communicate information more effectively. While natural image understanding and generation has been studied extensively, visually situated language such as tables, charts, plots, and infographics, continues to be a challenge for models large and small. In this talk we will show how teaching models to generate visually situated language can improve downstream reading and reasoning on this data modality for tasks such as question answering, entailment and summarization."

Anton Obukhov (from ETH Zurich) will talk about "Beyond Astronaut on a Horse: Repurposing Text-to-Image Models". 

"Stable Diffusion has garnered significant attention from the vision community, artists, and content creators. Its widespread adoption stems from notable enhancements in generation quality, versatile conditioning across different modalities, and the availability of open-source models. In this talk, we will initially explore…