Hero Image
Slice of AI 3 - Bridging Worlds - Recent advances in Multi-modal AI

Paper presentation and discussion session, organized by Stockholm AI and Silo AI, with the topic of Multi-modal AI. This session was moderated by Pier Luigi Dovesi and I was the main speaker. I started the presentation with an introduction of multi-modal models using the transformer architecture to then deep dive into two recent papers: CogVLM: Visual Expert for Pretrained Language Models (https://lnkd.in/dPaB946G) mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaboration (https://lnkd.in/dGiGPrmP) A Q&A session followed the presentation.

Thursday, April 11, 2024 | 1 minute Read
Hero Image
Dreamhack 2023 Talk

The presentation was about how we are using AI at Embark Studios to make video game characters come alive. We are using Reinforcement Learning to make our characters move in a physically-based environment, so that we don’t have to make complicated animations like it is traditionally done in video games. We also want interactions with our characters to be unique and flexible, so we are using Language Models to do that. We create a text representation of the world around our characters and we use it together with the user input to prompt a fine-tuned language model to generate a response. In this way our characters can respond to user’s questions in a relevant and entartaining way. Event URL: https://linkopingsciencepark.se/event/ai-session-dreamhack-ai-for-game-development-and-beyond/

Friday, June 16, 2023 | 1 minute Read
Hero Image
Everything Procedural 2024 Talk

Presented at the Everything Procedural 2024 conference in Breda(NL) how we are using AI at Embark Studios to make video game characters come alive. Event URL: https://www.everythingprocedural.com/ Presentation recording: https://www.youtube.com/watch?v=aOkw4aCo9Ro We would like the interactions with our characters to be unique and flexible, so we are using Language Models to do that. We create a text representation of the world around our characters and we use it together with the user input to prompt a fine-tuned language model to generate a response. In this way our characters can respond to user’s questions in a relevant and entartaining way.

Friday, June 16, 2023 | 1 minute Read