Curated for content, computing, and digital experience professionals

Day: September 25, 2024

Ai2 launches family of open multimodal models

The Allen Institute for AI (Ai2) announced the launch of Molmo, a family of state-of-the-art multimodal models. This family includes our best Molmo model, closing the gap between close and open models, an open, efficient, and powerful multimodal model. Currently, most advanced multimodal models can perceive the world and communicate with us, Molmo goes beyond that to enable one to act in their worlds, unlocking a new generation of capabilities, from sophisticated web agents to robotics:

  • Exceptional image understanding: Molmo can accurately understand a wide range of visual data, from everyday objects and signs to complex charts, messy whiteboards, clocks, and menus.
  • Actionable insights: To bridge the gap between perception and action, Molmo models can point to what they perceive, empowering capabilities that require spatial knowledge. Molmo can point to UI elements on the screen, enabling developers to build web agents or robots that can navigate complex interactions on screen and within the real-world.

Molmo was designed and built in the open and Ai2 will be releasing all model weights, captioning and fine-tuning data, and source code. Select model weights, inference code, and demo are available, providing open access to enable continued research and innovation in the AI community.

https://molmo.allenai.org/blog

Gilbane Advisor 9-25-24 — CORE-Bench, dynamic knowledge graphs

This week we feature articles from Amanda Kau, and Sayash Kapoor & Arvind Narayanan.

Additional reading comes from Ben Dickson, Fulala Fulalasen, Cassie Kozyrkov, and Paul Sawers.

News comes from Brightspot, Adobe, Hubspot, and DeepL.

Our next issue will arrive October  2.

All previous issues are available at https://gilbane.com/gilbane-advisor-index


Opinion / Analysis

Can AI automate computational reproducibility?

Sayash Kapoor and Arvind Narayanan tackle a critical issue…
“In a new paper, we introduce CORE-Bench (Computational Reproducibility Agent Benchmark), a benchmark for measuring how well AI can automate computational reproducibility, that is, reproducing a paper’s findings when the code and data are available.”

Introduction: (5 min) 
https://www.aisnakeoil.com/p/can-ai-automate-computational-reproducibility
Full paper:
PDF: https://arxiv.org/pdf/2409.11363v1
HTML: https://arxiv.org/html/2409.11363v1

Dynamic knowledge graphs: a next step for data representation?

How do you integrate temporal data into knowledge graphs? What’s the difference between dynamic knowledge graphs, temporal knowledge graphs, and discrete time dynamic graphs? What kinds of applications are they used for? And how do they work, or compete with, LLMs? Amanda Kau does a nice job addressing these and other questions. (9 min)

https://medium.com/@researchgraph/dynamic-knowledge-graphs-a-next-step-for-data-representation-c35a205a520a

More Reading

All Gilbane Advisor issues


Content technology news

Brightspot announces latest version of their content management system

Updated CMS has expansive tech stack integrations, AI features that speed up creation time, and prioritizes streamlined content workflows.
https://www.brightspot.com

HubSpot launches Breeze, updates Marketing & Content Hubs

Breeze includes Copilot, an AI companion; Agents, AI experts who complete work from start to finish; 80+ AI features embedded across the platform.
https://www.hubspot.com/company-news/fall24-spotlight

DeepL announces glossary generator

Companies can create and manage custom translation glossaries so specific words or phrases are translated consistently according to their unique terminology.
https://www.deepl.com/en/translator

Adobe Experience Cloud updates help personalize and measure AI-generated content

New offerings enable brands to personalize AI-generated content variations across channels such as web and email to boost customer engagement.
https://news.adobe.com/news/news-details/2024/Adobe-Unveils-Innovations-in-Adobe-Experience-Cloud-for-Brands-to-Personalize-and-Measure-AI-generated-Content/default.aspx

All content technology news


The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news most Wednesdays. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

© 2024 The Gilbane Advisor

Theme by Anders NorenUp ↑