This week we feature articles from Jerry Liu, and Scott Brinker.

Additional reading comes from Sarah Perez, Rada Mihalcea, Oana Ignat & Zhijing Jin et al, Ben Thompson, and Airbyte.

News comes from PingCAP, SearchStax, Datometry & Databricks, and Snowflake & Neeva.

All previous issues are available at https://gilbane.com/gilbane-advisor-index/

---

Opinion / Analysis

The key point of Google’s “we have no moat” memo on generative AI is that ecosystems are the moat

Scott Brinker has a good read inspired by the Google “no moat” memo. He thinks the memo is “right on the money” and makes a convincing case why. (8 min)

https://chiefmartec.com/2023/06/the-key-point-of-googles-we-have-no-moat-memo-on-generative-ai-is-that-ecosystems-are-the-moat/

Combining text-to-SQL with semantic search for retrieval augmented generation

LlamaIndex is already useful for combining proprietary internal and external data and knowledge bases with LLMs to build custom data applications. LlamaIndex creator Jerry Liu describes their latest tool.

“We have created a brand-new query engine… that can query, join, sequence, and combine both structured data from your SQL database and unstructured data from your vector database in order to synthesize the final answer.” (10 min)

https://medium.com/llamaindex-blog/combining-text-to-sql-with-semantic-search-for-retrieval-augmented-generation-c60af30ec3b

More Reading

• Who’s using what, etc… State of data 2023 via Airbyte
• What to work on beyond LLMs… A PhD student’s perspective on research in NLP in the era of very large language models, via  Language and information technologies (LIT) University of Michigan
• Ben Thompson is a fan… Apple Vision via Stratechery
• WordPress.com challenges Substack with launch of paid newsletters via TechCrunch 

All Gilbane Advisor issues

---

Content technology news

PingCAP Unveils TiDB 7.1

With simplified operations and enhanced MySQL compatibility users can accelerate the productivity of developers and infrastructure engineers.
https://www.pingcap.com

SearchStax launches SearchStax for Good

Developers at non-profit organizations can build web and mobile applications without the high cost of managing search infrastructure.
https://www.searchstax.com/ss-for-good

Datometry partners with Databricks

To help enterprises accelerate migrations from data warehouses to the lakehouse without having to rewrite or redefine application code.
https://datometry.com

Snowflake acquires Neeva​

Will incorporate Neeva’s search experience that leverages generative AI across the Data Cloud to benefit customers, partners and developers.
https://www.snowflake.com/blog/snowflake-acquires-neeva-to-accelerate-search-in-the-data-cloud-through-generative-ai/

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

This week we feature articles from Irene Solaiman, and the Meta AI Blog.

Additional reading comes from Stephen O’Grady, Max G. Levy, and Huw Roberts, Alexander Babuta, Jessica Morley, Christopher Thomas, Mariarosaria Taddeo & Luciano Floridi.

News comes from Docugami, Acquia, Adobe, and Elastic.

All previous issues are available at https://gilbane.com/gilbane-advisor-index/

---

Opinion / Analysis

Generative AI systems aren’t just open or closed source

“Conversation around generative AI tends to focus on whether its development is open or closed. It’s more responsible to envision releases along a gradient.”

Irene Solaiman proposes a framework of six levels of access to generative AI systems. Her focus is on policy and responsible and ethical release of these systems, and her framework provides a useful foundation for thinking about release strategies, and relevant policy decisions at different points along the gradient. 

(4 min summary): https://www.wired.com/story/generative-ai-systems-arent-just-open-or-closed-source/
Full paper: https://arxiv.org/abs/2302.04844v1

Introducing speech-to-text, text-to-speech, and more for 1,100+ languages

Meta AI reports on their Massively Multilingual Speech (MMS) project which combines “wav2vec 2.0 … and a new dataset that provides labeled data for over 1,100 languages and unlabeled data for nearly 4,000 languages.”. They include a short demo, info on error rates, and links to the code and the technical paper. (7 min)

https://ai.facebook.com/blog/multilingual-model-speech-recognition/

More Reading

• All the announcements from Microsoft Build 2023 Book of News via Microsoft
• Artificial intelligence regulation in the United Kingdom: a path to good governance and global leadership? via Internet Policy Review
• Chatbots don’t know what stuff isn’t via Quanta Magazine
• The latest RedMonk programming language rankings via RedMonk

All Gilbane Advisor issues

---

Content technology news

Docugami announces integration with LlamaIndex

Combine LlamaIndex with Docugami’s Document XML Knowledge Graph to build LLM applications that connect users to their own business documents.
https://www.docugami.com/blog/llamaindex

Acquia updates Acquia DAM

Enhancements to its digital asset management platform, Acquia DAM (Widen), includes an AI chatbot to assist in creative workflows and collaboration.
https://www.acquia.com/products/acquia-dam

Adobe unveils Generative Fill for Photoshop

The beta release is Adobe’s first Creative Cloud application to deeply integrate Firefly. Document Cloud, Experience Cloud and Adobe Express to follow.
https://firefly.adobe.com/

Elastic unveils the Elasticsearch Relevance Engine​

Companies can use their structured and unstructured data to build custom generative AI apps without the cost of running LLMs.
https://www.elastic.co/enterprise-search/generative-ai

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

This week we feature articles from Skanda Vivek, and Alexander Savard.

Additional reading comes from Dean Allemang, Neil Clarke, Sridhahr Ramaswamy & Vivek Raghunathan, and Bogdan Arsintescu.

News comes from Ontotext, Expert[.]ai, Sinequa, and TransPerfect & Contentstack.

All previous issues are available at https://gilbane.com/gilbane-advisor-index/

---

Opinion / Analysis

When should you fine-tune LLMs?

Last week we led with an article looking at combining knowledge graphs with large language models to create high-value domain specific applications. This post from Skanda Vivek looks at another decision to make when building a domain specific application: whether to use a proprietary LLM, such as ChatGPT, fine-tune an open-source LLM, or train an LLM from scratch. Vivek includes cost considerations, but also includes a link to a post with detailed hosting costs. (7 min)

https://towardsdatascience.com/when-should-you-fine-tune-llms-2dddc09a404a

That little island changes everything

A really interesting case study from Lyft on implementing Apple’s Dynamic Island and Live Activities for a better user experience. Alexander Savard takes you through the design decisions. (10 min)

https://design.lyft.com/that-little-island-changes-everything-b89b108f45b4

More Reading

• Explaining rules (and OWL models) with LLMs ,via Dean Allemang
• The cost of dealing with generative AI created submissions. It continues… via Clarkesworld Magazine
• Neeva is shutting down its search engine. Too bad – was promising. via Neeva
• What LinkedIn’s giant knowledge graph does… How LIquid connects everything via LinkedIn Engineering

All Gilbane Advisor issues

---

Content technology news

Sinequa enhances platform for scientific search and clinical trial data

Combines deep learning and large language models for natural language understanding (NLU) with ChatGPT models through Azure OpenAI Service.Tridion unites web content, structured content and headless delivery
https://www.sinequa.com/enterprise-search-for-industries/healthcare-life-science/

Expert[.]ai launches AI platform for Life Sciences

The Platform combines industry language models and AI-based natural language capabilities transforming health and scientific data into insights.
https://www.expert.ai/solutions/life-science-pharma/

TransPerfect launches GlobalLink Connect app for Contentstack’s DXP

The GlobalLink Connect app is now available on the Contentstack Marketplace, part of Contentstack’s Composable Digital Experience Platform (DXP). 
https://www.transperfect.com/about/press/transperfect-launches-globallink-connect-app-contentstacks-composable-digital

Ontotext releases Target Discovery​

Platform provides pharma & biotech companies more efficient insight discovery, faster information retrieval, and advanced visual analytics.
https://www.ontotext.com/solutions/ontotexts-target-discovery/

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

This week we feature articles from Dean Allemang, and Tim Neusesser & Evan Sunwall.

Additional reading comes from Amelia Wattenburger, Google I/O presenters, and Allen Institute staff.

News comes from Tridion, Adobe & Google, MindsDB & Nixtla, and Algolia.

All previous issues are available at https://gilbane.com/gilbane-advisor-index/

---

Opinion / Analysis

AI’s Woolf at the door — LLMs and knowledge graphs

The combination of Large Language Models with other sources of data and knowledge has enormous potential for new, and more powerful, applications across domains. Most of the examples we’ve looked at in the last few weeks involve knowledge graphs and LLMs, which seem like particularly promising partners. Dean Allemang reports from last week’s Knowledge Graph Conference that there is a lot of enthusiasm for such a marriage. But Allemang wants more evidence that knowledge graphs are in fact a better match for LLMs than other types of databases. His article is a good place to start for anyone who has the same question. (8 min)

https://medium.com/@dallemang/ais-woolf-at-the-door-llms-and-knowledge-graphs-eecd6289380f

Error-message guidelines

Who among us hasn’t been occasionally baffled by error messages that aren’t the least bit helpful? This is one of the most frustrating user experience failures. Tim Neusesser and Evan Sunwall describe what designers should watch out for, and review good and bad error-message examples (including one they like from ChatGPT – see the first item in the list just below for more on chatbot UIs.) (7 min)

https://www.nngroup.com/articles/error-message-guidelines/

More Reading

• Why chatbots are not the future of LLM UI, via Amelia Wattenburger
• A good place to start if you weren’t there. There are also links to more detailed presentations. Google I/O ’23 in under 10 minutes, via Google
• Help from the Allen Institute… AI2 OLMo, an open language model made by scientists, for scientists, via AI2 Blog

All Gilbane Advisor issues

---

Content technology news

Tridion unites web content, structured content and headless delivery

Includes Tridion Docs 15, Tridion Sites 10, updated Tridion Dynamic Experience Delivery, and embedded Fonto for structured content authoring.
https://www.rws.com

Adobe and Google integrating Firefly and Bard

Adobe will use the Content Authenticity Initiative’s (CAI) open-source Content Credentials technology for transparency to images generated.
https://www.adobe.com/sensei/generative-ai/firefly.html

MindsDB and Nixtla enhance time-series forecasting

The integration allows developers using MindsDB to build AI forecasting capabilities and anomaly detection in the database without extensive code.
https://mindsdb.com ■‍ https://www.nixtla.io/

Algolia launches AI-powered Algolia NeuralSearch

NeuralSearch uses Large Language Models (LLM) and Algolia’s Neural Hashing for hyper-scale, and constantly learns from user interactions.
https://www.algolia.com/products/neuralsearch/

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

This week we feature articles from Minqi Jiang, and Scott Brinker.

Additional reading comes from David Weinberger, Mike Masnick, David Pierce, and Kevin Schaul, Szu Yu Chen & Nitasha Tiku.

News comes from Weaviate, Xyleme, Bloomreach, and Replica Analytics.

Time for our own version of spring break. The next issue will be published on May 17.

All previous issues are available at https://gilbane.com/gilbane-advisor-index/

---

Opinion / Analysis

Software²: A new generation of AIs that become increasingly general by producing their own training data

“… exploration, as typically studied in reinforcement learning (RL) and supervised learning (SL)—where it appears as some variation of active learning—is primarily designed with a static, predefined dataset or simulator in mind … unsuitable for learning in open-ended domains like the real world, where the set of relevant tasks is unbounded and cannot be modeled as a static, predefined data generator.”

Minqi Jiang and colleagues look ahead to continuous, open-ended, generalized exploration, to get beyond this limitation. (14min)

https://thegradient.pub/software2-a-new-generation-of-ais-that-become-increasingly-general-by-producing-their-own-training-data/

Exploring the 2nd order effects of generative AI in marketing and martech

Scott Brinker is also looking ahead to what’s coming, beyond the immediately obvious, for marketing technology. (10 min)

https://chiefmartec.com/2023/04/exploring-the-2nd-order-effects-of-generative-ai-in-marketing-and-martech/

More Reading

• David Weinberger trys to pin chatGPT down… chatGPT on why it pretends to know things via David Weinberger
• Mike Masnick is encouraged… Bluesky plans decentralized composable moderation via techdirt
• Can ActivityPub save the internet? Who knows? But this is a useful look at the question. via The Verge
• Inside the secret list of websites that make AI like ChatGPT sound smart, and you can see if yours is one of them! A gifted link… via The Washington Post

All Gilbane Advisor issues

---

Content technology news

Xyleme adds Elevate module to CCMS/LCMS platform

The new product adds dashboard analytics, APIs, and rich integration capabilities to the existing component content management system (CCMS)
https://xyleme.com

Weaviate raises $50 million for vector database

The vector database technology addresses the problem of generating, storing, and searching embedding vectors and their corresponding objects.
https://weaviate.io

Bloomreach integrates ChatGPT with CMS

The ChatGPT Text Generator with Bloomreach Content CMS is designed to support the creation and integration of text into e-commerce web pages.
https://www.bloomreach.com/

Replica Analytics unveils Replica Synthesis 3.0

The latest version of trusted synthetic data generation software comes with a new intuitive user interface.
https://replica-analytics.com/

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

This week we feature articles from Matt Deitke, and Sung Kim.

Additional reading comes from Mike Masnick, Lior Sinclair, Tim Schopf, and Daniel Tunkelang.

News comes from Adobe, Brightspot, Stardog, and Bloomreach.

All previous issues are available at https://gilbane.com/gilbane-advisor-index/

---

Opinion / Analysis

Objaverse: A universe of annotated 3D objects

“Recent advancements in computer vision… and natural language processing… were made possible by the availability of massive datasets. However, existing 3D datasets, such as ShapeNet, are limited in scale and diversity, consisting of only 50,000 objects. In response, we on the PRIOR team at AI2 have developed Objaverse, a vast dataset with nearly 1 million annotated 3D objects, complete with descriptive captions, tags, and animations.” 

(2 min) until you start exploring this free resource.

https://blog.allenai.org/objaverse-a-universe-of-annotated-3d-objects-718ef3d61fd6

Chat with document(s) using OpenAI ChatGPT API and text embedding

“Have you ever wondered how these applications are able to chat with documents that are over 100 or even 1,000 pages long, whereas if you try to do the same thing with ChatGPT, you will get an error message…”

Business analyst Sung Kim shares details of how he assembled a solution to chat with documents, PDFs, and books using ChatGPT API and text embedding. (13 min)

https://blog.devgenius.io/chat-with-document-s-using-openai-chatgpt-api-and-text-embedding-6a0ce3dc8bc8

More Reading

• The unintended consequences of internet regulation, via Techdirt
• Overview of the research landscape combining structured and unstructured knowledge in NLP A decade of knowledge graphs in natural language processing via Towards Data Science
• Make your life easier… Create neural network architecture drawings parametrically & export SVG via alphasignal
• Effective query triage via Daniel Tunkelang

All Gilbane Advisor issues

---

Content technology news

Adobe expands Frame.io collaboration platform beyond video

Frame[.]io now includes rich support for photos and PDFs, helping more teams to seamlessly collaborate in a centralized cloud-based workspace.
https://news.adobe.com/news/news-details/2023/Adobe-Expands-Frame.io-Collaboration-Platform-Beyond-Video/default.aspx

Brightspot expands partner program

To offer comprehensive implementation and maintenance options for building digital, web and content experiences using Brightspot CMS.
https://www.brightspot.com

Stardog introduces Stardog 9

The knowledge graph powered semantic layer has new integrations for Azure Synapse, Collibra Data Governance and Databricks.
https://www.stardog.com/blog/introducing-stardog-9/

Bloomreach unveils SMS marketing updates 

The TCPA List Validation feature removes reassigned or deactivated numbers from send lists, and numbers on state and national Do Not Call registries.
https://www.bloomreach.com/en/news

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

This week we feature content from Barr Moses & Shane Murray, and Peter Lawrence.

Additional reading comes from Jay Graber, Kingsley Uyi Idehen, Stanford, and the National Science Foundation.

News comes from Expert[.]ai & Reveal Group, Databricks, Algolia, and Stilo.

Note that news items now link to the original source of the news rather than our 200 word summaries, which are always available here.

All previous issues are available at https://gilbane.com/gilbane-advisor-index/

---

Opinion / Analysis

Zero-ETL, ChatGPT, and the future of data engineering

“The post-modern data stack is coming. Are we ready?”.

Barr Moses & Shane Murray aim to help you prepare with this very readable post on promising components of future data stacks. (9 min)

https://towardsdatascience.com/zero-etl-chatgpt-and-the-future-of-data-engineering-71849642ad9c

Knowledge Graphs + Large Language Models = The ability for users to ask their own questions?

One area the article recommended above doesn’t address is the incorporation of knowledge graphs in data stacks. This is an area we are keenly interested in, especially in combination with LLMs. Peter Lawrence examines what may seem a less-than-obvious use-case (digital twins) for such a combination, and describes how a knowledge graph can be used to train an LLM to be significantly more valuable. He also illustrates why it is not easy. (12 min)

https://medium.com/@peter.lawrence_47665/knowledge-graphs-large-language-models-the-ability-for-users-to-ask-their-own-questions-e4afc348fa72

More Reading

• A marketplace for social Algorithmic choice, via Bluesky
• HowTo — Using CHAT-GPT to generate a Knowledge Graph from a Mermaid Entity via OpenLink Software Blog
• Just out… The Stanford 2023 AI Index Report, via Stanford
• Looking for proposals to help. Building the Prototype Open Knowledge Network (Proto-OKN) via National Science Foundation

All Gilbane Advisor issues

---

Content technology news

Expert[.]ai and Reveal Group partner to combine NLP and RPA

Expert[.]ai and Reveal Group partner to combine NLP and RPA — To help organizations extend the value in intelligent automation programs with natural language processing and understanding (NLP/NLU).
https://www.expert.ai/ ■ https://revealgroup.com/

Databricks announces Lakehouse for Manufacturing

Lakehouse for Manufacturing offers pre-built solutions, partner-designed Brickbuilder offerings and integrated AI capabilities.
https://www.databricks.com/solutions/industries/manufacturing-industry-solutions

Algolia introduces developer-friendly plan 

The AI Search and Discovery platform’s two new plans include a “Build” plan that is free and a “Grow” plan that offers low-priced scalability.
https://www.algolia.com

Stilo launches Migrate 5.0 

Migrate 5 provides automated content conversion from legacy content to structured DITA XML.
https://www.stilo.com/

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

This week we feature content from OpenAI and Kurt Cagle.

Additional reading comes from Alex Hollender, Dean Allemang, and Tom Warren.

News comes from Adobe, Ontotext, Kobai, and Syncro Soft.

Note that news items now link to the original source of the news rather than our 200 word summaries, which are always available here.

The next issue will be published April 12. All previous issues are available at https://gilbane.com/gilbane-advisor-index/

---

Opinion / Analysis

ChatGPT plugins

Many, perhaps most, of the problems with large language models like GPT are due to data limitations (availability, age, quality). The ability to complement GPT data with external knowledge and data sources you own or trust, or are specific to your industry or business, increases model quality, context, and utility. LlamaIndex APIs can help you accomplish this. Now ChatGPT plugins take integration possibilities up a level. This post by the OpenAI team is the best place to get up-to-speed on the first batch of plugins, and what they’re planning. (12 min)

https://openai.com/blog/chatgpt-plugins

Nine ChatGPT tricks for knowledge graph workers

A helpful show-and-tell from Kurt Cagle… 

“Where things get interesting is in the realm of coding and semantics… most of these samples made use of ChatGPT+ for experimentation and the DaVince OpenAI Playground for generating more complex output.” (22 min)

https://thecaglereport.com/2023/03/16/nine-chatgpt-tricks-for-knowledge-graph-workers/

More Reading

• Design notes on the 2023 Wikipedia redesign via UX Collective
• LLM’s closing the KG gap via Dean Allemang
• You can now try Microsoft Loop, a Notion competitor with futuristic Office documents via The Verge

All Gilbane Advisor issues

---

Content technology news

Adobe announces multiple product updates

Adobe announcements focused on generative AI services, personalization, content management, product analytics, and content supply chain.
https://news.adobe.com/home/default.aspx

Ontotext releases Metadata Studio 3.2

Enables rapid text mining development based on an organization’s knowledge graph with non-technical contributors in the loop.
https://www.ontotext.com

Kobai launches Saturn Knowledge Graph 

Kobai Saturn platform users to query data at Lakehouse scale and integrate every use case and function into a single semantic layer.
https://www.kobai.io/products/kobai-saturn

Syncro Soft releases Oxygen XML suite 25.1 

Updates to Oxygen XML Editor, Author, Developer, Web Author, Publishing Engine, WebHelp, PDF Chemistry, and Scripting, and Oxygen Feedback.
https://www.sync.ro

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact