This week we feature articles from Simon Wardley, and Jakob Nielsen.

Additional reading comes from Sayash Kapoor & Arvind Narayanan, Rishi Bommasani, Kevin Klyman, Daniel Zhang & Percy Liang, and Alex Ratner.

News comes from Acquia, Adobe, Optimizely, and Expert[.]ai & Blue Prism.

All previous issues are available at https://gilbane.com/gilbane-advisor-index

---

Opinion / Analysis

Both articles this week argue that the current state of conversational programming with prompt engineering as the interface, is primitive, though directional. Simon Wardley’s post is a bit more technical, while Jakob Nielsen’s focuses on end-user usability.

Why the fuss about conversational programming

“In my last post on conversational programming I asked the reader to “get yourself ready for a world of conversational programming” but I wasn’t willing to call it for ChatGPT or the existing crop of LLMs.”

If you’re familiar with Simon Wardley, you won’t be surprised that he says we need to get to “code as maps”. Otherwise, see his previous post and perhaps some of his other links. (10 min)

https://swardley.medium.com/why-the-fuss-about-conversational-programming-70a8b7ca0d2b

AI: first new UI paradigm in 60 years

Jakob Nielsen…

“I doubt that the current set of generative AI tools (like ChatGPT, Bard, etc.) are representative of the UIs we’ll be using in a few years, because they have deep-rooted usability problems. Their problems led to the development of a new role — the prompt engineer.” (5 min)

https://www.nngroup.com/articles/ai-paradigm/

More Reading

• It’s not so simple… Is AI-generated disinformation a threat to democracy? via AI Snake Oil
• Handy comparison table with details and scores for each requirement… Do foundation model providers comply with the draft EU AI Act? via Stanford Center for Research on Foundation Models
• Of course we need a platform… Snorkel’s Foundation Model Data Platform via Snorkel

All Gilbane Advisor issues

---

Content technology news

Acquia enhances digital experience platform for personalization

Enables digital experiences based on knowledge gained from a broader array of channels, using anonymous, known, and understood customer data.
https://www.acquia.com/newsroom/press-releases/acquia-enhances-digital-experience-platform-power-omnichannel-customer

Expert[.]ai expands partnership with SS&C Blue Prism

Processing unstructured language data for automation creates new potential for leveraging intelligent automation in the enterprise.
https://www.expert.ai ■ https://www.blueprism.com

Optimizely introduces Content Graph

Content Graph service extends the capabilities of Optimizely’s CMS by enabling flexible content delivery across channels and applications.
https://www.optimizely.com/headless

Adobe adds Firefly generative AI capabilities to Illustrator

Following Adobe Photoshop and Adobe Express, Illustrator is the latest Creative Cloud application to benefit from Adobe’s generative AI.
https://www.adobe.com/products/illustrator.html

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

This week we feature articles from Jacob Steinhardt, and Fan Li.

Additional reading comes from Shirley Lu & George Serafeim, Cassie Kozyrkov, M.G. Siegler, and Jeffrey Pound et al.

News comes from Adobe, Neo4j, Bloomreach, and Optimizely.

All previous issues are available at https://gilbane.com/gilbane-advisor-index

---

Opinion / Analysis

What will GPT-2030 look like?

Of course we would all like to know, but given the speed of new developments in machine learning it’s difficult to make, or have confidence in, any predictions. Jacob Steinhardt isn’t afraid to try, and his post is a must-read for anyone looking for some data points to inform their own research and thinking. You’ll want a cup of coffee or tea and perhaps a little more time than the specified read time (27 min).

https://bounded-regret.ghost.io/what-will-gpt-2030-look-like/

Explore OntoGPT for schema-based knowledge extraction

“The OntoGPT framework and SPIRES tool provide a principled approach to extract knowledge from unstructured text for integration into Knowledge Graphs (KGs), using Large Language Models such as GPT. This methodology enables handling complex relationships, ensures logical consistency, and aligns with predefined ontologies for better KG integration.”

Fan Li describes another open available tool that he believes overcome some limitations to the popular LangChain and LlamaIndex frameworks. The more tools the better. (7 min).

https://apex974.com/articles/ontogpt-for-schema-based-knowledge-extraction

More Reading

• How AI will accelerate the circular economy via HBR
• Linking un-structured Web documents to entities in knowledge graphs… Growing and serving large open-domain knowledge graphs via arXiv
• Platform play redux… Apple’s Vision Pro & Meta’s Vision Oh No via 500ish
• Generative AI vs enterprise AI… Why multi-purpose systems are hard to design safely via Cassie Kozyrkov

All Gilbane Advisor issues

---

Content technology news

Adobe announces Firefly for Enterprise

Adobe plans to enable businesses to custom train Firefly with their own branded assets, embedding Firefly into their own ecosystem.
https://news.adobe.com/news/news-details/2023/Adobe-Brings-Firefly-and-Express-to-Enterprises/default.aspx

Neo4j announces new integrations with generative AI features in Vertex AI

Enterprise customers can now leverage knowledge graphs with Google’s large language models to improve generative AI outcomes.
https://neo4j.com

Bloomreach enhances customer experience with Gorgias integration

Gorgias provides data about the customer experience and gives Engagement users a more in-depth understanding of the customer journey.
https://www.bloomreach.com/

Optimizely expands partnership with Contentsquare

Contentsquare enables Optimizely users to leverage heatmaps and data analyses to uncover customer insights and enhance experiments.
https://www.optimizely.com/insights/blog/optimizely-x-contentsquare-5-ways-were-better-together/

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

This week we feature articles from Jerry Liu, and Scott Brinker.

Additional reading comes from Sarah Perez, Rada Mihalcea, Oana Ignat & Zhijing Jin et al, Ben Thompson, and Airbyte.

News comes from PingCAP, SearchStax, Datometry & Databricks, and Snowflake & Neeva.

All previous issues are available at https://gilbane.com/gilbane-advisor-index/

---

Opinion / Analysis

The key point of Google’s “we have no moat” memo on generative AI is that ecosystems are the moat

Scott Brinker has a good read inspired by the Google “no moat” memo. He thinks the memo is “right on the money” and makes a convincing case why. (8 min)

https://chiefmartec.com/2023/06/the-key-point-of-googles-we-have-no-moat-memo-on-generative-ai-is-that-ecosystems-are-the-moat/

Combining text-to-SQL with semantic search for retrieval augmented generation

LlamaIndex is already useful for combining proprietary internal and external data and knowledge bases with LLMs to build custom data applications. LlamaIndex creator Jerry Liu describes their latest tool.

“We have created a brand-new query engine… that can query, join, sequence, and combine both structured data from your SQL database and unstructured data from your vector database in order to synthesize the final answer.” (10 min)

https://medium.com/llamaindex-blog/combining-text-to-sql-with-semantic-search-for-retrieval-augmented-generation-c60af30ec3b

More Reading

• Who’s using what, etc… State of data 2023 via Airbyte
• What to work on beyond LLMs… A PhD student’s perspective on research in NLP in the era of very large language models, via  Language and information technologies (LIT) University of Michigan
• Ben Thompson is a fan… Apple Vision via Stratechery
• WordPress.com challenges Substack with launch of paid newsletters via TechCrunch 

All Gilbane Advisor issues

---

Content technology news

PingCAP Unveils TiDB 7.1

With simplified operations and enhanced MySQL compatibility users can accelerate the productivity of developers and infrastructure engineers.
https://www.pingcap.com

SearchStax launches SearchStax for Good

Developers at non-profit organizations can build web and mobile applications without the high cost of managing search infrastructure.
https://www.searchstax.com/ss-for-good

Datometry partners with Databricks

To help enterprises accelerate migrations from data warehouses to the lakehouse without having to rewrite or redefine application code.
https://datometry.com

Snowflake acquires Neeva​

Will incorporate Neeva’s search experience that leverages generative AI across the Data Cloud to benefit customers, partners and developers.
https://www.snowflake.com/blog/snowflake-acquires-neeva-to-accelerate-search-in-the-data-cloud-through-generative-ai/

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

This week we feature articles from Irene Solaiman, and the Meta AI Blog.

Additional reading comes from Stephen O’Grady, Max G. Levy, and Huw Roberts, Alexander Babuta, Jessica Morley, Christopher Thomas, Mariarosaria Taddeo & Luciano Floridi.

News comes from Docugami, Acquia, Adobe, and Elastic.

All previous issues are available at https://gilbane.com/gilbane-advisor-index/

---

Opinion / Analysis

Generative AI systems aren’t just open or closed source

“Conversation around generative AI tends to focus on whether its development is open or closed. It’s more responsible to envision releases along a gradient.”

Irene Solaiman proposes a framework of six levels of access to generative AI systems. Her focus is on policy and responsible and ethical release of these systems, and her framework provides a useful foundation for thinking about release strategies, and relevant policy decisions at different points along the gradient. 

(4 min summary): https://www.wired.com/story/generative-ai-systems-arent-just-open-or-closed-source/
Full paper: https://arxiv.org/abs/2302.04844v1

Introducing speech-to-text, text-to-speech, and more for 1,100+ languages

Meta AI reports on their Massively Multilingual Speech (MMS) project which combines “wav2vec 2.0 … and a new dataset that provides labeled data for over 1,100 languages and unlabeled data for nearly 4,000 languages.”. They include a short demo, info on error rates, and links to the code and the technical paper. (7 min)

https://ai.facebook.com/blog/multilingual-model-speech-recognition/

More Reading

• All the announcements from Microsoft Build 2023 Book of News via Microsoft
• Artificial intelligence regulation in the United Kingdom: a path to good governance and global leadership? via Internet Policy Review
• Chatbots don’t know what stuff isn’t via Quanta Magazine
• The latest RedMonk programming language rankings via RedMonk

All Gilbane Advisor issues

---

Content technology news

Docugami announces integration with LlamaIndex

Combine LlamaIndex with Docugami’s Document XML Knowledge Graph to build LLM applications that connect users to their own business documents.
https://www.docugami.com/blog/llamaindex

Acquia updates Acquia DAM

Enhancements to its digital asset management platform, Acquia DAM (Widen), includes an AI chatbot to assist in creative workflows and collaboration.
https://www.acquia.com/products/acquia-dam

Adobe unveils Generative Fill for Photoshop

The beta release is Adobe’s first Creative Cloud application to deeply integrate Firefly. Document Cloud, Experience Cloud and Adobe Express to follow.
https://firefly.adobe.com/

Elastic unveils the Elasticsearch Relevance Engine​

Companies can use their structured and unstructured data to build custom generative AI apps without the cost of running LLMs.
https://www.elastic.co/enterprise-search/generative-ai

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

This week we feature articles from Skanda Vivek, and Alexander Savard.

Additional reading comes from Dean Allemang, Neil Clarke, Sridhahr Ramaswamy & Vivek Raghunathan, and Bogdan Arsintescu.

News comes from Ontotext, Expert[.]ai, Sinequa, and TransPerfect & Contentstack.

All previous issues are available at https://gilbane.com/gilbane-advisor-index/

---

Opinion / Analysis

When should you fine-tune LLMs?

Last week we led with an article looking at combining knowledge graphs with large language models to create high-value domain specific applications. This post from Skanda Vivek looks at another decision to make when building a domain specific application: whether to use a proprietary LLM, such as ChatGPT, fine-tune an open-source LLM, or train an LLM from scratch. Vivek includes cost considerations, but also includes a link to a post with detailed hosting costs. (7 min)

https://towardsdatascience.com/when-should-you-fine-tune-llms-2dddc09a404a

That little island changes everything

A really interesting case study from Lyft on implementing Apple’s Dynamic Island and Live Activities for a better user experience. Alexander Savard takes you through the design decisions. (10 min)

https://design.lyft.com/that-little-island-changes-everything-b89b108f45b4

More Reading

• Explaining rules (and OWL models) with LLMs ,via Dean Allemang
• The cost of dealing with generative AI created submissions. It continues… via Clarkesworld Magazine
• Neeva is shutting down its search engine. Too bad – was promising. via Neeva
• What LinkedIn’s giant knowledge graph does… How LIquid connects everything via LinkedIn Engineering

All Gilbane Advisor issues

---

Content technology news

Sinequa enhances platform for scientific search and clinical trial data

Combines deep learning and large language models for natural language understanding (NLU) with ChatGPT models through Azure OpenAI Service.Tridion unites web content, structured content and headless delivery
https://www.sinequa.com/enterprise-search-for-industries/healthcare-life-science/

Expert[.]ai launches AI platform for Life Sciences

The Platform combines industry language models and AI-based natural language capabilities transforming health and scientific data into insights.
https://www.expert.ai/solutions/life-science-pharma/

TransPerfect launches GlobalLink Connect app for Contentstack’s DXP

The GlobalLink Connect app is now available on the Contentstack Marketplace, part of Contentstack’s Composable Digital Experience Platform (DXP). 
https://www.transperfect.com/about/press/transperfect-launches-globallink-connect-app-contentstacks-composable-digital

Ontotext releases Target Discovery​

Platform provides pharma & biotech companies more efficient insight discovery, faster information retrieval, and advanced visual analytics.
https://www.ontotext.com/solutions/ontotexts-target-discovery/

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

This week we feature articles from Dean Allemang, and Tim Neusesser & Evan Sunwall.

Additional reading comes from Amelia Wattenburger, Google I/O presenters, and Allen Institute staff.

News comes from Tridion, Adobe & Google, MindsDB & Nixtla, and Algolia.

All previous issues are available at https://gilbane.com/gilbane-advisor-index/

---

Opinion / Analysis

AI’s Woolf at the door — LLMs and knowledge graphs

The combination of Large Language Models with other sources of data and knowledge has enormous potential for new, and more powerful, applications across domains. Most of the examples we’ve looked at in the last few weeks involve knowledge graphs and LLMs, which seem like particularly promising partners. Dean Allemang reports from last week’s Knowledge Graph Conference that there is a lot of enthusiasm for such a marriage. But Allemang wants more evidence that knowledge graphs are in fact a better match for LLMs than other types of databases. His article is a good place to start for anyone who has the same question. (8 min)

https://medium.com/@dallemang/ais-woolf-at-the-door-llms-and-knowledge-graphs-eecd6289380f

Error-message guidelines

Who among us hasn’t been occasionally baffled by error messages that aren’t the least bit helpful? This is one of the most frustrating user experience failures. Tim Neusesser and Evan Sunwall describe what designers should watch out for, and review good and bad error-message examples (including one they like from ChatGPT – see the first item in the list just below for more on chatbot UIs.) (7 min)

https://www.nngroup.com/articles/error-message-guidelines/

More Reading

• Why chatbots are not the future of LLM UI, via Amelia Wattenburger
• A good place to start if you weren’t there. There are also links to more detailed presentations. Google I/O ’23 in under 10 minutes, via Google
• Help from the Allen Institute… AI2 OLMo, an open language model made by scientists, for scientists, via AI2 Blog

All Gilbane Advisor issues

---

Content technology news

Tridion unites web content, structured content and headless delivery

Includes Tridion Docs 15, Tridion Sites 10, updated Tridion Dynamic Experience Delivery, and embedded Fonto for structured content authoring.
https://www.rws.com

Adobe and Google integrating Firefly and Bard

Adobe will use the Content Authenticity Initiative’s (CAI) open-source Content Credentials technology for transparency to images generated.
https://www.adobe.com/sensei/generative-ai/firefly.html

MindsDB and Nixtla enhance time-series forecasting

The integration allows developers using MindsDB to build AI forecasting capabilities and anomaly detection in the database without extensive code.
https://mindsdb.com ■‍ https://www.nixtla.io/

Algolia launches AI-powered Algolia NeuralSearch

NeuralSearch uses Large Language Models (LLM) and Algolia’s Neural Hashing for hyper-scale, and constantly learns from user interactions.
https://www.algolia.com/products/neuralsearch/

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

This week we feature articles from Minqi Jiang, and Scott Brinker.

Additional reading comes from David Weinberger, Mike Masnick, David Pierce, and Kevin Schaul, Szu Yu Chen & Nitasha Tiku.

News comes from Weaviate, Xyleme, Bloomreach, and Replica Analytics.

Time for our own version of spring break. The next issue will be published on May 17.

All previous issues are available at https://gilbane.com/gilbane-advisor-index/

---

Opinion / Analysis

Software²: A new generation of AIs that become increasingly general by producing their own training data

“… exploration, as typically studied in reinforcement learning (RL) and supervised learning (SL)—where it appears as some variation of active learning—is primarily designed with a static, predefined dataset or simulator in mind … unsuitable for learning in open-ended domains like the real world, where the set of relevant tasks is unbounded and cannot be modeled as a static, predefined data generator.”

Minqi Jiang and colleagues look ahead to continuous, open-ended, generalized exploration, to get beyond this limitation. (14min)

https://thegradient.pub/software2-a-new-generation-of-ais-that-become-increasingly-general-by-producing-their-own-training-data/

Exploring the 2nd order effects of generative AI in marketing and martech

Scott Brinker is also looking ahead to what’s coming, beyond the immediately obvious, for marketing technology. (10 min)

https://chiefmartec.com/2023/04/exploring-the-2nd-order-effects-of-generative-ai-in-marketing-and-martech/

More Reading

• David Weinberger trys to pin chatGPT down… chatGPT on why it pretends to know things via David Weinberger
• Mike Masnick is encouraged… Bluesky plans decentralized composable moderation via techdirt
• Can ActivityPub save the internet? Who knows? But this is a useful look at the question. via The Verge
• Inside the secret list of websites that make AI like ChatGPT sound smart, and you can see if yours is one of them! A gifted link… via The Washington Post

All Gilbane Advisor issues

---

Content technology news

Xyleme adds Elevate module to CCMS/LCMS platform

The new product adds dashboard analytics, APIs, and rich integration capabilities to the existing component content management system (CCMS)
https://xyleme.com

Weaviate raises $50 million for vector database

The vector database technology addresses the problem of generating, storing, and searching embedding vectors and their corresponding objects.
https://weaviate.io

Bloomreach integrates ChatGPT with CMS

The ChatGPT Text Generator with Bloomreach Content CMS is designed to support the creation and integration of text into e-commerce web pages.
https://www.bloomreach.com/

Replica Analytics unveils Replica Synthesis 3.0

The latest version of trusted synthetic data generation software comes with a new intuitive user interface.
https://replica-analytics.com/

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact

This week we feature articles from Matt Deitke, and Sung Kim.

Additional reading comes from Mike Masnick, Lior Sinclair, Tim Schopf, and Daniel Tunkelang.

News comes from Adobe, Brightspot, Stardog, and Bloomreach.

All previous issues are available at https://gilbane.com/gilbane-advisor-index/

---

Opinion / Analysis

Objaverse: A universe of annotated 3D objects

“Recent advancements in computer vision… and natural language processing… were made possible by the availability of massive datasets. However, existing 3D datasets, such as ShapeNet, are limited in scale and diversity, consisting of only 50,000 objects. In response, we on the PRIOR team at AI2 have developed Objaverse, a vast dataset with nearly 1 million annotated 3D objects, complete with descriptive captions, tags, and animations.” 

(2 min) until you start exploring this free resource.

https://blog.allenai.org/objaverse-a-universe-of-annotated-3d-objects-718ef3d61fd6

Chat with document(s) using OpenAI ChatGPT API and text embedding

“Have you ever wondered how these applications are able to chat with documents that are over 100 or even 1,000 pages long, whereas if you try to do the same thing with ChatGPT, you will get an error message…”

Business analyst Sung Kim shares details of how he assembled a solution to chat with documents, PDFs, and books using ChatGPT API and text embedding. (13 min)

https://blog.devgenius.io/chat-with-document-s-using-openai-chatgpt-api-and-text-embedding-6a0ce3dc8bc8

More Reading

• The unintended consequences of internet regulation, via Techdirt
• Overview of the research landscape combining structured and unstructured knowledge in NLP A decade of knowledge graphs in natural language processing via Towards Data Science
• Make your life easier… Create neural network architecture drawings parametrically & export SVG via alphasignal
• Effective query triage via Daniel Tunkelang

All Gilbane Advisor issues

---

Content technology news

Adobe expands Frame.io collaboration platform beyond video

Frame[.]io now includes rich support for photos and PDFs, helping more teams to seamlessly collaborate in a centralized cloud-based workspace.
https://news.adobe.com/news/news-details/2023/Adobe-Expands-Frame.io-Collaboration-Platform-Beyond-Video/default.aspx

Brightspot expands partner program

To offer comprehensive implementation and maintenance options for building digital, web and content experiences using Brightspot CMS.
https://www.brightspot.com

Stardog introduces Stardog 9

The knowledge graph powered semantic layer has new integrations for Azure Synapse, Collibra Data Governance and Databricks.
https://www.stardog.com/blog/introducing-stardog-9/

Bloomreach unveils SMS marketing updates 

The TCPA List Validation feature removes reassigned or deactivated numbers from send lists, and numbers on state and national Do Not Call registries.
https://www.bloomreach.com/en/news

All content technology news

---

The Gilbane Advisor is authored by Frank Gilbane and is ad-free, cost-free, and curated for content, computing, web, data, and digital experience technology and information professionals. We publish recommended articles and content technology news weekly. We do not sell or share personal data.

Subscribe | View online | Editorial policy | Privacy policy | Contact