Recently in Enterprise Search Category

I was at the Gilbane Conference in San Francisco last week, where I answered questions as a panelist, moderated another panel, heard many excellent presentations, and joined in many engaging discussions. On the plane ride home, I took some time to piece together the individual bits of information and opinion that I had absorbed during the two-day event. This reflection led to the following observations regarding the state of enterprise content management practices and technologies.

Up With People

Many content software vendors are now focusing on people first, content second. This is a huge shift in perspective, especially when voiced at a content management conference! Kumar Vora, Vice President & General Manager, Enterprise at Adobe was the first person to proclaim this philosophical change during his opening keynote presentation at Gilbane San Francisco. He reported that Adobe has shifted its business philosophy to focus on serving people and their needs, as opposed to thinking about content first. Many other vendor representatives and attendees from end user organizations echoed Kumar's emphasis on people during the event. It is too early to say definitively what this radical change in perspective means, but we should see more user friendly enterprise content management tools as a result.

Keyword Fail

Keyword search has largely failed end users and incremental improvements haven't been able to keep up with the explosion in newly created content. Jeff Fried, VP Product Management for Microsoft's FAST search engine actually proclaimed that "keyword search is dead!" The business world is at a point where alternatives, including machine-generated and social search techniques, must be explored. The latter method was on many attendees minds and lips, which should not surprise, given the shift to people-centric thinking identified above. Social search will be an increasingly hot topic in 2009 and 2010.

SharePoint Upheaval

Microsoft SharePoint 2010 has the potential to completely shake up the information management market. The next version of SharePoint will likely include a raft of (as of yet unconfirmed) Web Content Management features that have been missing or rudimentary. In her keynote address, Tricia Bush, Group Product Manager for SharePoint said that the promise of content management has not yet been realized and that her team is focusing diligently on the opportunity. This increased emphasis on content management is contrary to the first trend that I described above, and the negative perceptions many hold of SharePoint may increase unless Microsoft also better enables people in SharePoint 2010 (it is rumored that the product will also see substantial additions to its currently limited social collaboration functionality.) Those placing bets should do so knowing that Microsoft intends to, and probably will, be a major force in enterprise information management.

Simplicity Trumps Complexity

Enterprise applications and systems managed by IT departments continue to grow in complexity. As this happens, end users turn to simpler alternatives, including consumer oriented Web 2.0 applications, in order to get work done. The "problem" is that these consumer applications aren't approved or controlled by the IT function. The opportunity is a potentially large market for software vendors that can create enterprise ready versions of Web 2.0 applications by adding security, reliability, and other attributes demanded by CIOs. For those vendors to succeed, however, they must retain the simplicity (intuitiveness and ease of use) that are the hallmark of consumer Web 2.0 applications.

Communication Beats Publishing

Communication applications are increasingly being used by end users to collaborate, because enterprise content management applications have become too complex (see the trend immediately above). Additionally, communication tools are favored by end users because they can use them to simultaneously create and distribute content. This increased speed of content publication also accelerates general business process execution, allowing users of communication tools to be more productive than users of formal enterprise content systems. Communication tools will continue to become an important and growing back channel that employees use to share content when overly complex publishing tools impede or fail them.

Having one's ideas validated by a reputable peer is always rewarding. John Mancini, President of AIIM, published a blog post in the time between when I first formulated these thoughts on the flight home from San Francisco last week and when I published this post today. Reading John's post should encourage you to believe that the trends I (and he) have described are for real. The question for all of us now is how will we respond to these emerging realities.

Looking forward to seeing many of you next week at Gilbane San Francisco. Whether you will be there or not, you can suggest questions to ask our analyst panel. Each of the panelists have specific areas of expertise covering web content management, web governance, enterprise social software and social media, collaboration, and enterprise search. The panel is a keynote session after the two keynote presentations from Microsoft and Adobe, so we'll also be covering reactions to those. You can submit your questions directly to me via a comment, email, or twitter (DM or post using the hashtag #gilbanesf).

Registration for the conference is still open and will be available on-site. If you register in advance you can still get a $200. discount using GILBANE as the discount code. There is no charge for the keynotes or the technology demonstrations or product labs.

K2. Keynote Analyst Panel
We invite industry analysts from many different firms to speak at all our events to make sure our conference attendees hear differing opinions from a wide variety of expert sources. A second, third, fourth or fifth opinion will ensure you don't make ill-informed decisions about critical content and information technologies or strategies. This session will be a lively, interactive debate guaranteed to be both informative and fun.
Moderator: Frank Gilbane
Panelists:
Jeremiah Owyang, Senior Analyst, Social Computing, Forrester
Hadley Reynolds, Research Director, Search & Digital Marketplace Technologies, IDC
Larry Hawes, Lead Analyst, Collaboration and Enterprise Social Software, Gilbane Group
Lisa Welchman, Founding Partner, WelchmanPierpoint

There are only 4 more weeks until our annual San Francisco conference. If you haven't already made plans to attend, you should check it out. We have more content than we have ever had in San Francisco, so whatever kind of enterprise web or content application project or responsibility you have, you'll find learning and networking opportunities.

Our marketing group has been posting updates on our announcements blog and on Twitter. But for those of you who only read this stream, here is a quick update:

• The early discount rates have been extended to May 8th.
• Gilbane conference room rate of $220 at the San Francisco Westin includes complimentary daily guest room internet use, valued at $14.95 per day.
• There are 46 conference sessions, workshops or product labs, 90 expert speakers, 36 sponsors/exhibitors.
• Keynotes from Microsoft & Adobe on the future of web platforms and customer engagement
• Keynote analyst panel with Forrester, IDC, Gilbane, and WelchmanPierpoint.
• We'll be using #gilbanesf as the hash tag.

See you there.

Suw Charman-Anderson posted a thoughtful piece with the title Businesses will live to regret their social media ignorance today.  Her main point is that organizations that do not deploy enterprise social software behind the firewall will lose control of information as it spreads through public social media.  This is an oft-heard refrain these days in the blogsphere.

Please don't misunderstand, I agree with Suw.  If businesses want to retain some control over their information, they should provide secure, enterprise-ready versions of the specific types of collaboration and communication tools that employees want to use.  For example, if the risk of information leakage via Twitter is too high, the organization should deploy an enterprise microblogging application on its own servers (or subscribe to a SaaS offering hosted by a trusted vendor.)

What is especially valuable and somewhat novel in Suw's post is her recognition of the content management issues surrounding the use of public social media to share corporate information.  She writes,

"...you need to make sure you know how communications using these tools are going to be logged, archived, and made searchable. Mostly, archiving (or logging) is built in, so it shouldn’t be that difficult. Cross-archive search might be a little bit more interesting, but it’s worth your while because more time is wasted in re-finding information than in finding it in the first place."

Much of the dialog around enterprise social software has rightly been on connecting people to other people and the information and knowledge they possess.  The notion of using software to connect people to unstructured information hasn't gotten nearly as much attention in the Enterprise 2.0 discussion.  Perhaps content management is a dull topic in comparison to connecting people, but enterprise social software is essentially a content authoring tool and it has fueled growth in the amount of content created within an organization.

Traditionally, unstructured information has been housed in what most would call a 'document', but it also may be contained in a message authored in a microblogging, wiki, or instant messaging application.  Those messages must be stored, indexed, and searchable so that users can find valuable information after it has initially been documented and shared by the author.  The same content management principles that we've applied to corporate email must also be used to ensure the findability of information generated in and shared via enterprise social software.

What is your view on this issue?  Do you have horror stories or best practices to share?  If so, please do by adding a comment below.

We've been especially focused on enterprise search this year. In addition to Lynda's blog and our normal conference coverage, we have released two extensive reports, one authored by Lynda and one by Stephen Arnold, and Udi Manber VP Engineering, Search, Google, keynoted our San Francisco conference. We are continuing this focus at our upcoming Boston conference where Prabhakar Raghavan, Head of Yahoo! Research, will provide the opening keynote.

Prabhakar's talk is titled "The Future of Search". The reason I added "enterprise" to the title of the post, is that Prabhakar's talk will be of special interest to enterprises because of its emphasis on complex data in databases and marked-up content repositories. Prabhakar's background includes stints CTO at Verity and IBM so enterprise (or, if you prefer "behind-the-firewall", or "intranet") search requirements are not new to him.

Here is the description from the conference site:

Web content continues to grow, change, diversify, and fragment. Meanwhile, users are performing increasingly sophisticated and open-ended tasks online, connecting broadly to content and services across the Web. The simple search result page of blue text links needs to evolve to address these complex tasks, and this evolution includes a more formal understanding of user's intent, and a deeper model of how particular pieces of Web content can help. Structured databases power a significant fraction of Web pages, and microformats and other forms of markup have been proposed as mechanisms to expose this structure. But uptake of these mechanisms remains limited, as content owners await the killer application for this technology. That application is search. If search engines can make deep use of structured information about content, provided through open standards, then search engines and site owners can together bring consumers a far richer experience. We are entering a period of massive change to enable search engines to handle more complex content. Prabhakar Raghavan, head of Yahoo! Research, will address the future of search: how search engines are becoming more sophisticated, what the breakthrough point will be for semantics on the Web and what this means for developers and publishers.

Join us on December 3rd at 8:30am at the Boston Westin Copley. Register.

Fred is our newest contributor, and has already posted his first blog entry. Fred pokes at the challenging tension in search between intent and context, especially over time as context (or intent) changes. Lynda has also posted about intent, and the subject also came up in discussions of search quality around Udi Manber's talk at our conference in this past June.

Fred brings the welcome perspective of a serious software developer, and will be blogging on a few different topics, so he may be posting here on on one of our other blogs. Welcome Fred!

Intent, hidden within a search click, lies at the intersection of Search and Business, as in "let's do some business". That search click has extra-ordinary value because of the intent to buy -- that's why we're searching, right?

Perhaps, or maybe we're just browsing, or surfing, and we're not in the mood for advertisements. It could be more militant than that; perhaps we're still trying to research our choices and would see a sales pitch as tainting the honesty of the information. At least that's what the founders of Google originally believed.

Although the model of the web was a set of stateless pages, and a Google search box certainly fits that appearance, people's intent is not stateless. It ebbs and flows, from entertaining looking around, to researching choices and comparing possibilities, through sourcing a chosen product (now we're talking about a qualified buyer), to selecting fulfillment options, and possibly all the way to figuring out how to return a product that we're dissatisfied with. That last one is probably not the best time to present an ad claiming how wonderful that product is.

This is a "long running transaction," a series of steps that fit together and flow towards (and past) a purchasing decision, but with back-currents and eddies. And it really is a transaction in the database sense where a failure during one step can cause the entire sequence to be discarded as if it never happened. Though if you believe Sergey and Larry, it will be worse than never happening, you may lose trust in your guide through that transaction.

Has the intent changed? Depends on what that means. On one hand, what has changed across those steps is the mode of the intent. If the intent was to purchase a product, then the research, comparison, purchase, and fulfillment were clearly pieces of that intent, though they call for different approaches: organic search for the research, product focused responses for the purchase, perhaps service-oriented for the fulfillment, and some combination for the comparison.

But what about that "I need to return this product because I hate it" step? The intent has clearly changed, but it is more necessary than ever to connect this new intent to the previous steps. If not, perhaps the search engine will continue to suggest that product to a disgruntled customer with very counter-productive results.

So, what is the unifying concept? Is it intent, organized by modes? Not if what is being unified is a complete user's story about their purchasing experience.

We have a lot of search coverage at our San Francisco conference in a couple of weeks, including a conference keynote, a track keynote, multiple panel sessions, and an in-depth workshop. To complement all of this we are offering a 20% discount to registered attendees who order Beyond Search: What to do When Your Enterprise Search System Doesn't Work, by Stephen Arnold. Steve is being interviewed by Lynda Moulton in the Enterprise Search track keynote, so you can pepper him with questions after you read the report. All registered attendees will automatically get an email with the coupon code to use for the discount. If you can't make it to San Francisco you can still get the report at http://gilbane-store.com/.

Find out more about what we'll be covering in our search track on Lynda's search blog.

Our Publishing Practice released a new report this week: Digital Magazine and Newspaper Editions - Growth, Trends, and Best Practices. This is an interesting study especially because it is not an area covered much, if at all, by other firms. Bill Rosenblatt, who co-authored the report with Steve Paxhia, blogged about the report yesterday. You can download the report at no charge from our new "Research Reports" page.

The new page will be the place to find a listing of our most current reports and studies. You can also find information there about Beyond Search: What to do When Your Enterprise Search System Doesn't Work, by Stephen Arnold, which we released in April (and which is not free - but a great deal!).

We have 5 more reports in the works to be published in the next couple of months, and realized we needed a home for this new series of publications. While you can find most anything on our site with our Google custom search, we have reports going back to 1993, as well as many other types of publications, and thought a new home for current reports would make for a friendlier site.

In case you missed it, we published our latest report, Beyond Search: What to do When Your Enterprise Search System Doesn't Work, by Stephen Arnold, early last week, and it is available at a special introductory price through April 25. More details are at: http://gilbane.com/beyond-search.html, or you can go right to the store at: http://gilbane-store.com/.