Search Technologies and Products: February 2007 Archives

A tough truth about complex and integrated software applications is the lack of expertise and professional depth available to implement and maintain them. This explains a lot about why small business units and project teams often find and deploy their own software tools to get work done.

I am particularly concerned at the lack of will by organizations to fund implementation of applications like enterprise search to aggregate at the retrieval-end the content stored within disparate applications. No rational business planning can justify having workers sift through multiple repositories, each with a separate sign-on, search interface, and search engine protocols just to find a single document. True, organizations need highly competent professionals to meaningfully implement, tune, and administer enterprise search engines. They require the expertise of search analysts, taxonomists, librarians, IT specialists with security, platform, and software development training. However, developing a team of six to twelve “search engineers” to give workers in a thousand person company quick access to relevant content is an ROI no brainer when we know workers waste significant (5 – 15%) amounts of working hours hunting for stuff.

This week’s Information Week article by Nicholas Hoover on Web 2.0 contained a comment about Wells Fargo “…on another Enterprise 2.0 front, integrated search, the company has limited employees’ ability to search across data repositories because of the complex authorization schemes needed to keep people from accessing information they shouldn’t.”

Today’s (Feb. 27th) New York Times headlined with a story about Microsoft buying “a specialized search engine tailored to deliver useful medical information to consumers,” Medstory, Inc. The story goes on to cite comments by Esther Dyson who refers to the technology as “an ontology engine.” This underscores another truth about quality semantic (natural language) search; it depends on the existence of meaningful, topic specific vocabulary and concept maps to work well, a complexity in narrower markets.

Finally, we have seen the recent shift of companies like FAST moving from a strategy of selling solutions directly to enterprises for the purpose of aggregating content through a unified search portal to focusing on niche markets and highly tailored search architectures.

These are just three cases of a shift among search companies to leverage their search technology IP in more lucrative offerings. The losers will be organizations that really do need to deliver content more holistically to workers through a single search engine. Yes, security is a concern, and skilled search technologists must be hired and dedicated to delivering search options that tie directly to business operations.These efforts are not one-off projects but need to be sustained as permanent infrastructure. If you are in a position to influence search procurement solutions make your case for the most suitable software that will really help deliver the best retrieval option company-wide. Be realistic about funding and staffing; then go for it. If Enterprise Search is what you need, make sure that is what you get and deploy.

My silence last week had more to do with information overload than lack of interesting things to write about. Be forewarned, the floodgates of my brain are beginning to creak open. I just returned from Fast Search’s FastForward 07 conference in San Diego where their current and future visions for search technologies were front and center. While there seem to be no lack of innovations for how to make search engines smarter, faster, and more adaptable, the innovations being hyped at FastForward 07, and by others with only slightly less hyperbole, are notable. Search is becoming sexy and not just for the amount of money that Google and second-ranked Fast are raking in. In this arena search is the new business frontier, the marketplace-enabler, the marketplace-maker.

Consider this, search technologies have been business necessities for 35 years. For the first 30, search was strictly a support feature to many other kinds of finding mechanisms. In the earliest days search was performed by specialists as a service to other operations in the organization. Attempts to market search technology options to line managers, analysts, attorneys and R&D staff were marginal in their success. This is because search was not used enough for these groups to acquire the skill required for it to be really valuable. Once Web search engines exposed everyone to the possibilities of search in a far simpler modality, the innovation light bulbs popped off.

Suddenly search for use within the enterprise has become search for the enterprise’s marketplace, a major business driver that will put an organization’s products, services, and assets squarely in front of the right buying audience. What this means for those poor souls who still need to find the stuff mounting valuelessly in inaccessible silos remains to be seen. I am excited by what I saw but concerned by what I am witnessing. It is great that I may be able to find that weird audio adapter on the Web to let me connect to the sound system in the skating rink. But it is really awful when an engineering firm can’t put it’s hands on the schematic that shows how a circuit board was modified and delivered three years ago to a top customer.