Curated for content, computing, and digital experience professionals

Category: Semantic technologies (Page 30 of 72)

Our coverage of semantic technologies goes back to the early 90s when search engines focused on searching structured data in databases were looking to provide support for searching unstructured or semi-structured data. This early Gilbane Report, Document Query Languages – Why is it so Hard to Ask a Simple Question?, analyses the challenge back then.

Semantic technology is a broad topic that includes all natural language processing, as well as the semantic web, linked data processing, and knowledge graphs.


Researching Search with Intent Firmly in Control

I have hit on intent before and our latest member of the Gilbane blog team, Fred Dalrymple has joined the theme with his entry this week. Welcome Fred! You have given me an opening for an already planned topic, how to conduct research for enterprise search tools, those that go beyond the search box. Actually, this guidance is appropriate for the selection of any technology applications.

Getting intent solidly defined is important for so many reasons, many of them relating to solving a business problem and the expected outcomes. Knowing what these are will give you the framework for isolating likely candidates, efficiently. A second critical reason for having strong intent is to stave off project scope creep. As a former vendor, and now consultant, I see this play out repeatedly as product research ensues. Weak backbones in selection team members or flimsiness of their business case leaves openings for vendors to promote additional features, which often distracts from what is really needed.

So, armed with the right skeleton, a strong framework, a core scaffolding you are ready to approach your research systematically. Four paths are open to a study team; I recommend using all of them, in overlapping passes. Discovery about products, product performance in real-world scenarios, vendor business relationships with their clients, and the user community you will be joining are all targets that need to be exploited.

Discovering a user community on-line that might have expressed a potential problem with a vendor or product, should drive you back to do more research to discover potential limitations or why a user might be having a problem that they brought on through inappropriate implementation. Iteration in research for technology requires perseverance and patience. A comment on each path to research might be helpful:

  • Online research – This requires creativity and the most persistence to verify and validate what you find. I am amazed at how superficially many people read any content. We may be taught that good business writing requires a clear statement in the first paragraph of what follows with a solid summary at the end, but most content does not follow “good” business writing practices. You need to read between the lines, think about what is not being said and ask yourself why, follow every link on the sites of vendors under serious consideration. Look at vendor news notes and press releases to see how much activity is going on with product advances or new installations, and read descriptions of customer implementations to see how closely those deployments match your business need. Finally, search those customer names on the Internet in conjunction with the product name. This may retrieve public content that sheds more light on user experiences.
  • Professional groups – Professional organizations in which you participate are fertile ground for asking about what others in similar situations to yours are using. As you get closer to a final choice, go back to others you know personally or professionally to get answers to the direct question, “have you had any problems with this product or vendor?” and “what is the benefit of this product for you?”
  • Societies and academic institutions – These organizations publish content that may have a cost associated. When you consider thousands your organization spends on a selection process (in people time), contracting, licensing, implementation and deployment, it is wise to have a budget of several hundred dollars for reports that give detailed product evaluations. Get recommendations of librarians and peers as to publications’ authoritativeness.
  • User and analyst blogs and industry publications – The same guidance holds for industry publications as for societies and academic publishers but you will also want to pursue blogs of users and analysts. Users are a great source of discovering tidbits about products and vendors but continue beyond what you discover to see if the comments are isolated or follow a pattern.

This is a longer commentary than I intended but the core of my intent needed flesh, so there it is.

Beyond Intent

Intent, hidden within a search click, lies at the intersection of Search and Business, as in “let’s do some business”. That search click has extra-ordinary value because of the intent to buy — that’s why we’re searching, right?

Perhaps, or maybe we’re just browsing, or surfing, and we’re not in the mood for advertisements. It could be more militant than that; perhaps we’re still trying to research our choices and would see a sales pitch as tainting the honesty of the information. At least that’s what the founders of Google originally believed.

Although the model of the web was a set of stateless pages, and a Google search box certainly fits that appearance, people’s intent is not stateless. It ebbs and flows, from entertaining looking around, to researching choices and comparing possibilities, through sourcing a chosen product (now we’re talking about a qualified buyer), to selecting fulfillment options, and possibly all the way to figuring out how to return a product that we’re dissatisfied with. That last one is probably not the best time to present an ad claiming how wonderful that product is.

This is a “long running transaction,” a series of steps that fit together and flow towards (and past) a purchasing decision, but with back-currents and eddies. And it really is a transaction in the database sense where a failure during one step can cause the entire sequence to be discarded as if it never happened. Though if you believe Sergey and Larry, it will be worse than never happening, you may lose trust in your guide through that transaction.

Has the intent changed? Depends on what that means. On one hand, what has changed across those steps is the mode of the intent. If the intent was to purchase a product, then the research, comparison, purchase, and fulfillment were clearly pieces of that intent, though they call for different approaches: organic search for the research, product focused responses for the purchase, perhaps service-oriented for the fulfillment, and some combination for the comparison.

But what about that “I need to return this product because I hate it” step? The intent has clearly changed, but it is more necessary than ever to connect this new intent to the previous steps. If not, perhaps the search engine will continue to suggest that product to a disgruntled customer with very counter-productive results.

So, what is the unifying concept? Is it intent, organized by modes? Not if what is being unified is a complete user’s story about their purchasing experience.

Taking Measure of Search on Vendor Sites

As I was developing concepts put forth in the report Enterprise Search Markets and Applications – Capitalizing on Emerging Demand I bounced around the Internet a lot to verify information I had previously noted about products listed in the vendor directory. As I did so, evidence began to emerge about the ease with which I could resurrect an earlier retrieved bit of content. It mystified me that vendors of products to aid retrieval of content would make it so difficult to find information on their own web site. One assumption of mine has been completely debunked, that vendors would use their own search product to help site visitors discover more about their products and services. It made me wonder why they would not be showcasing the full flavor of their offerings.

The report was not written to evaluate specific products but rather to give a more holistic view of how the markets for products break down and how products themselves can be categorized. In order to do the latter, it required reading about many products with which I had no hands on experience. I wanted to understand how vendors were positioning their products, what markets they felt their products are most suited to satisfy, and what search problems were best solved with their technologies. Coming up with generalizations, trends, and differentiators was one purpose for my research. When I realized how difficult it was to dig out specifics from many vendor Web sites, I moved on, probably leaving stones unturned but time was not on my side.

Now I am going back to learn more about the problem with researching search, something complained about by a number of buyers I interviewed. Vendors are not making it easy for buyers to narrow their search for search, and shame on them. This should be a “no brainer.” If you are a vendor pushing a product that is easy to install, implement and deploy, there is no better way than to put it to work on your own site. On the other hand, if you have products that are more sophisticated in terms of offering complex retrieval by leveraging refined ontologies or rules, you had better take the time to make it work well for finding nuggets on a few hundred pages of your Web site.

I am going to be writing more about this because the deeper I dig, the more interesting the results. For starters, of the first 28 vendor on my list, twelve have no site search. Of those that do, several use a third-party search engine, not their own. One major vendor’s search result count displayed nearly a hundred records that matched the search while also displaying the breakdown of records by category. The trouble was the category numbers totaled less than 20. Hmmm!

Perhaps the trouble in “searchland” is that no one wants to take the time to implement, deploy and maintain search to satisfy the user. I keep saying, “it’s not the technology; it’s the thought and skill that goes into the back room implementation.” Or is it? Stay tuned.

Search is Not Taking a Summer Break & Call for Papers

Amidst post Gilbane San Francisco business. I have been reading what everyone else has been writing about search the past couple of months. While there continues to be much speculation and gossip about the Microsoft acquisition of FAST, and which companies may soon be absorbed into larger entities, there also continues to be interesting activity among the mid-tier and start-up search vendors. Meanwhile, I advise those who aspire to acquire a search solution for “behind the firewall,” don’t wait for the “big players” to come up with the definitive solution to all your search needs because it will never happen. I’m in good company with other analysts who advise moving on with point search solutions for specific business needs. You will save money, and time because most of the new products are optimized for rapid deployment, in weeks or months, not years.

If you check out my new research report, Enterprise Search Markets and Applications; Capitalizing on Emerging Demand, June, 2008, you will find a directory to companies offering search solutions with choices for what Steve Arnold refers to as “beyond search.” Deep test drives of many of these products can be found in his report, as well. Meanwhile, new releases of products listed, and new products both continue to be announced. ISYS, Coveo and Expert System (Cogito) have brought new offerings to market in the last month and Collexis, a relative newcomer, is drawing attention to itself by demonstrating its products at numerous meetings this year.

So, keeping reading and checking out the possibilities. While you are at it, be sure to put the Gilbane Boston Conference on your calendar for December 3 – 4. We are all busy rounding out the program right now.

I am particularly interested in hearing from those of you who have participated in the selection of a search product in the past two years, implementing or deploying a system anywhere within your own enterprise. Please consider sending me a brief proposal for a presentation at the conference. For your effort, you will get to attend all the conference sessions, as well as help the audience with the needed reality checks on what it takes to conduct a selection process and follow through with implementation. I particularly want you to share your learning experiences: the good, the frustrating, and the lessons you have accrued. Professional speaking experience is not required – we want stories. [You’ll find my email on the “Contacts” page of the Gilbane site and you should also look at the speakers guidelines for additional information.]

Afterthoughts on the State of Search

Search for the whole enterprise vs. point solutions was the subject of some discussion, especially since our keynote speaker, Stephen Arnold gave strong guidance that you can’t think about one search solution (“product”) for the entire enterprise and all content. This is something with which I pretty much agree, in most cases.

Just emerging from the Gilbane San Francisco conference, six sessions on search and a workshop I conducted, I want to share a couple of general impressions. Details and expanded reflections will follow in the days and weeks to come.

Search for the whole enterprise vs. point solutions was the subject of some discussion, especially since our keynote speaker, Stephen Arnold gave strong guidance that you can’t think about one search solution (“product”) for the entire enterprise and all content. This is something with which I pretty much agree, in most cases. However, a question arose in one of the sessions in which a couple of presentations talked about a single search engine for what appeared to be the entire enterprise. A member of the audience asked for clarification in view of Arnold’s earlier comments.

I chose to intercede so as not to put our speakers on the defensive about what, for their organizations were very reasonable choices. Both of the cases were for research or professional services organizations with a high incidence of uniformity in the scope and type of content. They are relatively flat in structure with the bulk of the population being researchers: consultants, engineers, scientists. The applications were for intranets that were being leveraged to connect content and experts, so that from either direction (finding an expert and then looking at their content, or finding content to reveal expertise) other professionals could leverage organizational knowledge. It is a safe bet that other search does exist elsewhere in these companies, even if it is in stealth mode or embedded in other applications. Still, in general, large organizations with highly differentiated personnel with functional and disparate content requirements will find value in point search solutions that may only have purpose in a single internal domain.

To that point, if you are a finance professional or business manager you might want to sign up for a webinar this Thursday, June 26th, when I will be laying out a business case for a particular kind of search solution that is targeted at your demographic. This Apps Associates sponsored webinar also describes a solution leveraging Oracle enterprise search, but the ideas in it will give you a sense of what search can provide in your domain.

Judging from the topics presented on search, the reasons and ways in which it is being applied are more diverse than even I imagined. Opinions about what is good/bad, appropriate or not, and how to approach search technology ran the gamut of simple to complex. Two strong points of view were expressed about taxonomy vs. just tagging or letting the search engine categorize. Neither side would give an inch to the other as having an approach that is often “good enough.” It is pretty clear that hybrid solutions offering both a structured approach to search where a taxonomy is applied through metadata, and auto-categorization by the search engine without a supporting taxonomy in the background will be applied in many enterprises.

What is Semantic Technology Anyway?

Meaning is a very large concept in every aspect of search technology and dozens of search product sites include either the words “semantic” or “meaning” as a key element of the offered technology. This is not as far fetched as search product claims to “know” what the searcher wants to find, as if “knowing” can be attributable to non-human operations. However, how well a search engine indexes and retrieves content to meet a searcher’s intent, is truly in the eyes of the beholder. I can usually understand why, technically speaking, a piece of content turns up in a search result, but that does not mean that it was a valid scrap for my intent. My intent for a search cannot possibly be discernible by a search engine if, as is most often the case, I don’t explicitly and eloquently express what, why, and other contextual facts when entering a query.

The session we have set aside at Gilbane San Francisco for a discussion on current activity related to semantic technologies will undoubtedly reveal more meaning about technologies and art of leveraging tools to elicit semantically relevant content. I suspect that someone will also stipulate that what works requires a defined need and clear intent during the implementation process – but what about all those fuzzy situations? I hope to find out.

This is the last posting before the conference this week so I hope you will add this enterprise search session (EST-6: Semantic Technology – Breakdown or Breakthrough) being moderated by Colin Britton to your agenda on June 19th. He will be joined by speakers: Steve Carton, VP Content Technologies, Retrieval Systems Corp., Folksonomies: Just Good Enough for all Kinds of Thing, Prakesh Govindarajulu, President, RealTech Inc, Building Enterprise Taxonomies from the Ground Up, and Jack Jia, Founder & CEO, Baynote.

See you in San Francisco in person or virtually thereafter.

Enterprise Search Expands Beyond the Box

Hustling through my preparation list before the Gilbane San Francisco conference I have come to the fifth session on enterprise search that I’ll be moderating, Mining, Analyzing and Delivering Intelligent Content, featuring Amin Negandi, Principal, Echelon Consulting LLC, speaking on Enterprise Search at A.T. Kearney, and Rob Joachim, Information Systems Engineering Lead, MITRE Corporation presenting a case study on the development of An Expertise Finder Application Built on Enterprise Search. In listening to both of them talk about their projects, these are “must-attend” presentations for those seeking to build search-based solutions for their organizations. Both are examples of the practical and real challenges that surround value building projects. Both have positive outcomes but are hardly implementations that will become static legacy deployments; sustaining a value-based system is an ongoing activity.

As the session abstract states, there are as many technologies for finding content as there are types of content and types of enterprises. Locating a pile of links or citations is rarely the end game for those who really seek to leverage content. Both presenters in this session will talk about solutions that serve real and critical needs for one enterprise, in the first case being able to securely search content across a professional services firm in which collaboration is important within defined proprietary boundaries.

The second case also touches on the need for collaboration and sharing, in this case by enabling location of individuals who are experts. Using the context of content and associations to which they are linked for “defining” individual expertise, search filters relevant metadata to reveal those individuals. Connections are made to locate people and their professional work.

Delivering search results intelligently requires not only technology but also the art of the implementation team. Keeping the focus on specific business outcomes is the essence of ensuring that search delivers intelligent content. The stories of what problem was targeted, what tools were deployed, and how search was implemented by savvy search specialists are the most interesting and useful for learning. Finding out that serendipity also plays a role is getting closer to the best solution is always fun to discover in the process. We’ll be listening on June 19th.

Enterprise Search Executives to Comment on Trends and Challenges

Executives from four companies with unique products for solving search challenges within organizations will share their thoughts on what is most interesting, promising and problematic in the current market at Gilbane San Francisco, session EST-4 on June 19th. Because it is important to consider markets, this type of session gives the panel and audience a chance to recognize the perspectives of each other, sellers and buyers. I’ll be asking the executives to comment on their product strengths, with emphasis on specific value propositions for buyers. There will be an opportunity for the audience to ask questions because what is on the minds of buyers is often the most interesting for everyone to hear. When one listens to questions asked of vendors and hears responses, it reveals two important things about markets:

  • Alignment that exists (or not) between what buyers want and what sellers have to offer
  • Challenges both face to create value

Think about it. When individuals are tasked with selecting any technology on behalf of an organization or organizational unit, their ultimate success depends on selecting a product and company that truly supports a value proposition for that enterprise business need. While the buyer has responsibility for implementing or selecting the right implementation team, s/he rightly depends on good guidance and a healthy relationship with the purveyor of product.

When a technology company puts its product in the hands of a buyer it must do so with the confidence that its product comes with a total value package. By that I mean not just the technology but also the design, toolkit, and support team to guide its successful implementation.

No one, particularly vendors, likes to talk about negatives. However, given all the things that can go wrong for a buyer trying to manage an implementation team or for sellers who don’t anticipate expectations about their products not explored during the selection process, it is important to consider factors that lead to failure or less than satisfactory outcomes. One question I will have for vendors is to share honestly some of the challenges or disappointments about the market that are a particular point of pain for them. Bad-mouthing customers is not the answer but conveying how hard most vendors honestly try to create value and how their best intentions can be derailed through miscommunication may help buyers and sellers smooth the communication flow.

After all, don’t we all want to provide value for our internal and external customers? I think you will find the panel a receptive group: a 25+-year veteran of the information access market, a marketing executive with an international search and text analytics firm, a founder of a rapidly growing plug-and-play search solution, and a marketing VP working to position a company with a large scale solution against the “big-three” search solutions. You’ll hear straight talk and interesting value propositions.

Speakers: Margie Hlava, President, Accession Innovation, David Haucke, VP Global, Marketing, ISYS, Laurent Simoneau, President & CEO, and Rebecca Thompson, VP Marketing, Vivisimo

« Older posts Newer posts »

© 2024 The Gilbane Advisor

Theme by Anders NorenUp ↑