XML Technologies & Content Strategies

New Gilbane Beacon on High-Volume Data Challenges

2010-03-03T20:48:48Z

We've published a new paper on addressing large-scale integration, storage, and access of complex information. As Dale mentions in his entry over on our main blog, the paper frames the discussion in terms of challenges to Open Government initiatives. We note, though, that the exploration of obstacles to effective, efficient processing of high volumes of data and content is relevant across many industries.

We're cross-posting here on the XML blog because the paper deals wtih XML content and the XML family of standards, including XQuery and XPath.

The Gilbane Beacon is available as a free download from Gilbane and from Mark Logic, sponsor of the paper.

Focusing on the "Content" in Content Management

2010-01-04T14:31:20Z

The growth in web-centric communication has created a major focus on content management, web content management , component content management, and so on. This interest is driven primarily by increasing demand for rich, interactive, accessible information products delivered via the Web. The focus is not misplaced but may be missing part of the point. To be specific, in our focus on the "management" part of CM, we may be missing the first word in the phrase.... "Content."

It's true that the application of increasing amounts of computer and brain power to the processes associated with preparing and delivering the kind of information demanded by today's users can improve those products. But it does so within limits set by and at costs generated by the content "raw material" it gets from the content providers. In many cases, the content available to web product development processes is so structurally crude that it requries major clean-up and enhancement in order to adequately participate in the classification and delivery process. As the focus on elegant Web delivery increases, barring real changes in the condition of this raw content, the cost of enhancement is likely to grow proportionally, straining the involved organizations' ability to support it.

The answer may be in an increased focus on the processes and tools used to create the original content. We know that the original creator of most content knows the most about how it should be logically structured and most about the best way to classify it for search and retrieval. Trouble is, in most cases, we provide no means of capturing what the creator knows about his or her intellectual product. Moreover, because many creators have never been able to fully populate the metadata needed to classify and deliver their content, in past eras, professional catalogers were employed to complete this final step. In today's world, however, we have virtually eliminated the cataloger, assuming instead that the prodigious computer power available to us could develop the needed classification and structure from the content itself. That approach can and does work, but it will require better raw material if it is to achieve the level of effectiveness needed to keep the Web from becoming a virtual haystack in which finding the needle is more good luck than good measure. Native XML editors instead of today's visually oriented word processors, spreadsheets, graphics and other media forms with content-specific XML under them, increased use of native XML databases and a host of rich content-centric resources are part of this content evolution.

Most important, however, may be promulgation of the realization across society that creating content includes more than just making it look good on the screen, and that the creator shares in that responsibility. This won't be an easy or quick process, requiring more likely generations than years, but if we don't begin soon, we may end up with a Web 3 or 4 or 5.0 trying to deliver content that isn't even yet 1.0.

In the end, good search may depend on good source.

2010-01-02T16:35:21Z

As the world of search becomes more and more sophisticated (and that process has been underway for decades,) we may be approaching the limits of software's ability to improve its ability to find what a searcher wants. If that is true, and I suspect that it is, we will finally be forced to follow the trail of crumbs up the content life cycle... to its source. Indeed, most of the challenges inherent in today's search strategy and products appears to grow from the fact that while we continually increase our demands for intelligence on the back end, we have done little if anything to address the chaos that exists on the front end. You name it, different word processing formats, spreadsheets, HTML tagged text, database delimited files, and so on are all dumped into what we think of as a coherent, easily searchable body of intellectual property. It isn't and isn't likely to become so any time soon unless we address the source. Having spent some time in the library automation world, I can remember the sometimes bitter controversies over having just two major foundations for cataloging source material (Dewey and LC; add a third if you include the NICEM A/V scheme.) Had we known back then that the process of finding intellectual property would devolve into the chaos we now confront, with every search engine and database product essentialy rolling its own approach to rational search, we would have considered ourselves blessed. In the end, it seems, we must begin to see the source material, its physcial formats, its logical organization and its inclusion of rational cataloging and taxonomy elements as the conceptual raw material for its own location. As long as the word processing world teaches that anyone creating anything can make it look like it should in a dozen different ways, ignoring any semblance of finding-aid inclusion, we probably won't have a truly workable ability to find what we want without reworking the content or wading through a haystack of misses to find our desired hits. Unfortunately, the solutions of yesteryear, including after-creation cataloging by a professional cataloger, probably won't work now either, for cost if no other reason. We will be forced to approach the creators of valuable content, asking them for a minimum of preparation for searching their product, and providing the necessary software tools to make that possible. We can't act too soon because, despite the growth of software elegance and raw computer power, this situation will likely get worse as the sheer volume of valuable content grows. Regards, Barry Read more: Enterprise Search Practice Blog: http://gilbane.com/search_blog/

What is Smart Content?

2009-11-24T20:18:33Z

At Gilbane we talk of "Smart Content," "Structured Content," and "Unstructured Content." We will be discussing these ideas in a seminar entitled "Managing Smart Content" at the Gilbane Conference next week in Boston. Below I share some ideas about these types of content and what they enable and require in terms of processes and systems.

When you add meaning to content you make it "smart" enough for computers to do some interesting things. Organizing, searching, processing, and discovery are greatly improved, which also increases the value of the data. Structured content allows some, but fewer, processes to be automated or simplified, and unstructured content enables very little to be streamlined and requires the most ongoing human intervention.

Most content is not very smart. In fact, most content is unstructured and usually more difficult to process automatically. Think flat text files, HTML without all the end tags, etc. Unstructured content is more difficult for computers to interpret and understand than structured content due to incompleteness and ambiguity inherent in the content. Unstructured content usually requires humans to decipher the structure and the meaning, or even to apply formatting for display rendering.

The next level up toward smart content is structured content. This includes wellformed XML documents, content compliant to a schema, or even RDMS databases. Some of the intelligence is included in the content, such as boundaries of element (or field) being clearly demarcated, and element names that mean something to users and systems that consume the information. Automatic processing of structured content includes reorganizing, breaking into components, rendering for print or display, and other processes streamlined by the structured content data models in use.

Finally, smart content is structured content that also includes the semantic meaning of the information. The semantics can be in a variety of forms such as RDFa attributes applied to structured elements, or even semantically names elements. However it is done, the meaning is available to both humans and computers to process.

Smart content enables highly reusable content components and powerful automated dynamic document assembly. Searching can be enhanced with the inclusion of metadata and buried semantics in the content providing more clues as to what the data is about, where it came from, and how it is related to other content.Smart content enables very robust, valuable content ecosystems.

Deciding which level of rigor is needed for a specific set of content requires understanding the business drivers intended to be met. The more structure and intelligence you add to content, the more complicated and expensive the system development and content creation and management processes may become. More intelligence requires more investment, but may be justified through benefits achieved.

I think it is useful if the XML and CMS communities use consistent terms when talking about the rigor of their data models and the benefits they hope to achieve with them. Hopefully, these three terms, smart content, structured content, and unstructured content ring true and can be used productively to differentiate content and application types.

Nuts and Bolts Tutorials at The Gilbane Conference

2009-11-23T14:38:36Z

In a world that seems increasingly about technology itself, it has become tempting to assume that the questions and challenges of new and better information products is about the technology. While it is true that technology is the key enabler of the new information world we are building, it is also true that the decision making and judgment involved in how that technology is to be organized and deployed is of equal--and not decreasing--importance. Indeed, as the products move toward increasing sophistication and flexibility--smart content you might say--the importance of the human and organizational parts of the information life cycle become even more important.

It is a truism that you cannot deliver information products you can't create and manage, and with the circle of participants in that creation and management ever widening, we must be sensitive to the limits of the creators. Moreover, while just "getting it up on the web" used to be at least sufficient to justify deployment of information products, today's information consumer has a much more extensive and demanding list of features required before he will accept web-based information. The publisher who forgets or ignores that list is for trouble.

In a half-day session preceding the Gilbane conference next week, the Gilbance consulting team will tackle some of the real world challenges inherent in this rapidly changing information world, providing both sign posts for issues likely to come up and "in the trenches" suggestions for how to deal with them. The goal of the session, scheduled for the afternoon of December 1, is that the attendees leave with a better handle on how to proceed in the quest for better information products and the role "smart content" should play.

The presenters, in addition to their expertise in the technology and tools of information, bring a unique resource to their efforts: years of design, implementation and evaluation of real organizations facing real challenges.

Upcoming Workshop: Managing Smart Content: How to Deploy XML Technologies across Your Organization

2009-11-23T13:50:16Z

As part of next week's Gilbane Boston Conference, the XML practice will be delivering a pre-conference workshop, "Managing Smart Content: How to Deploy XML Technologies across Your Organization." The instructors will be Geoff Bock, Dale Waldt, Bill Trippe, Barry Schaeffer and Neal Hannon--a group of experts that represents decades of technical and management experience on XML initiatives.

A tip of the virtual hat to Senior Analyst Geoff Bock for organizing this.

]]> Smart content holds great promise. First with SGML and now with XML, we are marking up content with both formatting and semantic tags, and adding intelligence to electronic information. Using richly tagged XML documents that exploit predefined taxonomies, we are developing innovative applications for single source publishing, pharmaceutical labeling, and financial reporting. By managing content snippets in a granular yet coherent fashion, these applications are revolutionizing our capabilities to meet business needs and customers’ expectations.

What’s working and why? What are the lessons learned from these innovative applications? Does the rapid growth of web-based collaborative environments, together with the wide array of smart content editors, provide the keys to developing other business solutions? There are many promising approaches to tagging content while doing work. Yet we still face an uphill battle to smarten up our content and develop useful applications.

In this workshop, we the five members of the Gilbane practice on XML technologies will share our experiences and provide you with practical strategies for the future. We will address a range of topics, including:

The business drivers for smart content
Some innovative content management techniques that make authors and editors more productive
The migration paths from ‘conventional’ documents to smart content
How to apply industry-specific taxonomies to tag content for meaning
The prospects for mash-ups to integrate content from disparate application communities

We will discuss both the rapidly developing technologies available for creating, capturing, organizing, storing, and distributing smart content, as well as the organizational environment required to manage content as business processes. We will identify some of the IT challenges associated with managing information as smart content rather than as structured data, and map strategies to address them. We invite you to join the conversation about how best to exploit the power of XML as the foundation for managing smart content across your organization.

Once Upon a Time...

2009-11-12T18:39:33Z

... there was SVG. People were excited about it. Adobe and others supported it. Pundits saw a whole new graphical web that would leverage SVG heavily. Heck, I even wrote a book about it.

Then things got quiet for a long time...

However, there are some signs that SVG might be experiencing a bit of a renaissance, if the quality of presentations at a recent conference is a strong indication. It's notable that Google hosted the conference and even more notable that Google is trying to bigfoot Microsoft into supporting SVG in IE, a move that would substantially boost SVG as an option for Web developers.

So a question for those out there interested in SVG. Where are some big projects out there? Are there organizations creating large bases of illustrations and other graphical content with SVG? I would love to talk to you and learn about your projects. You can email me or comment below.

UPDATE: Brad Neuberg of Google, who is quoted in the InfoWorld article linked above, sent along a link to a project at Google, SVG Web, a JavaScript library that supports SVG on many browsers, including Internet Explorer, Firefox, and Safari. According to the tool's website, using the library plus native SVG support, you can instantly target ~95% of the existing installed web base.

UPDATE: Ruud Steltenpool, the organizer for SVG Open 2009, sent a link to an incredibly useful compendium of links to SVG projects, tools, and other resources though he warns it is a little outdated.

Some Excellent Coverage of our Digital Publishing Report

2009-09-04T19:11:07Z

Over at TeleRead, David Rothman has a really fine writeup discussing our digital publishing report. He summarizes some of our key points about asset management and flexibility, but also raises some interesting related issues about DRM and the risks of "publishers as mixmasters."

My thanks to David for his thoughtful response.

XML's Role in Digital Archives

2009-08-27T21:26:55Z

I have a new post over at EMC's Community site, "Preserving Electronic Public Records: Lessons from the Washington State Digital Archives." This is part of our ongoing series for EMC on the use of ECM and XML in the public sector.

Do you Have an eBook Strategy Yet?

2009-08-24T19:53:30Z

We have been very pleased with the interest in our new report, Digital Platforms and Technologies for Publishers: Implementations Beyond "eBook." We have had hundreds of downloads already, the vast majority of which are senior people in the publishing industry. This tells us that the timing for the research is good and that interest is strong, and we are thinking about what to do next with this topic.

One idea we have thought about is helping publishers think through their eBook strategy. If our research (and other recent research) is correct, many larger publishers are jumping in with both feet, but some larger publishers, many medium-sized, and perhaps most smaller publishers are staying on the sidelines or testing the waters with pilots and low-cost and low-impact tests with third parties. Perhaps these efforts are part of developing a strategy? Perhaps some of you think the market is too nascent?

An eBook strategy would necessarily be multi-faceted, and would include input from sales, marketing, editorial, production, fulfillment, and others with a stake in the process. It would need to be informed by good market data, and with good understanding of what technology and channel partners can truly offer publishers. It would also need to be pragmatic, balancing the capabilities of your organization with a realistic assessment of the market opportunities you have.

We'd like to gauge interest in this kind of offering through the following simple poll. Just one question, and no requirement to log in or register. If you would like to talk in more detail about this idea, please email me with any questions.

Click Here for Poll Online Survey
| Website Polls
| Email Marketing

| Crowdsourcing Software
View MicroPoll

CMIS Use Cases

2009-08-17T23:18:01Z

If you're like me and have been thinking about CMIS (Content Management Interoperability Services), but need some use cases to help you conceptualize it better, Laurence Hart has put together a very useful presentation. He welcomes comments.

As usual, Robin Cover has a great list of resources here.

Mind the XBRL GAAP

2009-08-11T18:25:37Z

Recently, XBRL US and the FASB released a new taxonomy reference linkbase to enable referencing to the FASB Codification. The FASB Codification is the electronic data base that contains all US GAAP authoritative literature and was designated as official US GAAP as of July 1, 2009. Minding the GAAP between the existing 2009 US GAAP taxonomy reference linkbase, which contains references to the old GAAP hierarchy (such as FAS 142r or FAS 162) and the new Codification system is an interesting trip indeed.

The good news is that the efforts of the XBRL US people working in co-operation with FASB and the SEC have resulted in direct links from the new XBRL reference database to the Codification. There are a couple problems, however.

The new reference linkbase is unofficial and will not be accepted by the SEC's EDGAR system. URI links point to the proper places in the COD for FASB publications but require a separate log in and give you access to the public (high level) view only.

Firms and organizations with professional access to the Codification will not find this a problem, but individual practitioners will have to subscribe (at $850 per year) to get any views beyond the bare bones.

SEC literature stops at the top of the page for ALL SEC GAAP citations. For example, any XBRL element that has a regulation SX reference will point to exactly the same place, the top of the document. Not very useful. The SEC should address this.

So it appears we have three levels of accounting material to deal with, 1) the high level public access literature, which is official US GAAP in the Codification; 2) the professional view additional detail and explanations, and 3) and the non-GAAP material the FASB left out of the COD that is in their hard copy literature but didn't make the COD/US GAAP cut. Ideally, all literature coming from the SEC or the FASB should be, in my opinion, easily accessible via the Internet.

The present plans to fix the GAAP in the US GAAP XBRL taxonomy are to wait until the 2010 taxonomy is issued (Spring 2010). Although this would give the SEC plenty of time to tweak the EDGAR system into accepting the new linkbase, until then users of XBRL will have to accept workarounds to discover the authoritative literature link from an XBRL element tag and official US GAAP.

Give Financial Statements an MRI with XBRL

2009-07-17T13:38:57Z

Recent news item: CLEVELAND (AP) — Indians outfielder Grady Sizemore is feeling better and will have an MRI on his strained left elbow on Monday.

It has become very commonplace for doctors to order an MRI for patients experiencing pain. According to Radiology Info.com, Magnetic resonance imaging (MRI) is a noninvasive medical test that helps physicians diagnose and treat medical conditions. The website goes on to say, “MR imaging uses a powerful magnetic field, radio frequency pulses and a computer to produce detailed pictures of organs, soft tissues, bone and virtually all other internal body structures. The images can then be examined on a computer monitor, printed or copied to CD.” (see http://www.radiologyinfo.org/en/info.cfm?pg=bodymr)

In a similar fashion, XBRL puts a company’s financial statements under a transformation that exposes detailed pictures of the underlying accounting backing every line item. This information can then be analyzed and compared by computer software to help determine a company’s financial health.

For example, let’s look at a sample line item from the Marathon Oil SEC filing covering the quarter ending September 30, 2008. The form 10-Q has a line on financial statement that reads:

Loss on early extinguishment of debt 120 (nine months ending September 30, 2007, in millions)

When you give that line item the XBRL MRI treatment, computers can extract the XBRL label:

us-gaap:GainsLossesOnExtinguishmentOfDebt

the definition of the item:

Amount represents the difference between the fair value of the payments made and the carrying amount of the debt at the time of its extinguishment.
And the authoritative literature that backs up the accounting decisions:

the reference:

Presentation Reference

Name                  Accounting Principles Board Opinion (APB)
Number               26
Paragraph          20, 21
Publisher           AICPA

Inquiring minds will take a close look at APB 26 for more detail. This examination should yield a much clearer understanding of the basis for reporting the number and therefore yield a better understanding of the financial statement.

Note: Mr. Sizemore returned to full duty with the Cleveland Indians shortly after his MRI.

When is a Book Not a Book?

2009-07-16T19:00:44Z

I recently wrote a short Gilbane Spotlight article for the EMC XML community site about the state of Iowa going paperless (article can be found here) in regards to its Administrative Code publication. It got me to thinking, "When is a book no longer a book?"

Originally the admin code was produced as a 10,000 page loose-leaf publication service containing all the regulations of the state. For the last 10 years it has also appeared on the Web as PDFs of pages, and more recently, independent data chunks in HTML. And now they have discontinued the commercial printing of the loose-leaf version and only rely on the electronic versions to inform the public. They still produce PDF pages that resemble the printed volumes that are intended for local printing of select sections by public users of the information. But the electronic HTML version is being enhanced to improve reusability of the content, present it in alternative forms and integrated with related materials, etc. Think mashups and improved search capabilities. The content is managed in an XML-based Single Source Publishing system that produces all output forms.

I have migrated many, many printed publications to XML SSP platforms. Most follow the same evolutionary path regarding how the information is delivered to consumers. First they are printed. Then a second electronic copy is produced simultaneously with the print using separate production processes. Then the data is organized in a single database and reformatted to allow editing that can produce both print and electronic. Eventually the data gets enhanced and possibly broken into chunks to better enable reusing the content, but the print is still a viable output format. Later, the print is discontinued as the subscription list falls and the print product is no longer feasible. Or the electronic version is so much better, that people stop buying the print version.
So back to the original question, is it no longer a book? Is it when you stop printing pages? Or when you stop producing the content in page-oriented PDFs? Or does it have to do with how you manage and store the information?

Other changes take place in how the information is edited, formatted, and stored that might influence the answer to the question. For instance, if the content is still managed as a series of flat files, like chapters, and assembled for print, it seems to me that it is still a book, especially if it still contains content that is very book oriented, like tables of contents and other front matter, indexes, and even page numbers. Eventually, the content may be reorganized as logical chunks stored in a database, extracted for one or more output formats and organized appropriately for each delivery version, as in SSP systems. Print artifacts like TOCs may be completely generated and not stored as persistent objects, or they can be created and managed as build lists or maps (like with DITA). As long as one version is still book-like, IMHO it is still a book.

I would posit that once the printed versions are discontinued, and all electronic versions no longer contain print-specific artifacts, then maybe this is no longer a book, but simply content.

Busy Week in XML Content Management Market

2009-07-01T18:32:56Z

Holiday weeks can be sleepy weeks in enterprise software news, but this week has seen one significant press release each day in the XML content management market, or component content management (CCM) market if you prefer.

On Monday, SDL announced the acquisition of XyEnteprise, and the creation of a new business unit based on XyEnterprise and Trisoft called SDL-XySoft.
On Tuesday, Really Strategies, the makers of the Marklogic-Server-based system RSuite, announced the acquisition of SaaS CCM provider DocZone.
Today, Quark and EMC announced an integration of Quark XML Author with Documentum.

First, the necessary disclosures and caveats. Of the six companies mentioned, we've worked with all of them, I believe, and I actually worked for XyEnterprise back in the 1980s and early 1990s. That said, each of these announcements is significant.

SDL, through both organic growth and acquistion, has grown into a substantial business that spans globalization technology, globalization services, CCM technology, and WCM technology. My colleagues Mary Laplante and Leonor Ciarlone know them much better as a company, but I believe it is safe to say that SDL is in a unique position spanning essentially four markets, but four markets that make a great deal of sense under a single umbrella. The product support content managed in a CCM technology is the best point of integration for globalization/translation tools. A CCM technology is also an excellent underpinning for a global company's web presence or web precenses (the latter more likely, especially when one considers the need for localized web sites). And services are an essential piece of this puzzle. It's the rare company that staffs heavily for localization, and even when they do, very few would staff full time to cover all of their language needs. Is SDL in a position to represent one-stop shopping for large companies with complex product content that needs to be localized into many languages? Again, my colleagues could answer that question more precisely, but it's not a crazy question to ask.

Mary has more on SDL XySoft over in the globalization blog.

The acquisition also breathes new life into XyEnterprise, a company with highly functional, mature technology and excellent executive leadership. We take it as a very positive sign that XyEnterprise CEO Kevin Duffy will become the CEO of the newly combined business unit, reporting to Mark Lancaster, Chairman and CEO of SDL.

The Really Strategies acquistion of DocZone is on a smaller scale of course, but it is is significant in that these two companies represent two leading trends in the CCM marketplace--management of component content in native XML repositories (MarkLogic Server for RSuite and Documentum Content Store for one version of DocZone) and Software as a Service (SaaS). Count me among those who have been skeptical at times about SaaS for CCM, but DocZone, under Dan Dube's leadership, has made it work. Really Strategies, in the mean time, has developed an impressive CCM offering on top of Mark Logic Server, and they have quietly built up a strong customer list. We think the combined companies complement each other, and the new management team is excellent, with Barry Bealer as CEO, co-founder Lisa Bos as CTO, Ann Michael in charge of services, and Dan Dube as VP Sales and Marketing.

Which brings us to Quark and EMC. Both companies have been developing more CCM capabilities. EMC acquired X-Hive, and a lot of XML expertise along with it. They have since added more XML expertise on both the product management and engineering side. As they have integrated X-Hive into the Documentum platform, they have logically looked to build out more capabilities and applications for vertical markets. The integration with Quark XML Author makes perfect sense for them, giving their customers and prospects a ready mechanism for XML authoring in a familiar editorial tool.

For Quark's part, the move is a logical and very positive next step. They had previously announced this kind of integration with IBM Content Manager, which has a strong presence in the manufacturing space. With EMC, Quark now has a strong partner in the pharma space. Documentum has long dominated pharma, and Quark XML Author, under Michael Boses and previous owner In.Vision, had built up a long list of pharma customers. Boses and his team know the pharma data structures inside and out, and it will be interesting to see the details of how Quark XML Author will integrate with Documentum and its storage mechanisms. (I am sure both EMC and Quark see the potential as more than just the pharma market--government is also a good target here--but the pharma angle will be fruitful I am sure.)

So, what news is on tap for tomorrow?