Newsletters Welcome, Guest Log In | Register

Enterprise Software

Insights on enterprise software markets to help define smart strategy

About this Blogger RSS

Subscribe

Sign up now and get the best business technology insights direct to your inbox.

  • Daily Edge
  • CTO Edge Update
  • Business Tools & Templates
  • Aligning IT & Business Goals
  • Maximizing IT Investments

0

In Some Search Software, It All Depends on the Meaning of 'It'

Posted by Dennis Byron Sep 30, 2008 12:13:23 PM

From Matthew Broderick's War Games to the Tom Cruise movie The Minority Report, films like to make it seem like IT has human qualities. But you know different.

 

IT doesn't infer anything from the number, character and color coding it pushes around inside the box. Or relate one set of bits to the other. Or conceptualize. It just moves zeros and ones around the way IT guys tell it to. In other words, forget the movies, IT can't "think."

 

But I talked with a company CEO on Sept. 26 who is working on the character-code part of the getting-computers-to-think challenge. Or at least getting them to infer, relate and conceptualize.

 

Jeff Catlin is CEO of Massachusetts-based Lexalytics, which is about to become part of London-based Lexalytics Limited, a subsidiary of Infonic (LSE: IFNC). The two companies have been working separately to develop similar, and they hope symbiotic, technology for semantic search and text analytics.

 

In the near term, the applications will be working with character codes that are strung into words. And they have to be English words.  And Catlin's software is still having a bit of a problem with the word "it." Lexalytics' ability to work with little words might sound trivial but it is the real challenge in text analytics. Take for example my use of the pronoun "it" halfway through the previous sentence. I used the word rather than repeating "ability." But some text analytics software might have inferred I meant Lexalytics, the company, or its software instead.

 

Despite the "it" issue, Lexalytics' latest software, due out in October, has a real good handle on "he" and "she." Which means semantic search and text analytics software is coming to an IT application near you sooner rather than later.  Both IT managers and marketers want to integrate it into enterprise applications for the same reason they have been integrating numbers-oriented analytical applications for the last decade: make data cleaner, extract metadata and spot trends and patterns in unstructured data.

 

Text analytics goes further than traditional analytics because it can enhance the power of now-ubiquitous search engines, whereas traditional analytics work primarily with ERP and like applications dependent on structured data. Lexalytics' technology does not stand alone but works with partners such as Microsoft FAST and Endeca. Its engine works fundamentally like a human; that is, inferentially. It is not scoring-based, for example, like a Fair Issac Corp (FICO)-based credit application. Instead, Lexalytics' software is based on sentence structure and has a part-of-speech tagger, draws pertinent metadata from content (people, dates, etc.) and mines relationships (e.g., relating a person's job title to the company he or she works for).

 

One final factoid to consider:  In handling the he-she-it thing mentioned above, so far the Lexalytics software does best understanding "she" in context.  That's because "she" is mentioned less often in unstructured data.  Another glass ceiling to crack, ladies.

Add a comment Leave a comment on this blog post.

There are no comments on this post

Software Forum: Information On Demand Virtual Experience

This interactive virtual forum presents leading IT experts providing the insights you need to turn your information into a strategic driver for innovation, business optimization and competitive differentiation.

Performance Under Pressure: The State of Enterprise Web Application Quality and Availability

This research study finds that Web application issues are an all-too-common problem and examines these Web-based enterprise application issues from two perspectives: that of an online customer and that of a site manager.

Security SaaS Solutions

Hosted security solutions that not only protect your data, but reduce your security management TCO, as well.

Data Warehousing for Business Intelligence

Comprehensive storage solutions for better data access and retrieval, leading to better-informed business decisions.

Decision Management

Applications, management tools and industry advice on how to optimize your data for better business decisions.

Responding to Change

The technology tips and tools to enhance your ability to respond to business change with ease and success.

Budget & Finance Toolkit for IT - 2010 Edition

What kind of year are you planning in 2010?  Growth or continued "survival mode"?  Download a comprehensive collection of templates, forms, instruction and advice that will help you to plan and submit your 2010 IT Budget.

Learn more >

Six Sigma Framework for IT

This collection of tutorials, calculators, and templates will show you how to apply six sigma thinking to IT service management.

Learn more >