Comments on: The Oracle of Unstructured Information: A Three-Horse Race http://kellblog.com/2010/01/21/the-oracle-of-unstructured-information-a-three-horse-race/ The official blog of Dave Kellogg Thu, 09 Feb 2012 19:36:00 +0000 hourly 1 http://wordpress.com/ By: Dave Kellogg http://kellblog.com/2010/01/21/the-oracle-of-unstructured-information-a-three-horse-race/#comment-3036 Thu, 19 Aug 2010 20:56:37 +0000 http://test.kellblog.com/2010/01/21/the-oracle-of-unstructured-information-a-three-horse-race/#comment-3036 Sameer,

Thanks for sharing. Very interesting.

]]> By: Sameer Nori http://kellblog.com/2010/01/21/the-oracle-of-unstructured-information-a-three-horse-race/#comment-3035 Thu, 19 Aug 2010 19:54:42 +0000 http://test.kellblog.com/2010/01/21/the-oracle-of-unstructured-information-a-three-horse-race/#comment-3035 Dave

Interestingly seems that Endeca is now organized by three markets(Public Sector, Enterprise & Ebusiness) as evidenced by their new management structure.

http://www.endeca.com/about-us-leadership-team.htm

]]> By: Dave Kellogg http://kellblog.com/2010/01/21/the-oracle-of-unstructured-information-a-three-horse-race/#comment-3034 Wed, 03 Feb 2010 18:19:13 +0000 http://test.kellblog.com/2010/01/21/the-oracle-of-unstructured-information-a-three-horse-race/#comment-3034 Felciano — here is an answer provided by Jason Hunter of the Mark Logic team:Taxonomies and ontologies are (in our view) an application-level feature. MarkLogic supports taxonomies and ontologies by providing robust building-blocks that make it really easy to build them, in the various shapes and sizes that our customers require. At K&L, for example, there are a few ways to handle the hierarchical geographic representation.* Have each document know its country, sub-region, and appellation.<geography> <country>United States</country> <subregion>California</subregion> <appellation>Napa Valley</appellation></geography>The top listing would be to show country values (and counts) matching the other constraints. The sub-region listing would be to show subregion values and counts matching the other constraints plus the country = "X" constraint. We can very quickly do that. And the appellation listing would be to show appellation values and counts matching the other constraints plus the established country and subregion constraints. This works fine for a taxonomy that isn't under a lot of flux. This also lets you do what K&L does and show both Country and Sub-Region as top-level listings.* Use geospatial indexes. Normally this isn't an option, but it would be here for a geographic constraint. Assign a geo point to every winery. Define countries, subregions, and appellations by different polygon bounding boxes.* Use an external value-centric definition. This is somewhat like the geospatial indexes approach in that you give each item its final value (but textual instead of geographic) and use an external definition to define the higher-up groupings (California consists of Napa Valley, Sonoma County, and …). Use OR queries to group the different text values. This works well when the groupings change more often.* Use scalar index bucketing. For anything with a number value (i.e. prices, sizes, ratings) there's built-in support for bucketing. Each item gets a price and you can bucket to arbitrary groupings. You can shrink the bucket sizes on each refinement. Bucket sizes can be declared externally or calculated programmatically based on peeking at the search results.This is just a sampling of ways you can use our built-in query and analytic tools to build a hierarchical or otherwise nested taxonomy or ontology. Looking at the K&L site it'd be pretty easy to do all the features I see. And with MarkLogic it's possible to do it against millions of items before even having to cluster, and billions of items in a cluster.

]]> By: felciano http://kellblog.com/2010/01/21/the-oracle-of-unstructured-information-a-three-horse-race/#comment-3033 Thu, 28 Jan 2010 22:35:51 +0000 http://test.kellblog.com/2010/01/21/the-oracle-of-unstructured-information-a-three-horse-race/#comment-3033 Out of curiosity Dave, does MarkLogic support the sorts of taxonomy-based searches shown on the K&L Wine site? It seems like publishers — especially Science and Technology — would benefit from being able to leverage taxonomies and ontologies defined for markets and fields of study that have unusually large and complicated domain vocabularies.For example, on the K&L site, if you narrow the wines down by region to California, you will then be able to further filter by sub-region specific to California (Napa Valley, Sonoma County, etc). This level of structure probably isn't in the document itself, but is in the definition of the facet space.I'm asking because it seems like this type of structure — the knowledge that Sonoma County and Napa Valley are both in California — is what a structured DB can really help with, but I'm struck that there is very little mention of taxonomies, ontologies, etc on the MarkLogic site.

]]> By: Stephen http://kellblog.com/2010/01/21/the-oracle-of-unstructured-information-a-three-horse-race/#comment-3032 Fri, 22 Jan 2010 21:03:16 +0000 http://test.kellblog.com/2010/01/21/the-oracle-of-unstructured-information-a-three-horse-race/#comment-3032 Dave – I'm going to quote this article to you when we're both old and grey!

]]> By: sunny http://kellblog.com/2010/01/21/the-oracle-of-unstructured-information-a-three-horse-race/#comment-3031 Fri, 22 Jan 2010 12:03:30 +0000 http://test.kellblog.com/2010/01/21/the-oracle-of-unstructured-information-a-three-horse-race/#comment-3031 Dave,its quite a long and interesting post. Kudos to your patience. Helped me a lot to understand the in and outs of MarkLogic's competitor's focus and strategies.WIll be eagerly waiting for your thoughts on "Why Oracle is not in the 3-horse race and cannot become Oracle of unstructured data".

]]>