“Got kitesurfing on the mind, mixed with some search & classification tech, and a dab of political ranting”

A Knowledge Community

Posted by direwolff on February 27, 2007

OK, so I’m beginning to make some headway on a concept that brings together the benefits of a Wikipedia-like contributory model with the needs of users trying identify and locate very specific information from large collections of documents. Whether these collections are Web pages, RSS feeds, or documents on users’ hard drives, we want to enable users needing to do research or discovery, the ability to do so quickly and effectively. The idea is that creating robust queries requires tools that are not generally available to most people. Classification and text analysis technologies are expensive and search engines’ advanced querying capabilities remain relatively weak. Lexis-Nexis level querying is out of reach for most users, and corporate users that have access to this pay a lot of money but are also bound by the content walls provided through such services.

The idea of being able to let any one develop a robust and sophisticated query that can then be shared with others is the rooting of this new service. The ability to not only create and use this query, but to also index the content according to this and all other queries created, in a fast and scalable way moves us to an interesting place where communities of interest can work together to share access to useful information. Of course, there will also be the ability to keep queries private, especially at higher levels of details where specific names of entities or people come into play, but there will be a set of foundational queries which will contribute to human knowledge, that any one will be able to participate in creating. We already have over 500 such queries that locate such nebulous ideas as any discussion about a trend or forecast, or all discussions about terrorists (and not necessarily because the term “terrorist” appears in the article). Relevant domain focused content identification is now more easily achievable.

This community of knowledge is shifting the focus from knowledge creation by virtue of originating the content to knowledge creation by virtue of providing the roadmap for finding information, by providing people the tools for doing so. This is somewhat analogous to folksonomy, where tags are used to identify content. Both the author and those who find the content can tag it using different services. Where tags tend to be weak in their consistency of usage given that it’s difficult to know the motives of the person tagging the content, knowledge types such as topics, issues and categories will be strong in this regard. Even if inaccurate, they will be consistent which means that improving their accuracy will reverberate across all usages.

The community of knowledge will be primarily useful to those trying to discover content. Looking for article, blog posts, or research reports that talk about an increase or decrease in the price of oil is a fairly abstract idea to look for, but that’s just the kind of thing that will be possible and we will be providing access to the tools to enact such discovery and the wiki to share the topics, issues, and categories (queries) created by the community for shared use. Imagine trying to track the behavior of those in charge, and what the complexity of such a query might need to be. The community of knowledge will have a set of foundational knowledge types that already deal with such complexity, but also allow users to tackle more if they have a need to.

As we elaborate the platform, I’ll discuss it further here, but note that our intent is on providing a resource that will break through the constraints currently existing in precise and accurate text analysis technology, so that all can have access to it, not just the elite Fortune 500 companies that can afford starting prices of $200,000+ in annual fees.

Tags: , , , , ,


2 Responses to “A Knowledge Community”

  1. I like this idea. Are you suggesting that these queries would be live, like two-way tags? What would the interface be for idea generation?

  2. p-air said

    You might think of it more as a testing environment for creating a sophisticated queries quickly and easily, which would include access to the set of community created topics. From here, you could use a topic as-is or copy it and modify it as appropriate for your needs. Note that this query building is like a virtual tagging of things from your perspective. For example, someone with a taxonomy could implement the queries whose results meet the criteria for the classification in various levels of the taxonomy. However, by the same token, topics can be created for any purpose much like a tag (except by bldg a query), but given that it’s query it provides more perspective and context for why things are being tagged as they are. This enables another user to see this and decide whether it meets their needs with or w/o change.

    As we’re envisioning we would be tracking and displaying to a user, the description of the query by the author, what the query is, who created it, changed it, and the dates of those activities, as well as any additional and relevant notes that the author wishes to share.

    The query building and testing application would be different than the traditional one box approach, and as soon as we have a prototype to show, I’ll blog it. Not sure if that answers your question.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s

%d bloggers like this: