The Macrosite for News, Analysis and Opinion about the Future of the Internet
Marc Canter

The Dawn of the PKB (Personal Knowledge Base)

Written by Marc Canter
7/15/2008 10 comments
no ratings
DISCUSS     Email This

As the firehose of information continues to flood our inboxes and activity-stream displays, one has to wonder, “When will it all stop?”

Well, I hate to break it to you -- but it won’t. It will only get worse.

Managing and keeping track of all the digital information relevant to your lifestyle is becoming an increasingly important issue. Whether it be for business or pleasure, family or health, internal or external use, we all have the need to categorize, store, retrieve, and parse many forms of information, every day.

Most people use their Outlook account as their storage mechanism. After all, this is where your email comes in and is stored, so most of the time, that's where you go to find something. That’s certainly how I run my digital life.

Clearly, we need something better.

I’ve written recently on my own blog about Personal Knowledge Bases (PKBs), and I think it’s something that might resonate here. The idea is that one should be able to keep track of all important items, broken up by category, tags, sections -- what have you -- and a permanent archive of this information would be stored away "in the cloud."

This is what Lotus Notes and countless other "knowledge management" tools have promised corporate IT, but none of them is cleanly integrated into the Web. And needless to say, Outlook, your RSS reader, your IM client, your social networks -- all are in disparate locations, far from being an integrated solution.

There is nowhere to store my Twitter and FriendFeed accounts, my Flickr photostream, my social networks, my various blogs and IM traffic. Just trying to keep track of all the info that comes in via RSS feeds is a bear, and there isn’t a good way of storing that information, besides relying on Google Reader (or whatever RSS reader you use).

So I’ve been extrapolating. What might a personal knowledge base tool look like, and how would it work? Here are some thoughts:

    1) One has to be able to grab stuff as it flies through the activity stream, which ideally means aggregating your email, IM traffic, RSS feeds, Twitter traffic, and other "streaming info."

    2) Just as one can "like" or "comment on" an item, one should be able to grab an item, tag it, and store it away (ŕ la de.licio.us or magnolia).

    3) This accumulated archive would automatically be indexed and cross-referenced with similar tags, and it would benefit from any prior categorization.

    4) Once a system is set up for tagging and categorizing, it should be built up around relevant information in the right context. This means organizating data, not just based on one's current communication and email, but on important documents, specs, images, XLS files, etc.

    5) All this data needs to be moved into the same place.

    6) Adding new categories, continuing to use "bottom up" folksonomies, and parsing of activity streams should be ongoing for one's lifetime.

    7) Once a PKB environment is created, you could then connect it to the PKBs of colleagues, family members, and friends. And then the fun begins!

We don't have it yet, but it's not a matter of "if" but "when" we will all have our own personal knowledge bases.

In the meantime, it's best to prepare for some sort of system for creating a permanent collection of "all our stuff." Don't forget to tag everything.

— Marc Canter, Founder & CEO, Broadband Mechanics

DISCUSS     Email This
Current display:       newest comments first       display in chronological order
Brian Newby
IQ Crew
Monday July 21, 2008 5:31:38 PM
no ratings

This is a fascinating topic on a few levels.  Primarily, recognizing the need to manage personal data is on the cutting edge, something I don't think many people see now.  The value becomes evident when moving from one type of p.c. to another, when central storage for an individual or family becomes more and more "common sense."

I think there are some business opportunities here (beyond the storage).  Maybe a Franklin Covey for the 2000s--just like Covey provided tools for persons to manage their schedule, leading to Palms, Treos, smartphones, etc., there's probably an opening for a company to come up with the Personal Knowledge Base turn-key solution.  I know there are a lot of programs people could use, but something customized and branded for this purpose, easy to use, could go mainstream.

jasonpriem
Rank: Cave Painter
Friday July 18, 2008 10:13:03 AM
no ratings

I forgot to mention in my other comment this wiki, with a whole slew of tools for personal knowledge management. And I have to give a shout out to the open-source Firefox plugin. It has a bit of narrower focus, being designed for academics who want to organize large collections of article. If you do any research reading, though, I think it's invaluable. I review it in greater detail on my blog.

oh, and also, the del.icio.us feed for PKM is a pretty good resource for keeping up with the area.

jasonpriem
Rank: Cave Painter
Thursday July 17, 2008 5:19:56 PM
no ratings

This is actually a topic of growning interest for a lot of people, including myself. The field of personal information management has been around for a while; more recently, personal knowledge management has come up (the difference between the two terms seems to vary some according to who you ask).

Lilia Efimova has been writing about PKM for while now. Harold Jarche has some posts, as does Jack Vinson. This post by Dave Pollard, while a little on the aged side, raises interesting points about managing not the knowledge itself but the formal and informal social networks we use to access it. Finally, and more recently, Eric Blue has been writing about using a souped-up MediaWiki to realize Vannever Bush's vision of the Memex PKM.

These are just a few I have readily at hand in my rather rudimentary PKM; if you're interested in this idea, though, I'm sure you could find more. It's a fascinating topic, and I reckon that we'll be hearing a lot more in the future.

Mashka
Researcher
Thursday July 17, 2008 4:11:58 AM
no ratings
Hello Marc!I think that's a great idea.But, wouldn't PKB make us to store the information we don't really need to.Now, when we don't have such a tool, we evaluate every email, every file-thinking: do I really need it-and having such a great program, we will keep everything and might be snowed under with information.It's like things- we have so many things we don't need to, could it happen with our files?
cjon316
IQ Crew
Wednesday July 16, 2008 8:05:23 AM
no ratings

Marc, I really appreciate your article. If my PKB was in shape at all, I would be able to give you more specifics about the idea I wanted to post. A few years back, I read of a software that sat in the background and created a sort of lifestream by indexing files opened on the computer, with a thumbnail of documents, and emails and everything (good and bad) of all the activity on the computer. It was a local resource on the harddrive of the users computer, but had some of those ideas you mentioned. Now with cloud computing and resources of that nature, I am certain this idea would be even more of value. By the way, the name escapes me of the designer and the software itself (which is legacy software by now and as recently as 2 years ago was not in supported status any more.) As I said, if my own PKB was in order, I'd be able to find it back and report the name to this post.

Any chance you have any memory of this software from years gone by? Have you any tools you can recommend for aggregating all these ideas into a pkb?

Like viboons, my closest thing to a PKB is also gmail where I can tag, sort, search, filter.  

Regards,

cmj 

abdlah
IQ Crew
Wednesday July 16, 2008 7:49:36 AM
no ratings

The idea as seen from the previous posts is a great one. The amount of information that we can create and use these days id mind boggling. Furthermore information is a mine of wealth if we can find ways to integrate them and add more value to our information store.

Also, the platform that will be able to retrieve and store disparate types of information will be quite a challenge, but there exist technologies out there that can definitely help. I have heard of Adobes AIR, could this be a good candidate to be used for developing the required platform?

We look forward to the day of PKBs

viboons
Researcher
Wednesday July 16, 2008 3:42:12 AM
no ratings

Good point you raised. I think knowledge/info management is more than just a matter of collecting and storing your data, but it's rather about being able to retrieve and use your data effectively when and where you need them. And it's not simple to manage a large amount of personal data collected over years in such a way that they are accessible and useful. This is more or less similar to what Google wants to achieve, and that is to organize the world's information, not just the Internet web pages but also books, literatures, images, videos and so on, a vast amount of knowledge in the world. And I think the key here for any knowledge management system is the "search" tool. Tagging and indexing are important, but if the search doesn't work to retrieve the relavent data you try to find then it's pretty much pointless.

Right now, the closest thing to PKB to me is my Gmail where I can effectively tag/label, store and retrieve my data (not the Twitter stuff but most of the useful knowledge) and which has a very good search engine and is pretty much integrated with other useful Google tools, like Google Calendar, Alerts, Docs, and Reader, etc. And most importantly, it's "personal" in the sense that the data I've collected is for me and only me can access it. 

viboons
Researcher
Wednesday July 16, 2008 2:40:22 AM
no ratings
Yeah, I also think that point #7 about connecting PKBs would somehow run into privacy issues even when sharing among friends and folks. Technically speaking, once your PKB is shared, it's no longer "Personal". But of course, certain part of your PKB data can be linked while keeping things that are really personal to you, like private correspondence or confidential docs, hidden from the "Shared Knowledge Base (SKB perhaps)".
Geekess
IQ Crew
Wednesday July 16, 2008 12:48:39 AM
no ratings

Marc,

Interesting idea!  It would definitely be great to get better control of all the info, and it would be very valuable to have it all in one place.  Unfortunately, there's the issue of 'work' stuff vs. 'personal' stuff.  Because of the rules in place for work-related info, there is only so much data that I can co-mingle with personal data. 

I'd also think that it might get a bit ticklish to share ALL this data with others.  Perhaps my parents are anti-rodent, and I don't want them to know about my Guinea Pig Club, etc?  Some finer-grained control over what I share with whom would be nice.  What do you envision for addressing this issue?

-Geekess 

Lynngi
IQ Crew
Tuesday July 15, 2008 5:50:35 PM
no ratings

I think we all have a storage problem because we don't know what we are going to use eventually. We've gone through so many interations of "how to store and retrieve your data", but still haven't arrived at one that works other than just keeping stuff.

Maybe we just need  "clean up your online stuff" day the way we have a "clean out your house" day in my community. We have one weekend set aside to bring "junk" to the recyclers (who temporarily set up collection centers in each community). It seems to help.

The ThinkerNet does not reflect the views of TechWeb. The ThinkerNet is an informal means of communication to members and visitors of the Internet Evolution site. Individual authors are chosen by Internet Evolution to blog. Neither Internet Evolution nor TechWeb assume responsibility for comments, claims, or opinions made by authors and ThinkerNet bloggers. They are no substitute for your own research and should not be relied upon for trading or any other purpose.
previous posts from Marc Canter
Marc Canter
Marc Canter   5/28/2008   6 comments
As the distributed Web, identity hubs, targeted advertising, and next-generation portals grow via the usage of widgets, iFrames, and Facebook apps/OpenSocial gadgets, it’s becoming clear that an “open mesh” is forming.
IETV: the thinkerNet on film
5
of
Kim Davis
Big-Data Can’t Always Sell Wine

5|21|13   |   2:23   |   4 comments


Whole Foods Global Wine Purchaser Doug Bell told me about some of the constraints on using analytics in the US wine market.
Paul J. Fleuranges
Digital Signage Keeps NYC Subway Straphangers on Track

5|6|13   |   3:51   |   No comments


New York's Metropolitan Transit Authority is conducting a pilot test of digital kiosks to guide subway users to where they want to go more efficiently and at lower cost.
Kim Davis
Fast Forward to the Future

4|23|13   |   2:29   |   20 comments


A look back at tech writing in the 90s makes us wonder where enterprise IT will be 20 years from now.
Mitch Wagner
Google Launches Its Most Depressing Service Yet

4|15|13   |   2:59   |   10 comments


Google's new Inactive Account Manager lets you control how Google disposes of your accounts when you die.
Second Shooter
Argument Over Top-Level Domains Is 'Stupid'

4|11|13   |   2:07   |   3 comments


The whole Amazon.reader debate is a double-stupid. It's stupid to think that there's any e-book buyer who doesn't know Amazon's URL, and it was stupider to let ICANN launch the whole free-form TLD initiative to start with.
Kim Davis
Ladies, Your Tablet Awaits

3|21|13   |   2:22   |   37 comments


ePad Femme is the world’s first tablet “made exclusively for women.”
Wisdom of the Big Chair
NFC Moves Into the Mainstream

3|20|13   |   2:16   |   No comments


While NFC's original goal was to enhance mobile commerce applications, it is finding its way into a number of other uses, which is creating both opportunity as well as challenges for IT departments.
Wisdom of the Big Chair
Integrating Security Into Your Cloud Contract

3|19|13   |   3:35   |   No comments


Enterprises would like to move to cloud computing but are hesitant because they are concerned about providers’ ability to secure company data. Here are some tips that help to ensure that if breaches occur, the business is not left holding the bag.
Brian Baron
How Edmunds.com Collects Customer Information

3|18|13   |   1:15   |   No comments


Edmunds separates customers into segments based on the info it collects on its site and from partners, and uses that to push out custom content, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
Brian Baron
How Edmunds.com Uses Analytics to Customize Site

3|14|13   |   0:47   |   No comments


The automotive website uses propensity modeling to target ads and customer registration forms, said Brian Baron, director of business analytics for Edmunds.com, at Predictive Analytics Innovation Summit.
an IBM information resource
sponsored content
big blue blog
an IBM information resource
sponsored content
Expert Integrated Systems: Changing the Experience & Economics of IT
In this e-book, we take an in-depth look at these expert integrated systems -- what they are, how they work, and how they have the potential to help CIOs achieve dramatic savings while restoring IT's role as business innovator.

READ THIS eBOOK
your weekly update of news, analysis, and
opinion from Internet Evolution - FREE!

REGISTER HERE
Wanted! Site Moderators
Internet Evolution is looking for a handful of readers to help moderate the message boards on our site – as well as engaging in high-IQ conversation with the industry mavens on our thinkerNet blogosphere. The job comes with various perks, bags of kudos, and GIANT bragging rights. Interested?

Please email: moderators@internetevolution.com
Internet Evolution – not for thickies
Keep Critical Data With a Knowledge Management System
Taimoor Zubair
Fortune 500 companies lose at least
$31.5 billion a year by failing to share knowledge. A Knowledge Management System (KMS) can help companies significantly reduce these costs.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE
M2M: Rise of the Machines? Not Yet
David Weldon
In the 1970 science fiction thriller
Colossus: The Forbin Project, two giant supercomputers from the United States and Soviet Union secretly join forces to take control of the collective nuclear might of the two countries. In the film, the two machines discover each other's existence, communicate back-and-forth, share their collective data, and cut their human creators out of the process. It is the ultimate example of machine-to-machine communications, or M2M.

CLICK FOR MORE