Shift Happened - Part 2: Small Apps Loosely Joined

by Thomas Vander Wal in , , , , , , , , , , , , , , , ,


What are Small Apps Loosely Joined?

There has been a large shift in how many people work today and part of that is in the tools that they use to get work done. This shift in work patterns mirrors the shift that many had in their personal lives around social interactions and productivity.

Late one night many years ago (long before the iPhone), a group of us were talking about web and mobile and opportunities to work in a variety of similar tools that were all interconnected. The mash-up culture was a year or two behind us with Paul Radamacher’s first map mashup HousingMaps and the salient understanding that surfaced from that was the ability to have different interfaces for different needs and uses that could work as a workflow, or even similar interfaces for different personal needs of the users. We talked about Twitter and its heavy reliance on third-party developers to build web and mobile apps and services on top of its services and the Twitter API (the application programming interface, which is a standard data and interaction layer that sits behind the scenes bring data back and forth between the service). This approach allowed anybody to build an interface for seeing and interacting with Twitter or create an interface that provided greater ease of use for tasks. With tongue in-cheek (paraphrasing David Weinberger’s “Small Pieces Loosely Joined”), I said this model was small apps loosely joined.

What joined these apps together was a common data layer that fits a standard data model (or, as is common in APIs, a data model that self describes). The Twitter model allowed people to interact with the service through a mobile app with full functionality of the Twitter site, or to see many different Twitter lists in something like TweetDeck, or monitor and respond through different accounts in something like HootSuite, while tracking follows and drops in other monitoring services.

This same idea is more prevalent now across our mobile devices and the apps and services that they connect to and use. Not only are today’s mobile apps and services interacting with the APIs on the internet, but they are working with standard file formats on the backend and apps that meet the needs of users’ context and workflows. Some of the common app and service types that people have been shifting to the small apps loosely joined model are: Calendar, email, photos, text / documents, and to do lists / reminders (a closer look at these follows).

Who is Doing This?

The small apps loosely joined concept is nothing new in the technical geek and productivity nerd community (as part of both tribes, i use the words geek and nerd lovingly), as well as for early adopters. These uses and patterns with small apps loosely joined started surfacing around ten years on the web and mobile devices, all interconnected to the internet.

We understand innovation and broad adoption can take quite some time, roughly 10 years for innovations and new ideas to take hold broadly. We are about 10 years into this way of working and interacting with information and applications, so it was not exactly a surprise to hear research (done in-house to better understand the mobile market) that 60 to 70 percent of military members and their families surveyed use more than one app for a task types. They used calendars, email, and weather as examples. I checked with others who do surveys of employees inside organizations if they were looking at the question and found that they were. Their responses were also in the 60 to 70 percent range for calendar, to do, and text apps on mobile devices.

So, while this small app loosely joined focus and obsession within technology and productivity communities has been more than a decade old, it is something that is now rather mainstream. Over the last five years or so, when I am traveling or in a dank gym for club basketball, I often ask people next to me what apps and services they like the most on the mobile devices that is in their hand. Their answers often surface apps related to tasks and workflows for a data type (calendar, document, etc.) and the person would qualify how and in which circumstances they use it. Quite often, the app did one or two things really well that others didn’t cover or did not do well in their perspective.

Why are People doing this?

There are a lot of reasons why people started embracing small apps loosely joined. The primary driver has been mobility and looking for small mobile or tablet apps that do a specific, needed task. Mobile and tablet uses often have quite different contexts for use, including a mix of creation and consumption, but the affordances and agency in these apps is a driver too. Having applications work across platforms is helpful, but it is more essential to have open file formats and standards that work with apps that can pick up the file and provide use on another device with the constraints and augmented capability mobile and tablets provide.

There are additional relevant benefits of the file formats and standards working across devices. The ability to easily share files with others with whom you are working or communicating is a great benefit, as the platform doesn’t matter, just the ability to grab an app (often inexpensive and sometimes free) to read and modify the file is key. Being able to easily share files leads to always having needed files accessible, as they can be kept of an internet directory (the kids, okay grown-ups, call this cloud storage).

The last benefit that is driving people to the world of small apps loosely joined is the value of non-proprietary files, which isn’t as hippy and give-it-to-the-man as it sounds–it’s really about ensuring that the files will work on any device with an application that handles that type of object. Having to keep two or three versions of the same software around so one can work across file differences, or open files in a different version of the software so it can be saved down into an older version, is silliness we can leave in the inefficient old days. Many of the file structures that are based on around text, including calendars, can be opened in any text application and read and edited there.

Where are People Doing This?

Most people (particularly outside the geeks) started down this path when smartphones and the modern class of tablets entered their lives. They looked for ways to replicate how they worked on laptops and desktops, but often the same apps weren’t there and they had to improvise. Word of mouth also spread ideas and options for getting things done. But, often people go exploring small, focused apps that are inexpensive or free to see what they do. The small targeted apps, often in the “does one thing well” class of app or small app that is does a few things simply and easily, have filled made it easy to try quite a few different apps to find something that works. People often find a few apps that fit into a workflow that targets a few small tasks to get things done while standing in line, stuck in traffic, or sitting at your desk waiting for one’s computer to finish updating and reboot.

As a result, often people find that this small focused app model helps them do the things they need to do, and it can be more efficient than digging around large cumbersome software. Often this can be more efficient as the person is not digging around large cumbersome software. Once this becomes a habit or a way of working on mobile, the expectation is that it should also work on the desktop / laptop as well. People look for similar apps and services that fit their more efficient workflows that started on their “devices that are too small and limited to do any real work on” and want that same type of focussed application where they “do their real work”.

This change is also being driven by more than just shifts in devices–people are trying apps and services in their personal life to help manage their schedules or work simultaneously with club or event organizers crafting an email or newsletter. Our personal lives used to trail our work lives as far as technology and services
augmenting what we do, but now what we’re doing in our personal lives has greatly surpassed the capabilities of many of our work offerings.

The Types of Apps that Often Fit the Bill

The starting place for many people who try a variety of apps on their mobile and tablet devices are weather, text, and calendar. We don’t modify weather apps as they are mostly just a display of provided content, but there are much variety among the offerings, such as <give a good, standard example> and DarkSky, which offers micro-location weather with how many minutes until precipitation starts or stops.

Text apps

Text apps is where many start seeing the concept and value of small apps loosely joined. People want something more than just simple notes application to jot ideas and sync them to other devices. They want to be able to read and do a little editing of text that they or others started writing on their “work” devices, all while standing in line or during other available moments that permeate our day. Soon this “little bit of editing” seems like it isn’t all that bad to do and they start picking up things they started writing elsewhere and knock out more on their mobile device or tablet. Or, they have an idea when they are not near their “work” device and start jotting a few notes in a text app, and soon it has turned into a couple or few paragraphs. The accessibility and convenience of these capabilities has switched on a lightbulb. Talking and comparing notes with friends and colleagues, they find there are apps that are not just simple text, but can add annotations for structure (headers and outlines), hooks for style (bold and italics), and more. This often leads to learning that some apps have more robust writing tools (dictionary, thesaurus, writing analytics, etc.). Those who write with a workflow of first getting ideas out of their head and then working with them to hone them are often most prone to the small apps loosely joined way of doing things. But, others also like the ease of just getting words and ideas out in one app, then editing elsewhere by just opening another app and grabbing the same text file from a cloud sync service or sharing between apps directly. These text apps, particularly when those that are markdown friendly, can take that initial text and turn it into a styled PDF, a Word doc, HTML to post, RTF (rich text format), or more.

Calendar apps

Calendars are another gateway drug, er application type, that leads to embracing the small apps loosely joined way of doing things. The calendar files are a set file type that is easy to move from app to app (except when working across platforms that have proprietary hooks that break compatibility). Smartphones and tables all come with calendar apps, but they rarely fit the full range of needs. Some people want a calendar to have a certain look or layout format that helps them see and evaluate their day, and there is an abundance of options on all platforms for visual display. But, the real gems are the small apps that shine with certain tasks like Fantastical does on Apple products with its natural language parsing that turns spoken words into an almost always bang-on calendar entry.

Other calendar apps start adding other intelligence and agency (applications doing things on our behalf to ease our work). Donna (rest her digital soul) was a favorite of mine for evaluating time between events and different modes of transport and calculating time to leave based on weather and traffic conditions (and if you were really stuck in a jam, it offered to help you get Uber). Donna was a gem for the space between meetings, but was an incredible help with coordinating kid pick-up and leave times related to their various events. Other apps that are helpful agents are Tempo (it came out of the same SRI lab as Siri), which is one of the fullest featured and most helpful calendar apps around. Tempo monitors your mail not only for events, but pulls the relevant emails, documents, location and contact information, and relevant transportation needs into one simple calendar entry–and all you had to do was place it on your calendar or say yes to an event invite. Tempo offers the ability to send an “I’m running late” notification to those with whom you are meeting, as well as the expected arrival time.

One the the interesting things about calendars in the small apps loosely joined set is that most of these class of apps do something else–they augment and clean-up the calendar entry. Say I open Tempo and it doesn’t recognize the location that is in the calendar entry - say it only has Ray’s Pizza in NYC (oh, you too have gone down this crazy path of meeting somebody at Ray’s Pizza in NYC only to later realize (not soon enough) that there are more than one and nearly a billion permutations of Ray’s, Ray’s Original, Original Ray’s, etc.)… so Tempo offers suggestions to sort out the exact location and then enters the address in the calendar file’s location field. Bingo! We have clarity, but not only does your calendar have clarity within Tempo, but in all other calendar apps that read that event file. Not only does Tempo do this, but other apps may also do this. We learn quickly the apps that don’t play well with others and hoard the clean up information (Mynd app has done this in the past, but it seems to be more friendly after its last update). Additionally, some apps give you the option as to which mapping and directions app you would like the calendar to open when you are actually on your way.

Email apps

One of the things that mobile and tablets reinforce is how painful email is in our lives (on both the work and personal sides). Being able to live in email and work with it easily in some managed way from a mobile device or tablet is critical. The small apps loosely joined concept really takes hold with email for many people. Some tools work as easy, light triage, such as Mailbox, to quickly filter through your email based on importance and time-relative needs. Also, some tools that manage attachments in email (or, more appropriately, files that would have been attachments, such as Hightail (formerly YouSendIt), which stores files and documents for your email to link to securely. The only requirement for most of the email apps is the email account must run on IMAP, which is pretty much the norm these days.

Photo apps

The quality of photos has improved drastically on many mobile devices and even tablets. This along with the adage, “the best camera is the one you have with you” (and most people always have their phone with them), has led to the reality that a lot of photos get taken on mobile devices and tablets. The photos are a common file type and there is an abundance of apps that can take a photo and modify it to improve its quality, add filters to change the look, add text, or turn into something that looks a lot like a watercolor painting. The photos can also be scanned and OCRed, as well as uploaded as a document and later searchable (as many do in Evernote.

Standards and Access

The key to many of the apps loosely joined use types mentioned (and the many not covered here) is that the files passed among apps follow a set or ad hoc standard. Text files that use Markdown (or Multi-Markdown that extends the capabilities to add footnote, tables, and more) are all human readable, but also any text app can read them and edit them. The file sizes are small, which is incredibly important for mobile devices and tablets in limited mobile bandwidth locations (be that Manhattan at 5:15 on any weekday or the outer suburbs of Accra).

Access to the files is the other important characteristic of small apps loosely joined. Working between apps may not require internet access, but working between devices that are not in bluetooth range, or sharing files to collaborate requires data access (most often through the internet). Small file size, which those of us working with mobile a long time know is still an essential for actually getting things done reliably.

Common Use Traits

These apps have a core set of functionality that stem from the capabilities of:

  • Viewing
  • Creating
  • Honing
  • Agency
  • Features / functionality augmentation

Viewing is a common characteristic of all the apps, but the ability to create is where the real difference in these apps start to have real value for people using these apps and working in a small apps loosely joined workflow. The small apps can also provide the ability to hone what has been done in another app or on another device. This honing may be editing or adding data or an element to improve use. Agents that look out for us and do work we would be having to do is quite helpful, particularly when they are getting to the near bulletproof reliability some are approaching these days. The features and functionality augmentation in apps really helps when working with light apps that are focused and easy to use. Adding grammar checks and tools that can improve our work or creations, much like we would at a laptop or desktop, have shifted many people to this small apps loosely joined life.

App Traits

There are a few core traits in these apps. First off, as mentioned, they work on open document types that are are commonly used as actual or de facto standards.

Another trait is the apps are light (a few features and functionality sets), focus on simplicity, and are easy to use. Mobile devices do not have the screen space for complicated or complex interfaces, and, in reality, given where and how these devices are used, the user’s full attention is not on the app or device. Good mobile and tablet designers and developers understand this limitation very well and understand just how far they can push the limited human constraints that come into play when interacting with the apps.

The last related trait is that the apps are focused. When listening to how people use and interact with their devices and apps, it is interesting how they understand and parse functionality that fits their needs across apps. With calendaring, some people love Fanstastical’s UI for display of the day’s and upcoming events, while other people love how easy it is to input information and create events from a chunk of copied, typed, or spoken text (and getting it right). It was interesting talking with other Donna calendar app users as many of us would open Donna to get just travel-related information and / or honing the address, then close it and open another calendar app for its different functionality. The apps do a few certain things really well and those that live in the small apps loosely joined workflow are quite fine with that.

Wrap-up

The small apps loosely joined workflow and expectation has moved from mobile devices to the laptop / desktop world. The small apps that were just on mobile devices are showing up on the more fully powered devices. The output created from these apps have supporting services on the web that can augment this practice much further. Many who work in small apps loosely joined have learned to like the focused task and mindfulness of that targeted approach–they get things done far more efficiently and are more productive more of the time, and, as a result, they can often get more uninterrupted time to focus on living life beyond devices and apps. The goal going in was just to get things done on the device I have with me, but it is not a bad benefit for those whom value it.


Shift Happened Series


On the Way to the Next Big Thing

by Thomas Vander Wal in , , , , , , , , ,


This was written in April 2011 and a publication had interest in publishing it, but it didn't fit their editorial cycle so it sat. I have annotated this with an endnote to bring it current.

A funny thing happened on the way to the next big thing, the big thing was little. Many people are looking to build the next Facebook or Twitter, but those that are gaining traction and actually being used don’t focus on collection and aggregation of the masses, they focus on the small groups of people who know each other and really aren’t connecting or interacting in or for the public eye.

At SXSW this past year, 2011, the next big thing wasn't one thing, it was many things. It was these same smaller group interaction platforms that let people who know each other already interact. The funny thing is this really shouldn't be a surprise to anybody who has actually been following or connecting to the mainstream in the crowd using Facebook or any other large service. Most people are are connected to a small group friends or other label for the people they share information, status, and possibly location with. When Facebook took its service beyond the walls of the university and let any old Joe and Jane in many of the students had fear and cut back their usage of the service. They wanted a service to have more regular communication and more private interactions with out of the eye of the hoards. This isn't because they are doing things they are ashamed of or would cause them consternation if others found out, it is because that is how most people in mainstream interact and consider normal. Many of these students kept their Facebook accounts and use them occasionally, but this is not their social home, this is not where they check the pulse of the group of people they want to connect with.

When you consider how this plays out you see it really clearly inside organizations that have openly social communication and collaboration platforms up and running. Much of the interaction is often not out in the open, but in the more focussed less travelled (or even semi-closed) groups and forums. These are the comfortable spaces with permeable walls. But, this is often where much of the sharing and interacting happens in organizations.

For many who drank the Kool Aide of people want to be openly social, this is an odd trend. But, it isn't really a trend it is the norm and for most of time going back this has been the norm. There is something to Robin Dunbar's postulation of “theoretical cognitive limit to the number of people with whom one can maintain stable social relationships”, which is commonly known as “The Dunbar Number” and is approximately 150 (with bounds of 100 to 230 as reasonable lower and upper reaches for most people). But, for small very close knit groupings of friends you often see from a a few teens in groups up to 40 to 50. But, about 40 to 75 the dynamics shift and is repeatedly comes up when talking to people in digital services with the number of people where the service shifted from being fun and easy to use to being more work.

At SXSW this year the proffering of small social services, many for smart mobile devices only, like Beluga, Ditto, GroupMe, etc. were the talk of the event in Twitter and from the remote conversations I was picking up on. The question was, “which service are you on?” for those you deemed viable enough to connect with outside of the masses in Facebook and Twitter. These services are where people look for who wants to meet up for dinner, where is the good place to hang, or most importantly “where are my peeps?”

Invisible Communities

This past week I caught Chris Heathcote's presentation on “Invisible Communities” from February 2011 at Lift Conference. Chris talks about all of the unseen communities on the internet and web, which have nearly always been there and keep growing. These are the web forums where the “good” information is shared. These are the handled application based services, some with web presence, but very few are searchable or open to the public. Chris' talk echoed most everything I hear when I talk to the famed “millennials” in organizations who are claimed to be “openly social” and heavy users of these huge web social tools, but when I sit with them in organizations regarding social tools inside the organization (they are included as they are supposed to be the heavy users and the ones that really know this stuff well), but dang if I have ever run across one that has claimed this. Very few use Facebook or Twitter (the “Twitter is for old people” (over 25) is commonly stated) and they all state some different small social tool where they keep in touch with their good friends with.

Personal InfoCloud

Doc Searls wrote a real gem of a post, “The Sense of Bewronging”. Doc's post is about the need for personalization and putting things in context that “I” care about, or as talked about here in this site the Come to Me Web and Personal InfoCloud. A post that triggered Doc was a presentation and post by Louis Gray “The Third Wave of the Web Will Be Uniquely Personal”. Both of these posts talk about aggregating all that we have inbound and as well share out (our digital exhaust) so to filter and hone what it is we care about so to serve it up more to our actual interests and with out information overload.

Many of us have been aggregating our own information for quite a while in various tools and services, or on just pulling and archiving feeds. Phil Gyford talks about a new kind of front page, Steven Berlin Johnson talks about the need for a Commonplace Book, Drummond Reed discusses the Personal Data Store, Jon Udell has his Hosted Lifebits, and Kim Cameron says my Personal InfoCloud “I think a framework like the one he proposes - based on attraction - is probably an early harbinger of the identity big bang.”

Why Does this Matter?

All of this matters because for as much as we use ThinkUp, My6sense, Momento app, Summify, etc. for our aggregation of personal exhaust data and to filter to ease our attention focus as well as use and most importantly reuse what flows through this at some point. In using these services most are focussing on the big social stops like Facebook and Twitter, just like malls have big box stores, but most people are not going to the mall for the big box they are hitting the smaller stores or skipping the mall altogether for more personal customer service and supporting businesses of people whom they know. If the social aggregation and information filtering tools are keeping their focus on the mall’s big boxes of social web, they are missing where many people are actually spending their valued attention. Having a wonderful service like ThinkUp to provide a history of what I have shared and was shared with me (or the more impersonal fact, shared to many and my friend hooks, nabbed a digital copy of that sucker) so that I can search and pull things together later is missing some key valued elements.

While it is worth the time these services are spending (all pulling the same big sites and services and missing the less broadly known services) on the big box social web services, so we can pay a bit less attention on them but for some digests and pay attention to our more valued services. But, what looses out is the use and reuse of across all those services. You have a friend share a book she just finished she thinks you and your group would like, but shared it in your tight friend space you won’t have easy recall from a central place. A real personal aggregation and attention management tool needs to capture all streams we consider to have value. Being able to build a Granular Social Network that really works and that keeps our attention from being over taxed is where much of this really should head. We have been stating what this third wave of the web should be for a long time as a personal web, we now have the tools start getting there, but we need to ensure our focus fits our needs and our actual interactions.

Yes, for those of you that have made it this far and have been waiting to state all this is walling ourselves off from the rest of the world, well I think this aggregation, archiving, and filtering to keep our attention from hitting overload is needed so we can take a much broader look at what is outside our bounds. If we enable keeping what is valuable in front of us we can explore and interact even more.

Some things have changed a little bit in the past year, but largely not much has changed. Facebook has its Timeline, which has thin value for being able to scan the real volume of our activities and then be able to aggregate and reuse that information in more usable and valuable (for one's self and others) format. It is an interesting visualization, but the value of making deeper sense just isn't there and understanding things never seems to fit in Facebook's plans.


40 Plus Social Lenses

by Thomas Vander Wal in , , , , , , ,


Lately, I've been getting asked what I am working on beyond client work, as there have been things popping up here and there that hint something is brewing. Well, there is and there isn’t something new, but something (one of my things has been drawing my attention). It started in Summer or early Fall 2010 with a blow off comment from me to someone else who was stating how difficult working with 3D was, and I blurted something like “try social software, which is 6D or 7D or more”. That was tweeted as an overheard (OH) and people started asking what the 6D or 7D were. At the time I blurted it I could roughly name six of seven different dimensions of social interaction that needed to be considered and design for. But, with each stating of the six or seven, the list started growing. This list of six of seven dimensions were coming from the frameworks, models, and lessons learned I have picked up since 1996 working with social software inside organizations and out on the web. By late October I was finally putting these social elements I used into a list, which quickly was into 20 high-level items and by November was about 40 items. I was also fleshing out the list for each item. I started calling the list my “40 Plus Social Elements”, but recently I have changed it to “40 Plus Social Lenses” as that is a much better term for how I have been using them over the past 15 years to see the “it depends” inflection points and enable thinking through them.

This is Needed?

Nearly every organization I talk to (or even web start-up working for on social interactions) I talk to is getting stuck or is hitting things they hadn’t expected a few months into their use with these tools. It does not matter if it is a platform improve internal communications and collaboration, a social CRM program, and/or a social media (marketing) effort everybody seems to be running into issues they did not see coming. Often I will start by asking how they are dealing with something (based on program type and tools) and I hear, “How did you know we had this problem? Who did you talk to?” They affirm they have these issues, some are manageable and at times they are really problematic. But, the big question is why did they not know these issues could arrive or would potentially arise. I have kept these lenses separate for years, rather than building into one big approach as each organization or services is different enough and has different enough influences that it is really tough to have one big singular approach. Taking small steps, monitoring, and then adapting or iterating is a really helpful approach, but so are mixing and matching lenses to get an improved perspective. Building solutions that address needs and having an overall big vision are helpful. Most often with social tools is it a more connected and free flowing means of doing things.

Lessons Learned

The continual problem for anybody who has been responsible for long-term management of social systems and/or communities who use them, development, design, and/or iteration of social software solutions is painfully confronted with, “is what I am seeing happen (often framed as a problem or issue to be solved) an issue with individual people, how humans are social, the culture(s) where the system is being used, the organization's needs and requirements or structure, or the tools themselves that are being used?” Often the answer is “yes”. These personal, social, organizational, and tools issues all interweave and quickly create a complicated, if not complex system where isolation of individual elements is really difficult. There is also a counterweight to this, which is we know that for use and adoption of these tools and services they need to be simple to use and get started (it doesn't mean they need to stay that way, Lithium's Community Platform is wonderful proof of this model and a I really need to devote a piece to why as it isn't plainly seen by most).

This thinking really started jelling in 2004 at Design Engaged with Mike Kuniavsky's lead-off monologue on complexity, which in his 10 minutes he focussed on the complexity in interaction design and urged us to “run toward the light of complexity”. This is an essential understanding for interaction design as the designer is working to make things that are rather complicated yet rather simple to use, which requires the designer to embrace the complicated and complex to master it so to work to make it simple. Where interaction design hits the individuals and their interaction with systems, social interaction design adds more layers with people interacting with others through the tools, which can be rather complicated just on its own and now you are throwing software in the middle. In 2007 or so I hit another big wake up call. I was working on the folksonomy book (no, it didn't get published, nor finished being written) and a couple months in I hit a sticking point. What I found was many of the common social models and foundations for Web 2.0 couldn’t explain the strong value that people were finding in places where Web 2.0 thinking would not lead one to believe it existed, nor could it explain the problems that I was repeatedly seeing. It took 12 or more months of deconstructing and reassembling the Web 2.0 models, the lessons I learned from years working with and building social software, as well as my formal education (in communication theory, organizational communication, grad school with economics, and social analytics) to identify the variables and components that had value and then build frameworks for thinking how this worked and why. I have blogged many of these as well have been presenting them publicly as well as using them in workshops and client engagements. They have proven to be really valuable, with feedback from many that is has saved them tens or hundreds of thousands of dollars in cost avoidance and value derived from improved decisions.

What is This List of Lenses?

The list is essentially what I have been using and building upon for 15 years dealing with social software and the hurdles and headaches that can come from it. These 40 plus lenses (sometimes nearly 50) are questions, models, and frameworks I use when working with clients or in workshops. I hadn’t realized there were as many elements in the list as I often work conversationally and one answer from a client will trigger 2 or 5 more questions that are relevant based on that answer or insight. This progression gives better understanding not only to me, but also to them to see potential options, the possible benefits as well as possible detractors, and then think through them sanely. Knowing potential problems or issues, helps keep an eye out for them and be prepared, all while using lenses to know that these decisions may bring.

I have shared the list with some others with quite long backgrounds in social software on production, management, or research sides and all (well not the researchers) have the first response of, “Thomas, you are over thinking this there is no way there are that many.” But, as they go through the list they often find all of it is very familiar and things they think through and consider as well so to help their organizations, services, or clients. Many of us have built up this trove of tacit knowledge and I'm working on making it more explicit.

Where I am finding the list is having value is using the components as lenses to see the “it depends” inflection points and be able to think through them to solid results that match each organization as best as possible. Often there isn’t an optimal solution, but knowing a gap exists and to keep an eye on it has made a huge difference for organizations as well as those building products.

The list is still in flux a little but, but it is firming up and getting it organized in to a nice flow will help. Once that is done it is writing time. I have been presenting many of the items on the list in workshops and in client engagements and honing the understanding and getting solid feedback from real experience and use over the years.

I have been having many discussions around the list and thinking that is behind them, which has surfaced in Dave Gray's Connected Company and a Gordon Ross’ post on Connected companies, complex systems, and social intranets. There is good thinking and understanding that is needed so we can get more value and better understanding out of social software used in organization and on the web, but importantly it can help the products and services improve as well.

There are quite a few posts around here that are included in the lenses as part of them or the whole of a lens:

What am I Doing with This List?

What I am doing with this list of lenses has been a big question. The list very quickly started looking like a book outline, so I am taking steps in that direction. Presenting on this, I have been using a lot of these lenses in presentations for the last 8 years and mix and match them based on subject of the presentation. Dave Gray has put together a really good presentation on the Connected Company that I have helped with and will be presenting that puts a nice wrapper around the ideas. But, being able to get the full list of lenses in front of people and help them use them practically, I think may be best done in a workshop model. I have done internal workshops using many of these lenses (I get very positive feedback about how much this has benefitted organizations and has saved them from selecting tools that didn't fit their needs and/or helped them realize they had a gap in their approach they had not foreseen), but I have yet to put one on that are open to the public. If there is interest in public workshops I have the material and they would likely be a two day for a full view and use, but also could be a one day intensive seminar approach. Please contact


Bing Likes Like, But Does it Mean We Do

by Thomas Vander Wal in , , , , , ,


Last week Microsoft Bing and Facebook announced Facebook is now part of Bing search. The part that has been touted the most is Bing's inclusion of Facebook Likes.

For me this is really surprising as Like has very little value, what little value is has is confounded by it lacks any explicit understanding of intent. Search is about finding what is being sought, which is much harder than it sounds, particularly with massive amounts of information, or when searching across contexts and influences. Like really doesn't add much of anything of value to this. Why somebody likes something is really important to understand, or more importantly even if a person actually likes what they placed a like on, or if they were using it as a proxy for a bookmark to hold on to something so to return later, or even if the Like is a social statement.

One of my trips to California I was with friends and we were trying to sort out where to grab something to eat. One friend suggested In-N-Out, she figured it was well liked and even the guy who is vegetarian would be in on it as he liked it on Facebook (she remembered). The vegetarian in the group strongly preferred not to go there and wanted an option with better vegetarian offerings. When he was asked why he put a Facebook Like on it he said, "I like hanging out with my friends there as it makes them happy, but I usually have eaten before, or will after. Now I am hungry and wish to eat, so I really prefer something other than In-N-Out." This triggered everybody talking about their doing similar things with Like in Facebook, which really didn't mean they liked what they clicked "Like" on.

Facebook Like, much like the often problematic star ratings, adds more ambiguity (or another value point that has no clear meaning that can be reliably used for search or predictors). My favorite recommendations from Facebook are those similar to "Those who like food also like sleep.", which gives me the option to like sleep. (We can cure cancer if we keep this intelligent thinking up.)

What is Next? The Past!

So, if this augmented ambiguity from using Facebook Like in search is problematic leads you to think, "What is better?" Well, a look back to 2005 or 2006 at Yahoo! is a very good place to start. Somewhere in this timeframe Yahoo Search did something smart, no freakishly smart (actually connecting two things together that made a giant difference for search). Yahoo! had its own social bookmarking service "My Web", which was somewhat similar to Delicious (which Yahoo acquired). The second version of MyWeb (MyWeb2) made it easy to see one's own bookmarks that you yourself tagged in your own context, your friends bookmarks they had tagged with their tag terms in their context, and everybody's. Yahoo! incorporated the tags and social connections from MyWeb2 into their search. This dramatically improved the search, if you were using MyWeb2 and particularly if you had stated people you were connected to.

At this point Yahoo! not only caught up to Google but passed it by a large margin for me. Why? Google was very good at finding good results, often good enough. Yahoo! with MyWeb2 built in and using my 60 to 70 people I was connected to started surfacing exactly what I was looking for. This was happening regularly. This was search Nirvana. Let's step back slightly to understand why.

Proper Social Understandings Improve Search Precision

One of the interesting things about people tagging content to store it in services like MyWeb2 or Delicious (or any other folksonomy tagging service) is people almost alway only tag things they have interest in. Based on the assumption (which holds up well) that people hold on to thing they like, but when they drift from that they usually will add tags that state that deference.

Search is difficult because of contextual influences and ambiguity. Having tagging done by people whom you know can help with that contextualization. People whom you know having tagged things around what you are seeking and use the terms in similar manner to the way you do has value. Well, no not really, it has insanely great value. The key is sorting out similar affinities (as close as possible) and similar term use helps to further remove ambiguity, which becomes clearer when you can parse things through the lens of a granular social network. With just 60 to 70 people my world of search was turned upside down in a very positive way. All search results that had been bookmarked and tagged by people I was connected to were annotated with their their name and often tags.

This giant step forward for Yahoo! did not last long as after a few months the experiment was over and Yahoo search returned to being not as helpful as Google search, which is just good enough.

The Yahoo experiment was not perfect, but it was much closer than most anything else to that point. Holding it back was the lack of people you were connected to. The more people you were connected to, to some degree, was helpful. Also, very few people knew about this experiment (it didn't seem like an experiment at the time, as it seemed it could only grow, but Yahoo really didn't seem to know how to get the word out or talk about this value, it was an information geek thing (yes, I could fall into that grouping). But, the piece missing that would have been most helpful, was the ability to garden and craft your relationships to those with whom you connected.

The gardening and contextualizing those with whom you are connected is really powerful. It doesn't need to be publicly exposed but the tools and service can make giant leaps forward if we have this. Most of this contextualization is assumed by tools and services, but having explicit crafting takes the guessing out. Being able to add fuzzy (roughly defined) semantic terms to attract what you value from that person closer while keeping the things of less of value at bey, can be helpful. This is core to the model of attraction (draft) idea that has been my frame for much around me for years. Being able to tag or annotate "Jim" with cycling, food, social search, design, and baseball will help search bring things roughly related to those topics or terms close to me, but may not give as high of relevance for his passion for early 1990s dot matrix printers nor Hobbits.

Next Step?

The next step for this as in terms of products and services also has happened. An enterprise social bookmarking service, Connectbeam (now gone) took the next step (Lotus Dogear, now Lotus Bookmarks in their Connections tools is somewhat similar) by bringing this same social tagging into the work environment and then surfacing that added value into search results. What set Connectbeam apart from others doing similar efforts was it helped people understand the social components better than most. They had some really good social interaction designs around the connecting people, that really started to get at some of the tough nuances that are really hard to crack outside the early adopter types using service (only 5 to 15% of most orgs will fall into that early adopter mindset, the rest are really lost with this). This crafting and understanding social interactions allowed Connectbeam to have the potential to drastically improve search, (search is a very expensive and painful proposition at every organization I have run across). The social interactions needed for comfort, familiarity, and producing value is central to getting any service right, but the hurdle is big but there is a large positive value if you get that right for social tagging. Sadly, Scuttle and thin not well thought through attempts at social tagging really do not add to much either.

Spending time to understand the keys to getting it right and selecting tools that do it well or working with vendors to get there will pay off.


Understanding the Cost of We Can't Find Anything

by Thomas Vander Wal in , , , , , , , , , , ,


One problem I often hear when talking with any organization about new solutions is understanding the cost and inefficiency of their existing way solutions, processes, or general way of doing things. In the past year or two I have used various general measurements around search to help focus the need for improvement not only on search, but the needed information and metadata needed to improve search.

We Can't Find Anything

There is nothing more common that I hear from an organization about their intranet and internal information services than, "We can't find anything." (Some days I swear this is the mantra that must be intoned for an organization to become real.)

There are many reasons and potential solutions for improving the situation. Some of these involve improved search technologies, some improved search interfaces, or But, understanding the cost of this inefficiency is where I find it is valuable to start.

The first step after understanding you have this problem is to measure it, but most organizations don't want to pay for that they are just looking for solutions (we all know how this turns out). The best method I find is walking through the broad understandings of the cost of inefficiencies.

The Numbers...

At Interop 2009 I presented "Next Generation Search: Social Bookmarking and Tagging". This presentation started off with a look at the rough numbers behind the cost of search in the enterprise (see the first 16 slides). [I presented a similar presentation at the SharePoint Saturday DC event this past week, but evaluated SharePoint 2010's new social tagging as the analysis focus.]

Most of the numbers come from Google white papers on search, which gets some of their numbers from an IDC white paper. I also have a white paper that was never published and is not public that has slightly more optimistic numbers, based on the percentage of time knowledge workers search (16% rather than the Google stated ~25% of a knowledge workers time is spent searching). There are a few Google white papers, but the Return on Information: adding to your ROI with Google Enterprise Search from 2009 is good (I do not endorse the Google Search Appliance, but am just using the numbers used to state the problem).

I focus on being optimistic and have I yet to run into an organization that claims to live up to the optimistic numbers or total cost of inefficiency.

  • Few organization claim they have 80 percent of or better success with employees finding what they need through search
  • That is 80 percent success rate
  • Or, 1 in 5 searches do not find what is they were seeking
  • A sample organization with 500 searches per day has 100 failures
  • An average knowledge worker spends 16% of their time searching
  • 16% of a 40 hour work week is 1.25 hours spent searching
  • 20% (spent with unsuccessful searches) of 1.25 hours a week is 15 minutes of inefficient productivity
  • At an average salary of $60,000 per year that leads to $375 per person of inefficient productivity
  • Now take that $375 per knowledge worker and multiply it by how many knowledge workers you have in an organization and the costs mount quickly
  • An organization with 4,500 knowledge workers is looking at a inefficiency cost of $1,687,500 per year.
  • Now keep in mind your knowledge workers are you most efficient at search
  • Many organizations as a whole are running at 40% to 70% success rate for search

We Know We Have a Costly Problem

This usually is enough to illustrate there is a problem and gap with spending time resolving. The first step is to set a baseline inside your organization. Examine search patterns, look at existing taxonomies (you have them and use them to some degree, yes?) and work to identify gaps, look at solutions like tagging (folksonomy) to validate the taxonomy and identify gaps (which also gives you the terms that will likely close that gap). But get a good understanding of what you have before you take steps. Also understand the easy solutions are never easy without solid understanding.

Evaluating what, if any taxonomy you have is essential. Understand who is driving the taxonomy development and up keep. Look at how to get what people in the organization are seeking in the words (terms) they use intend to find things (this is often far broader than any taxonomy provides).


Getting Info into the Field with Extension

by Thomas Vander Wal in , , , , , , , , , , , , , ,


This week I was down in Raleigh, North Carolina to speak at National Extension Technology Conference (NETC) 2008, which is for the people running the web and technology components for what used to be the agricultural extension of state universities, but now includes much more. This was a great conference to connect with people trying to bring education, information, and knowledge services to all communities, including those in rural areas where only have dial-up connectivity to get internet access. The subject matter presented is very familiar to many other conferences I attend and present at, but with a slightly different twist, they focus on ease of use and access to information for everybody and not just the relatively early adopters. The real values of light easy to use interfaces that are clear to understand, well structured, easy to load, and include affordance in the initial design consideration is essential.

I sat in on a few sessions, so to help tie my presentation to the audience, but also listen to interest and problems as they compare to the organizations I normally talk to and work with (mid-size member organizations up to very large global enterprise). I sat in on a MOSS discussion. This discussion about Sharepoint was indiscernible from any other type of organization around getting it to work well, licensing, and really clumsy as well as restrictive sociality. The discussion about the templates for different types of interface (blogs and wikis) were the same as they they do not really do or act like the template names. The group seemed to have less frustration with the wiki template, although admitted it was far less than perfect, it did work to some degree with the blog template was a failure (I normally hear both are less than useful and only resemble the tools in name not use). [This still has me thinking Sharepoint is like the entry drug for social software in organizations, it looks and sounds right and cool, but is lacking the desired kick.]

I also sat down with the project leads and developers of an eXtension wide tool that is really interesting to me. It serves the eXtension community and they are really uncoupling the guts of the web tools to ease greater access to relevant information. This flattening of the structures and new ways of accessing information is already proving beneficial to them, but it also has brought up the potential to improve ease some of the transition for those new to the tools. I was able to provide feedback that should provide a good next step. I am looking forward to see that tool and the feedback in the next three to six months as it has incredible potential to ease information use into the hands that really need it. It will also be a good example for how other organizations can benefit from similar approaches.


Explaining the Granular Social Network

by Thomas Vander Wal in , , , , , , , , ,


This post on Granular Social Networks has been years in the making and is a follow-up to one I previously made in January 2005 on Granular Social Networks as a concept I had been presenting and talking about for quite some time at that point. In the past few years it has floated in and out of my presentations, but is quite often mentioned when the problems of much of the current social networking ideology comes up. Most of the social networking tools and services assume we are broadline friends with people we connect to, even when we are just "contacts" or other less than "friend" labels. The interest we have in others (and others in us) is rarely 100 percent and even rarer is that this 100 percent interest and appreciation is equal in both directions (I have yet to run across this in any pairing of people, but I am open to the option that it exists somewhere).

Social Tools Need to Embrace Granularity

What we have is partial likes in others and their interests and offerings. Our social tools have yet to grasp this and the few that do have only taken small steps to get there (I am rather impressed with Jaiku and their granular listening capability for their feed aggregation, which should be the starting point for all feed aggregators). Part of grasping the problem is a lack of quickly understanding the complexity, which leads to deconstructing and getting to two variables: 1) people (their identities online and their personas on various services) and 2) interests. These two elements and their combinations can (hopefully) be seen in the quick annotated video of one of my slides I have been using in presentations and workshops lately.

Showing Granular Social Network

                Granular Social Network from Thomas Vander Wal on Vimeo.

The Granular Social Network begins with one person, lets take the self, and the various interest we have. In the example I am using just five elements of interest (work, music, movies, food, and biking). These are interest we have and share information about that we create or find. This sharing may be on one service or across many services and digital environments. The interests are taken as a whole as they make up our interests (most of us have more interests than five and we have various degrees of interest, but I am leaving that out for the sake of simplicity).

Connections with Others

Our digital social lives contain our interests, but as it is social it contains other people who are our contacts (friends is presumptive and gets in the way of understanding). These contacts have and share some interests in common with us. But, rarely do the share all of the same interest, let alone share the same perspective on these interests.

Mapping Interests with Contacts

But, we see when we map the interests across just six contacts that this lack of fully compatible interests makes things a wee bit more complicated than just a simple broadline friend. Even Facebook and their touted social graph does not come close to grasping this granularity as it is still a clumsy tool for sharing, finding, claiming, and capturing this granularity. If we think about trying a new service that we enjoy around music we can not easily group and capture then try to identify the people we are connected to on that new service from a service like Facebook, but using another service focussed on that interest area it could be a little easier.

When we start mapping our own interest back to the interest that other have quickly see that it is even more complicated. We may not have the same reciprocal interest in the same thing or same perception or context as the people we connect to. I illustrate with the first contact in yellow that we have interest in what they share about work or their interest in work, even though they are not stating or sharing that information publicly or even in selective social means. We may e-mail, chat in IM or talk face to face about work and would like to work with them in some manner. We want to follow what they share and share with them in a closer manner and that is what this visual relationship intends to mean. As we move across the connections we see that the reciprocal relationships are not always consistent. We do not always want to listen to all those who are sharing things, with use or the social collective in a service or even across services.

Focus On One Interest

Taking the complexity and noise out of the visualization the focus is placed on just music. We can easily see that there are four of our six contacts that have interest in music and are sharing their interest out. But, for various reasons we only have interests in what two of the four contacts share out. This relationship is not capturing what interest our contacts have in what we are sharing, it only captures what they share out.

Moving Social Connections Forward

Grasping this as a relatively simple representation of Granular Social Networks allows for us to begin to think about the social tools we are building. They need to start accounting for our granular interests. The Facebook groups as well as listserves and other group lists need to grasp the nature of individuals interests and provide the means to explicitly or implicitly start to understand and use these as filter options over time. When we are discussing portable social networks this understanding has be understood and the move toward embracing this understanding taken forward and enabled in the tools we build. The portable social network as well as social graph begin to have a really good value when the who is tied with what and why of interest. We are not there yet and I have rarely seen or heard these elements mentioned in the discussions.

One area of social tools where I see this value beginning to surface in through tagging for individuals to start to state (personally I see this as a private or closed declaration that only the person tagging see with the option of sharing with the person being tagged, or at least have this capability) the reasons for interest. But, when I look at tools like Last.fm I am not seeing this really taking off and I hear people talking about not fully understanding tagging as as it sometimes narrows the interest too narrowly. It is all an area for exploration and growth in understanding, but digital social tools, for them to have more value for following and filtering the flows in more manageable ways need to more in grasping this more granular understanding of social interaction between people in a digital space.


Selective Sociality and Social Villages

by Thomas Vander Wal in , , , , , , , , , ,


The web provides wonderful serindipity on many fronts, but in this case it brought together two ideas I have been thinking about, working around, and writing about quite a bit lately. The ideas intersect at the junction of the pattern of building social bonds with people and comfort of know interactions that selective sociality brings.

The piece that struck me regarding building and identifying a common bond with another person came out of Robert Paterson's "Mystery of Attraction" post (it is a real gem). Robert describes his introduction and phases of getting to know and appreciate Luis Suarez (who I am a huge fan of and deeply appreciate the conversations I have with him). What Robert lays out in his introduction (through a common friend on-line) is a following of each other's posts and digital trail that is shared out with others. This builds an understanding of each others reputation in their own minds and the shared interest. Upon this listening to the other and joint following they built a relationship of friendship and mutual appreciation (it is not always mutual) and they began to converse and realized they had a lot more in common.

Elements of Social Software Build OrderWhat Robert echos is the Elements in Social Software and its build order. This build order is common in human relationships, but quite often social software leaves out steps or expects conversations, groups, and collaboration to happen with out accounting for the human elements needed to get to this stage. Quite often the interest, ideas, and object (all social objects) are the stimulus for social interaction as they are the hooks that connect us. This is what makes the web so valuable as it brings together those who are near in thought and provides a means to connect, share, and listen to each other. I really like Robert's analogy of the web being like university.

Selective Sociality of Villages

The piece that resonated along similar threads to Robert's post is Susan Mernit's "Twitter & Friend Feed: The Pleasure of Permissions". Susan's post brings to light the value of knowing who you are sharing information with and likes the private or permission-based options that both Twitter and FriendFeed offer. This selective sociality as known Local InfoCloud of people and resources that are trusted and known, which we use as resources. In this case it is not only those with whom we listen to and query, but those with whom we share. This knowing who somebody is (to some degree) adds comfort, which is very much like Robert Patterson and Luis Suarez#039; villages where people know each other and there is a lot of transparency. Having pockets where our social armor is down and we can be free to share and participate in our lives with others we know and are familiar to us is valuable.

I am found these two pieces quite comforting as they reflect much of what I see in the physical community around me as well as the work environments I interact with of clients and collaborators. The one social web service I have kept rather private is Twitter and I really want to know who someone is before I will accept them as a connection. This has given me much freedom to share silly (down right stupid - in a humorous way) observations and statements. This is something I hear from other adults around kids playgrounds and practices of having more select social interactions on line in the services and really wanting to connect with people whom they share interests and most often have known (or followed/listened to) for sometime before formally connecting. Most often these people want to connect with the same people on various services they are trying out, based on recommendation (and often are leaving a service as their friends are no longer there or the service does not meet their needs) of people whom they trust. This is the core of the masses who have access and are not early adopters, but have some comfort with the web and computers and likely make up 80 to 90 percent of web users.


Stitching Conversation Threads Fractured Across Channels

by Thomas Vander Wal in , , , , , , , , , , , ,


Communicating is simple. Well it is simple at its core of one person talking with another person face-to-face. When we communicate and add technology into the mix (phone, video-chat, text message, etc.) it becomes more difficult. Technology becomes noise in the pure flow of communication.

Now With More Complexity

But, what we have today is even more complex and difficult as we are often holding conversation across many of these technologies. The communication streams (the back and forth communication between two or more people) are now often not contained in on communication channel (channel is the flavor or medium used to communicate, such as AIM, SMS, Twitter, e-mail, mobile phone, etc.).

We are seeing our communications move across channels, which can be good as this is fluid and keeping with our digital presence. More often than not we are seeing our communication streams fracture across channels. This fracturing becomes really apparent when we are trying to reconstruct our communication stream. I am finding this fracturing and attempting to stitch the stream back together becoming more and more common as for those who are moving into and across many applications and devices with their own messaging systems.

The communication streams fracture as we pick-up an idea or need from Twitter, then direct respond in Twitter that moves it to SMS, the SMS text message is responded back to in regular SMS outside of Twitter, a few volleys back and forth in SMS text, then one person leaves a voicemail, it is responded to in an e-mail, there are two responses back and forth in e-mail, an hour later both people are on Skype and chat there, in Skype chat they decide to meet in person.

Why Do We Want to Stitch the Communication Stream Together?

When they meet there is a little confusion over there being no written overview and guide. Both parties are sure they talked about it, but have different understandings of what was agreed upon. Having the communication fractured across channels makes reconstruction of the conversation problematic today. The conversation needs to be stitched back together using time stamps to reconstruct everything [the misunderstanding revolved around recommendations as one person understands that to mean a written document and the other it does not mean that].

Increasingly the reality of our personal and professional lives is this cross channel communication stream. Some want to limit the problem by keeping to just one channel through the process. While this is well intentioned it does not meet reality of today. Increasingly, the informal networking leads to meaningful conversations, but the conversations drifts across channels and mediums. Pushing a natural flow, as it currently stands, does not seem to be the best solution in the long run.

Why Does Conversation Drift Across Channels?

There are a few reasons conversations drift across channels and mediums. One reason is presence as when two people notice proximity on a channel they will use that channel to communicate. When a person is seen as present, by availability or recently posting a message in the service, it can be a prompt to communicate. Many times when the conversation starts in a presence channel it will move to another channel or medium. This shift can be driven by personal preference or putting the conversation in a medium or channel that is more conducive for the conversation style between people involved. Some people have a preferred medium for all their conversations, such as text messaging (SMS), e-mail, voice on phone, video chat, IM, etc.. While other people have a preferred medium for certain types of conversation, like quick and short questions on SMS, long single responses in e-mail, and extended conversations in IM. Some people prefer to keep their short messages in the channel where they begin, such as conversations that start in Facebook may stay there. While other people do not pay attention to message or conversation length and prefer conversations in one channel over others.

Solving the Fractured Communication Across Channels

Since there are more than a few reasons for the fractured communications to occur it is something that needs resolution. One solution is making all conversations open and use public APIs for the tools to pull the conversations together. This may be the quickest means to get to capturing and stitching the conversation thread back together today. While viable there are many conversations in our lives that we do not want public for one reason or many.

Another solution is to try to keep your conversations in channels that we can capture for our own use (optimally this should be easily sharable with the person we had the conversation with, while still remaining private). This may be where we should be heading in the near future. Tools like Twitter have become a bridge between web and SMS, which allows us to capture SMS conversations in an interface that can be easily pointed to and stitched back together with other parts of a conversation. E-mail is relatively easy to thread, if done in a web interface and/or with some tagging to pull pieces in from across different e-mail addresses. Skype chat also allows for SMS interactions and allows for them to be captured, searched, and pulled back together. IM conversations can easily be saved out and often each item is time stamped for easy stitching. VoIP conversations are often easily recorded (we are asking permission first, right?) and can be transcribed by hand accurately or be transcribed relatively accurately via speech-to-text tools. Voice-mail can now be captured and threaded using speech-to-text services or even is pushed as an attachment into e-mail in services as (and similar to) JConnect.

Who Will Make This Effortless?

There are three types of service that are or should be building this stitching together the fractured communications across channels into one threaded stream. I see tools that are already stitching out public (or partially public) lifestreams into one flow as one player in this pre-emergent market (Facebook, Jaiku, etc.). The other public player would be telecoms (or network provider) companies providing this as a service as they currently are providing some of these services, but as their markets get lost to VoIP, e-mail, on-line community messaging, Second Life, etc., they need to provide a service that keeps them viable (regulation is not a viable solution in the long run). Lastly, for those that do not trust or want their conversation streams in others hands the personally controlled application will become a solutions, it seems that Skype could be on its way to providing this.

Is There Demand Yet?

I am regularly fielding questions along these lines from enterprise as they are trying to deal with these issues for employees who have lost or can not put their hands on vital customer conversations or essential bits of information that can make the difference in delivering what their customers expect from them. Many have been using Cisco networking solutions that have some of these capabilities, but still not providing a catch all. I am getting queries from various telecom companies as they see reflections of where they would like to be providing tools in a Come to Me Web or facilitating bits of the Personal InfoCloud. I am getting requests from many professionals that want this type of solution for their lives. I am also getting queries from many who are considering building these tools, or pieces of them.

Some of us need these solutions now. Nearly all of us will need these solutions in the very near future.


Exposing the Local InfoCloud

by Thomas Vander Wal in , , , , , , ,


I have spent a lot of time and effort focussing on the Personal InfoCloud, but the past year or two I have been seeing that the interaction between the person and their information resources that are closest to them (the Local InfoCloud) is extremely important. I have gone around the Local InfoCloud looking at ways to best explain it and bring it to life in a more understandable manner. This past November at Design Engaged 2005 my presentation needed me to dig into the Local InfoCloud and it various components. Since Design Engaged I have been using the slide and ideas around it to explain its relationship to the Personal InfoCloud and the "Come to Me Web". I have iterated on the idea and received some good feedback (particularly from Liz Lawley. Are you ready to dig in?

Overview of the Local InfoCloud

The Local InfoCloud started as an idea of information that was physically close. What is stored or accessed by physical location (information that is physically close) as in an Intranet or location-based information accessed on your mobile device. The more I thought about it and chatted with others it became clear it was more than physical location, it is information resources that are familiar and easier to access than the whole of the web (Global InfoCloud) as a framing concept.

As the my understanding began to lean toward familiarity as a core component of the definition of Local InfoCloud, the term began to embrace the social and community aspects (I am working on shying away from the term community as it is a broadly used term and I am trying to be a little more precise). Interactions with people, services, networks, applications, etc. that are familiar are means of bringing information closer to us as people with data, information, and media needs. The Local InfoCloud eases access. It eases the ability to find and refind information. It is information that is closer to us, not necessarily in physical proximity, but in the ability to access, in which familiarity is bread.

I spent much time considering changing the label from local to community or social, but there were elements that did not perfectly fit that either. Location-based services may be created by a service, but understanding the mindset, terminology, dialect, and cognitive frameworks that are germane to that physical location the information can be structured to resemble or mirror the social elements of understanding in that place. I will get to a better understanding of this when I talk about the Location aspect of the Local InfoCloud. As well, thinking in the Model of Attraction framework the Local InfoCloud is that which is attracted closer to us than the Global InfoCloud.

Important Attributes

There are some attributes that are important to the Local InfoCloud and separate it from the Global InfoCloud and ease the ability to integrate or draw the information and/or media in to the Personal InfoCloud.

Familiarity

As mentioned above familiarity is an essential attribute. Familiarity can be through vocabulary and terminology used to describe or discuss information and objects that people are trying to find and use. The taxonomy or germane ontologies are important to understand as they help ease the connection between the person seeking the information and objects and those providing it.

Access

Access to a resource is very important as it is in the ease of access that we rely on the Local InfoCloud. There is information that is in systems or in locations that others can not get to (that would make it in other's Eternal InfoCloud), but ability to get to the information is important. The ability to get back to the information (through password locked systems, access only by location, etc.) that dictates access is a key attribute.

Structure

Structure is a key attribute in the seeking, finding, and refinding information and objects. In a physical neighborhood we know that a corner store is on the corner, but in a portal we know that movie reviews have a certain URL structure and/or that we can click on a Entertainment button/link to get to the page that links to the movie reviews. Reading one movie review in a familiar site we know how to get to other movie reviews. These browsing structures allow the person to interact and attract information to their screen easily.

Known Actions

Known actions are the element in peoples lives that provide patterns that can be repeated to get to what the person desires. Many times people know how to get to, or more appropriately get back to what they are interested in through indirect connections. A favorite resource may be on a friend's link page as they have not set a direct means to connect to that source or to even draw that information to them to cut down the effort expended. Applications and location-based information are other environments that depend upon known actions to connect people to that which they desire.

Consistency

Consistency is a main attribute driver to our use and reuse of a component in the Local InfoCloud. Consistency breeds familiarity as people learn the terminology, can bookmark, use the known actions to get back to information, or guess how to get access to other items of interest. Having URL structures that are consistent provides a means to get at open information as well as permits the person to restructure means to keep that information closer to them (external social bookmarking as an example).

Copy, Point & Tether

Copy, Point & Tether are actions that a person can take to move information from a Local InfoCloud to the Personal InfoCloud. The attributes are germane to the Personal InfoCloud, but also have importance in the Local InfoCloud often the Local InfoCloud embraces these concepts to ease these actions.

When a person finds data, information, or media objects of interest they most often do one of three things: Copy the item to keep it close (hard drive, flash drive, scan to a drive, scrape to a drive, etc.); Point to the location where the information is located (bookmark, link, blog, wiki, etc.); or Tether the item which is desired by copying or pointing, but then setting a means to get notified when that item has been changed, updated, moved, etc. through tools like RSS/ATOM, e-mail, a pinging service, etc. The tethering is insanely important for items that are anything but completely static over the very long-term (think years not shorter) and it will be getting its own long write-up in the future (subscribe to the RSS here to tether your interest to the future content).

Components

Localinfocloud_overviewNow we can look at the components that can comprise the Local InfoCloud. Each of these have one or more of the attributes. The components are digital and physical in nature. Components may or may not be exclusive, as some Local InfoCloud resources may be comprised of more than one component.

Location

Location was the first component of the Local InfoCloud I considered. Location is important as the physical place has characteristics that draw various attributes together. Location often has a familiarity with terms and language that frame the items within it. The structure of the physical surroundings play an important part in how and where things are located in that location. Tools that are implemented by location are kiosks, GPS/location-based information systems, games that use physical space to provide rewards or clues, language translation tools that are needed in a location, physical location can provide, ease, hinder or censor access to information, and access points to get information can be germane to location (mobile devices need local permissions to access services, etc.).

Friends (and Family)

There is one area that is often over looked as friends and family are not always digital resources, but can provide incredible means of information. Knowing a friend (or she has a good friend) who is an expert in the subject that we need understanding of is very helpful. We can call or visit that person, but we can also e-mail, chat, or have a video conversation with the person to get access to the information or knowledge. In social networks it is common that people will use those whom they are most familiar as a resource to get access to stored knowledge or use the person as a ready pointer to how to get the items they need. Access and familiarity are very strong attributes with friends and family. Often we do not have to tap the person to get the information, but the friend will e-mail us a pointer that they believe we have an interest in consuming. We can save e-mail (as that pointer or container of information is structured by a face or name we have known connections and have put them in context, much in the way they do with us.

A person's preferred method becomes a known action for us. We know the times we can tap somebody with a question or what tools they prefer to communicate using. We know friends who love to talk and their best means of interaction is the phone or an audio chat, while others are more apt to respond to e-mail, text chat, text messaging on their mobile device, or respond to a blog post. Over time we learn not only what is easy to get from whom, but the best means to interact to get the what we desire.

Near in Thought

We have resources that we rely upon because we have similar taste, interest, and/or perspectives on the genre or facet of life the resource covers, more directly these resources are near in thought to us. Politics is an easy example as the terminology used in and around the items we are seeking is known to us and we have expectations that we will like or agree with what is provided from that resource. Beyond politics we have resources with similar interests, perspectives and taste that help filter and provide easier access to items we desire. These resources are not only familiar but they often are structured in a manner that we understand the naming conventions for categories and other resource are easy for use to use and predict what will be brought closer to us through actions. These resources may be whole web sites, journals, writers, blogs, periodicals, etc.

Affiliations

In our life we belong to many groups. These groups have their own terminology and structures for things. Some of these affiliations will be easy to grasp how to access the resources at first opportunity, while others will come through enculturation of learning the structures and terminology. Through consistancy of the affiliations we increase our ability to use these resources to our benefit.

Organizations

Organizations are things we can belong to or join, like a knitting group, local chapter of a national affinity society, etc. These memberships in the organizations allow greater interaction with others with similar interests and/or needs. Organizations can have gated resources that are only access through membership or affiliation with that group.

Work

Work was the initial driver behind the Local InfoCloud as it was information and resources on an Intranet that was the initial understanding of local. But, work also has its own terminology, known actions, and structure. Over time we learn the resources, both digital, physical, and human that provide us access to information and knowledge.

Social Software

Social software can be device-based or network-based (web, internet, intranet, etc.) and the software builds consistency, structure, and known actions over time. If the software is built well the hurdles will be low to understanding how to get at the items we want and need. The software connects people and provides individuals the ability to contribute content and connect with others with similar interest and needs. Social software may connect people over time in an asynchronous manner as a person can leave an answer to a question at one point in time, but everybody with that same question or interest will have the capability to get to the same answer and potentially connect with that person as a known expert/resource through time.

The software becomes the conduit for connecting people and the data, information, and media the people share and/or discuss and augment. It also provides the means to connect people who are near in thought. It is one means for us to share things we would like feedback on. Social software mitigates distance for connecting people around common interests and can mitigate time as we do not need to be on at the same time to interact. Some examples are online discussion groups, listserves, social bookmarking, social networking, blogs, chat software, etc.

Portals

Portals in this meaning are the large aggregation sites that collect information and media into a familiar interface. Tools like AOL, Yahoo, news sites, aggregated shopping sites, etc. are portals with familiar structures that are consistent. Portals make a learnable interface to a variety of data, information, and media objects. Some are interest-based, while others are extremely broad. Similar to a newspaper or magazine the portal has one set of structures to grasp and access remains constant over time. We will easily know where to find movie reviews, car sales, discussion lists, various genre of news, etc.

Wrap-up

This is still a work in progress to some degree. Feedback on these attributes and components is always welcome. There may be some editing to this page, but more than likely the modifications will be in pages and posts that follow-on under this Local InfoCloud category.


The Come To Me Web

by Thomas Vander Wal in , , , , , , , , , , ,


Until May of 2005 I had trouble with one element in my work around the Model of Attraction and Personal InfoCloud (including the Local and Global InfoClouds as well) to build a framework for cross-platform design and development of information and media systems and services. This problem was lack of an easy of explaination of what changes have taken place in the last few years on the web and other means of accessing digital information. In preparing for a presentation I realized this change is manifest in how people get and interact with the digital information and media.

This change is easily framed as the "Come to Me" web. The "Come to Me" web, which is not interchangeable with the push/pull ideas and terms used in the late 90s (I will get to this distinction shortly). It is a little closer to the idea of the current, "beyond the page" examinations, which most of us that were working with digital information pre-web have always had in mind in our metaphors and ideologies, like the Model of Attraction and InfoClouds.

The I Go Get Web

Before we look at the "Come to Me" web we should look at what preceded it. The "I Go Get" metaphor for the web was the precursor. In this incarnation we sought their information. The focus was on the providers of the content and the people consuming the information (or users) were targeted and lured in, in the extreme people were drawn in regardless of a person's interest in the information or topic covered. The content was that of the the organization or site that provided that information.

This incarnation focussed on people accessing the information on one device, usually the desktop computer. Early on the information was developed for proprietary formats. Each browser variant had their own proprietary way of doing things, based around a few central markup tags. People had to put up with the "best view with on X browser" messages. Information was also distributed in various other proprietary formats that required software on the device just so the person could get the information.

The focus providing information was to serve one goal (or use) reading. Some of this was driven by software limitations. But it was also an extension of information distribution in the analog physical space (as opposed to the digital space). In the physical space the written word was distributed on paper and it was consumed by reading (reuse of it meant copying it for reading) and it took physical effort to reconstruct those words to repurpose that information (quoting sources, showing examples, etc.).

The focus was on information creation and the struggle was making it findable. On the web there were only limited central resources used to find information, as many of the search engines were not robust enough, did not have friendly interfaces. Findability was a huge undertaking, either to get people what they desired/needed or to "get eyeballs".

Just as the use of the information was an extension of the physical realm that predated the digital information environment, the dominant metaphor in the "I Go Get" web was based in the physical realm. We all designed and developed for findability around the navigation/wayfinding metaphor. This directly correlates to going somewhere. Cues we use to get us to information were patterned and developed from practices in the physical world.

Physical? Digital? Does it Matter?

You ask, "So what we used ideas from the physical world to develop our metaphors and methodologies for web design and development?" We know that metaphors guide our practices. This is a very good thing. But, metaphors also constrain our practices and can limit our exploration for solutions to those that fit within the boundaries of that metaphor. In the physical realm we have many constraints that do not exist in the digital realm. Objects are not constrained by the resources they are made from (other than the energy to drive digital realm - no power no digital realm). Once an object exists in the digital realm replicating them is relatively insignificant (just copy it).

Paths and connections between information and objects is not constrained by much, other than humans choosing to block its free flow (firewalls, filtering, limiting access to devices, etc.). Much like Peter Merholz desire lines where people wear the path between two places in a manner that works best for them (the shortest distance between two points is a straight line). Now, don't think of the physical limitation between two points, I need to go from my classroom on the fourth floor of building "X" to across campus, up the hill to the sixth floor office of my professor. Draw a straight line and walk directly. This does not work in physical space because of gravity and physical impediments.

Now we are ready to understand what really happens on the web. We go from the classroom to our professors office, but we don't move. The connection brings what we desire to us and our screen. In this case we may just chat (text or video - it does not matter) with the professor from our seat in the classroom (if we even need to be in the classroom). Connections draw objects to our screens through the manifestation of links. As differently as people's minds work to connect ideas together, there can be as many paths between two objects. Use of physical space is limited by limitations outlined in physics, but the limitations are vastly different in digital space, use of the same information and media has vastly different limitations also.

It is through breaking the constraints of old metaphors and letting the digital realm exist that we get to a new understanding of digital information on the networks of the digital realm, which include the web.

The Come to Me Web

The improved understanding of the digital realm and its possibilities beyond our metaphors of the physical environment allows us to focus on a "Come to Me" web. What many people are doing today with current technologies is quite different than was done four or five years ago. This is today for some and will be the future for many.

When you talk to people about information and media today they frame it is terms of, "my information", "my media", and "my collection". This label is applied to not only information they created, but information they have found and read/used. The information is with them in their mind and more often than not it is on one or more of their devices drives, either explicitly saved or in cache.

Many of us as designers and developers have embraced "user-centered" or "user experience" design as part of our practice. These mantras place the focus on the people using our tools and information as we have moved to making what we produce "usable". The "use" in "usable" goes beyond the person just reading the information and to meeting peoples desires and needs for reusing information. Microformats and Structured Blogging are two recent projects (among many) that focus on and provide for reuse of information. People can not only read the information, but can easily drop the information into their appropriate application (date related information gets put in the person's calendar, names and contact information are easily dropped into the address book, etc.). These tools also ease the finding and aggregating of the content types.

As people get more accustom to reusing information and media as they want and need, they find they are not focussed on just one device (the desktop/laptop), but many devices across their life. They have devices at work, at home, mobile, in their living space and they want to have the information that they desire to remain attracted to them no matter where they are. We see the proliferation of web-based bookmarking sites providing people access their bookmarks/favorites from any web browser on any capable device. We see people working to sync their address books and calendars between devices and using web-based tools to help ensure the information is on the devices near them. People send e-mail and other text/media messages to their various devices and services so information and files are near them. We are seeing people using their web-based or web-connected calendars to program settings on their personal digital video recorders in their living room (or wherever it is located).

Keeping information attracted to one's self or within easy reach, not only requires the information and media be available across devices, but to be in common or open formats. We have moved away from a world where all of our information and media distribution required developing for a proprietary format to one where standards and open formats prevail. Even most current proprietary formats have non-proprietary means of accessing the content or creating the content. We can do this because application protocols interfaces (APIs) are made available for developers or tools based on the APIs can be used to quickly and easily create, recreate, or consume the information or media.

People have moved from finding information and media as being their biggest hurdle, to refinding things in "my collection" being the biggest problem. Managing what people come across and have access to (or had access to) again when they want it and need it is a large problem. In the "come to me" web there is a lot of filtering of information, as we have more avenues to receive information and media.

The metaphor and model in the "I go get" web was navigation and wayfinding. In the "come to me" web a model based on attraction. This is not the push and pull metaphor from the late 1990s (as that was mostly focussed on single devices and applications). Today's usage is truly focussed on the person and how they set their personal information workflow for digital information. The focus is slightly different. Push and pull focussed on technology, today the focus is on person and technology is just the conduit, which could (and should) fade into the background. The conduits can be used to filter information that is not desired so what is of interest is more easily identified.


Europe Presentations from October

by Thomas Vander Wal in , , , , , , , ,


I am late in posting the links to my two presentations given in Europe. I presented the Personal Digital Convergence as the opening keynote to the SIGCHI.NL - HCI Close to You conference. I have also posted the final presentation, IA for the Personal InfoCloud, at the Euro IA Summit 2005.