Archive for the ‘interaction design’ Category

Smart(er)phones mean affective consumer trends

Tuesday, March 9th, 2010

Remember your first cell-phone? It was likely not the *original* cellphone,

In my case, it was a kyocera green-screen on my parents verizon network. It DID have mobile-web (remember those WHTML/WAP-sites?) when I went to Chicago. My next was a color-screened nokia until both myself and the web got serious and my sony-erickson was the fastest GPRS connected phone (which I infrared-connected to my HP WinMo device quite requently!)

Enough about my history, on to my point: I’m a geek, so I loved the capabilities of the phone, no matter how tedious it was. Most consumers aren’t willing to go through the tedium for the glory, and *finally* we have a crop of large-screened phones which allow something aside from left-down-right-up-left-left-down-ok magic of the early Nintendo days!

WinMo tried to be this player years back. Wow! An interface that was colorful, full and wasn’t ridiculously hidden behind 19 menus. It had a Today screen which told me more than the TIME! But Windows/M$ got lazy, were happy to ignore emerging tech while raking in the cash, and Apple took over, overnight.

Now, in the wake of the iPhone, LG & Samsung have created their own semi-smart interaces. I’ve been running the Samsung TouchWiz for awhile now, and I like it. I’ve played with LG’s, and it seems quite on-par.

But just look at this:

LG's newest

Facebook. There. Touch it!

Compared to 4 yrs ago:

Right-Down, Right, ok, Right?

Compared to 10 yrs ago:

Old Kyocera

There's an interface? Where?

This last sort of phone has no affective association (consumer gratitude for being simple, easy, beautiful) as much as the newer phones. Perhaps this is evidence of over-indulgence of luxury, but if I’m going to use this device, then I want it easier. I’m going to switch each time to another brand, trying to find a better edition. But worse off, the companies back then never stopped changing their interfaces, making it more and more confusing to consumers looking to latch-on. I’d be willing to bet Nokia owns the world-market simply on the history of a consistent Symbian interface.

Computers, netbooks & smartphone products table

Thursday, January 28th, 2010

For all those who were or are now confused about the computer/netbook/smartphone market, here’s a bit to help clear one the techy bits:

Product Hardware Software
Open Microsoft Apple
Computer Intel (x86) Linux (Desktop) Windows OSX
Netbook Intel (x86) Linux (Desktop) Windows hack-only
Netbook (Gen2010) (ARM) Linux (Variants) WinMo
iPad Apple A4 (ARM) iPhone
Phone (ARM) Linux (Variants) WinMo iPhone

Notice that there’s another column I forgot: Android. They’re a variant of Linux, and running on both desktop & netbooks (sort of). Oddly enough, Android on netbooks took all the fire/criticism up front about being too limited. Apple then stepping into the void and filled it with something just. usable. enough.

The only commentary on Apple’s latest device is two-fold: (1) No multitasking? I’m a fan of what I’ve called ‘limited computing‘, but this is a tad too constricting. (2) Likewise constricting is the iPhone AppStore: only those approved by Apple will do.

For the price, I’d rather have AlwaysInnovating’s Tablet/Netbook. It’s effectively the same thing, just with the software I already use. Trouble-spot: all linux software is old-school & menu-driven. Neither linux application communities (KDE nor Gnome) seem to be concerned with this forward motion UI’s.

Why do scrollbars still exist?

Monday, October 12th, 2009

Scrollbars are kinda, sorta, useful. I remember teaching my mom how to use a computer & she would consistently use the scrollbar backwards. And it makes sense: moving it down is moving the page up.. wha?? What the rest of us take for standard (scrollbar-as-document-representational) is backwards to how we read any other book or piece of paper.

While writing a paper recently on a portrait-view screen, I found myself able to see the full page I was writing, AND bits of the prior & next page. This gave such a HUGE advantage for context-analysis and paper flow. I bet most prof’s suffer through poor student papers, simply because the student doesn’t realize what is missing writing in landscape (and even worse, widescreen). In contrast, this is the joy of minority report: a HUGE surface area to hold windows-of-sufficient-size that can be placed with sufficient margins instead of being in an overlapping pile, thanks to the portability requirement. I’m still waiting for short-throw, cheap, hi-def projectors that I can have overhead, to project onto my white, tilted, large physical desktop.

Our eyes are tuned (in the real world) to spatiality. There is a layout, flow, and gradual perceptive fall-off from our field of vision. Computer UI designers are kind enough to give us EVERYTHING. This is required for use, and for the most part, our eyes ignore this extra.  Yet, we never have any ‘real’ awareness of what is off-screen. Some window-managers use ‘pagers’, but that isn’t for window content, as much as window layout. I’m a content-layout fan– keeps me focused on my task of creating, instead of doing the window manager’s window-layout job.

So I propose 2 options (especially for pen-computing), both using the mouse-pointer as a grab-and-drag hand, a la Adobe Acrobat, or FF’s plugin.

Gradients

Remaining content 'edged' by gradient

Remaining content 'edged' by gradient

Gradients are naturally-existing creatures around any real-world document. Shadows are handy, and they can tell us (representationally) how much of the document is remaining to view. Sure it’s not a mathematically precise as a scrollbar, but ’scrolling’ through a newspaper is hardly mathematical.

Magnifing Glass

Similar (actually inverse) to the gradient, I’ve also considered having the margins of a window, where there is still more content, grow in proportion to the content remaining. This would give a ’squished’ version of the remaining pages.

Likely scrollbars will exist forever, and likely I’ll be happy with grab-and-drag for all apps. Scrollbars do have the goodness of being able to scroll faster than anything else- instantaneous access to the top or bottom of the page. But isn’t that what the ‘home’ and ‘end’ keys do? Oh, wait, most keyboards don’t have those..

Courier’s Potential Issues

Thursday, October 8th, 2009

The bits missing from the Courier Video-demos:
First off, it is very, very limited:

  • Left:
    • Calendar
    • Contacts
    • Web
    • Photos
  • Right:
    • Maps (associated with contacts)
    • Journal (dual-pane)
    • web also (wait, which side do I view webpages on.. both?)
  • Middle:
    • Clipboard-Pocket

This is it? Doesn’t sound like much. So what do I use my laptop for these days?

  • Libraries of media, for which iTunes & Amazon are trying to be the end-all. For this, I likely will run a streaming media source, or keep my library on a home server, so the laptop neWed not have a multi-terabyte drive.
  • Basic file editing/viewing, for which Google Documents is trying to be the end-all. And so long as your online (or whenever local caching of GDocs hits) this might work. But Google doesn’t support various Journal formats at present.

Web viewing

There doesn’t seem to be any web-organization, just a list of tabs/Safari-like window-images. My use of the web falls into the 2 categories previously mentioned: the daily views of interest & responsibility (like reading the news & checking the bank) and researching the latest idea & interest I had, or for classes.

File-Viewing

I wanna make sure this has full office & PDF file editing & annotation, otherwise, it’s not a laptop replacement. Clearly this thing won’t be creating the office-heavy/design-heavy files.. but it should have full-view of them.

Filetypes supported are likely OneNote->PDF instead of the millions of incongruent filetypes presently on any one system. Others’ ability to edit & comment on PDFs at present is limited. This is an early-collaboration tool, not a late-collaboration, final-product kind of tool.

Pocket

There is a heavy amount of visual drag-and-dropping, specifically of web/PNG images. But I deal with excel and photoshop files too. Will previews be auto-generated for these as well? How will I know which spreadsheet is which when I place it in the pocket? Sometimes filenames *are* handy.

Minor

We didn’t see any online chat-abilities with the contacts, something my nokia N800 did well.

The 2 biggest hurdles for development:

  1. Metadata heavy
  2. Handwriting heavy

One step closer to useful

Thursday, October 1st, 2009

UI usability is consistently my no. 1 time-suck. I’ve ‘wasted’ countless hours config’ing and reconfig’ing GNOME panels into assumed-need sorts. I’ve given up and returned to Mac & heeded again the siren call to Linux’ potential simplicity.

My latest spin *was* playing with screen-maximizing UI’s: task-bar-less environments, panel-over-top window-titlebars, then I turned wanna-be tablet with the iPen.

But I’ll not deny, the best ‘inspiration’ has been the non-existent-yet(?) Microsoft Courier. Here’s a list of the bits, related & not, which I’ve come up with:

Dual-pane

My 13″ macbook is nearly-exactly 2×9″ screens. Yes, this is very Courier-esque. Especially if I use Linux’ dragbox in between panes! But the benefit here is window management. In Xwindows-land, there’s lots of these things called ‘window managers’. They’re supposed to, y’know.. manage windows. What do they ACTUALLY do? Place windows in wierd locations & sizes which require you to use a taskbar, alt-tab or expose’ your day away. I’m not down with that. Time for a ’tiling” window manager. Yet I’m just looking for 2 panels, and on a 13″ screen, that’s plenty. If I config my window-placer-thing to throw some of my apps on the left, I (craziest idea ever) can expect them to be there. I know where they are! Which leads me to my next point..

Priority

Since I’m not fussin’ with my 9 windows that are open, wondering where to look for ‘em (something a taskbar is supposed to do, but doesn’t supply the requisite window-parallel usage scenario).. anyways, since I’m not wasting time placing windows, I can focus on what I’m supposed to be doing: being a human with responsibilities over resources and being creative and learning. Those are the categories my applications have taken: email, calendar & files on the left, OpenOffice, Journal & Web on the right.

Lists, lists, lists!

Perhaps this is more iphone-y than anything, but there’s some goodness to be had with the removal of clutter (and there’s plenty on the web!) Yet, I use google calendar & email all day long. I don’t need another cal or mail app, I just need a browser open with these bits in it. But even these apps aren’t clean. Facebook, Yahoo Mail, Google Mail, Google Reader AND Google Calendar ALL have sidebars. Why, oh why do we need sidebars? They take up sooo much screen real-estate, especially after you scroll.

Bad:

What you get when viewing web-apps half-screen'd or in portrait

What you get when viewing web-apps half-screen'd or in portrait

Good:

Ahh, mobile: a clutter-free web-experience!

Ahh, mobile: a clutter-free web-experience!

You just have to load the mobile versions of the webapps you use. To find them, I viewed them on my phone & checked the url. I’ve also found the ‘print’ versions of yahoo news to be similarly readable.

Conditions: sure forcing all my windows into 2 locations (left/right) & 2 states (half-screen or maximized) is ‘limiting’, but I’m a limited human! I need some parallels here to stay sane. I can’t be moving & resizing windows all day long.

Perhaps I’m just getting old, and will eventually regress into the old lady who only has one window open (maximized) at a time. Until then, this is a good compromise.

Courier, please deliver soon, or I’ll make you out of Linux!

Wednesday, September 23rd, 2009

Everyone’s all abuzz with Microsoft’s latest leaked prototype: Courier. On an off-note, it’s hilarious to contrast the handwritten everything with the king of monospace fonts! (and previously, my latest interest has been the long-awaited crunchpad.)

But there’s 2 things I’m here to mention: my dream & the obvious rising behind Courier.

Why Courier is Obvious:

First off, how many people do you see carrying around a notebook/folio of some variety? Everyone. The business guys do it for their contacts, dates & files. College kids do it for their class notes. Artsy-kids do it for their scribble-pics. Christians have a habit of doing it for their Bible study/sermon notes. Everyone.

Second: netbook+eReader. Limited computing strikes again, and awaiting for a convergence.

Third: Intel’s atom platform (and I would argue ARM even more!) is ready for this kind of thin-and-goodness. Especially with ssd’s (heck, I’d be happy with an SDHC!)

My Little Dream:

I’m a fan of the UI-customizability of Linux. Always have been: it’s what keeps me away from MacOS. Right now, I’ve got a toolbar that has everything I need in it: time, calendar-on-click, applets & a task-switcher. All this overlays the wasted-space of window-titlebar. Most of the time I maximize my apps, so I can focus. But there are somethings that should be a sidebar: notably a tabbed filemanager (since I already have a tabbed term thanks to tilda).

lxpanel-coloredAnd there’s no reason why a quick photo-viewer, calculator, contacts & datebook cannot also be in this sidebar (especially if cache’d & synced from Google!) All this sidebar stuff is too perfect. Why not make a Window Manager that runs specific apps in specific ‘frames’ (yes, like HTML old-skool style). The frames are resizable & collapsable. Ths is so (similar but) much more useful than a tiling WM.

Next up, I’ve never, ever understood file dialog boxes. I do however understand Delicious’ tagging. It auto-generates recommendations, and why not do this for files?  Linux is built for this: symlinks.

And while we’re at it, why not kill off scrollbars & make everything grab-and-draggable. Just use a modifier key (or both-click). Then we can have the app be like a magnifying glass, with the edges smushed to show you how much more you have down there (in preview-style).

As for all this journally stuff, Xournal is the single-best program I have ever, ever, ever encountered. Multiple-layers? yup. Print to PDF? Yup. Wanna add a new page? Click the ‘next page’ button. It could remove all it’s menus if it just had a ‘preferences’ dialog box. It is the model for any journaling program.

Lastly, mouse-gestures are very hot lately. I don’t use them because I’d like ‘em to be like Courier: context-specific AND list suggested actions, instead of always acting on its own.

Dreams, dreams, dreams.

All I’m sayin’ is if ASUS puts out an Intel Atom dual-screen netbook/eReader next year, or even this year, I’m putting my dreams to work. Just need to solve 2 problems:  the sidebar thinger (update: “devilspie” might be halfway there for me) & handwriting recognition (and I’ve got a prototype system coming this december when classes are out!).

The iPen Review

Tuesday, September 22nd, 2009

The iPen, by Finger System, Inc.

First off, sometimes you can judge a book by it’s cover– especially when a marketing department has ahold of the cover. By this I mean the “Ages 5 & up” label. Yes, this IS a kids play toy, and I’m going to try and take it seriously. I hope that doesn’t make me a kid. Likely does.

First Impressions

first 15mins:  holy crap this is fussy! How does this work right at all?

second 15mins:  let’s try to figure some workarounds..

third 15mins:  ok, now with a basic system in place, perhaps there’s a chance.. a very small chance..

last 15mins:  It brings back the good ol’ days of owning a pocket pc.

1 month in: with the right linux-config’d system in place, the iPen has it’s place, and can even replace the need to own a full $1700 tabletPC. For $15, it’s a steal. But the whole repetitive stress thing isn’t any better or worse, but that’s my fault for being tied to this thing for 12hrs /day!

“The System” (My Linux config)

0) You really should use the old-school optical 1mm grid they provide.. graph paper doesn’t cut it. I ended up cutting a 2″x3″ square out & taping it on the corner of my laptop (nearly over the trackpad!) when I’m not at my desk. However, when running in ’super slow mode’, i need the whole thing. Choose cutting wisely.
1) hold the mouse a bit more upright than a regular pen, especially when not using the grid-pad :(
2) Slow the mouse settings all the way down: xset m 0 0, (or see my ultra-slowed-down xorg.conf)
3) Use xournal to scribble notes & PDF annotate, zoomed in to full-width (150%), unless running ultra-slow, then tis fine zoomed out where the notebook lines are like college-ruled. (yes, i measured). Xournal also supports graph paper, colored paper & custom-paper sizes. Handy for when I rotate the screen. Also, I found having the default right-click to be the ‘hand’ is very handy (like acrobat’s hand/grab-drag-scrolling)
4) Use cellwriter for single character input (aka PocketPC-land!). Takes some config, but it gets pretty good.
5) Firefox plugin: “Grab and drag”!  This is when it hit me: “Don’t try and use a pen like a mouse. Use a pen like a pen!”

The Speed Test

With cell writer config’d & trained (not a hard process at all),
and using the sentence: “The quick brown fox jumps over the lazy dog”:
Typing: “THe quick brown fox jumped over hte lazy dog” is 8-9 seconds, with only 2 errors.
Cellwriter: “the quick brown fox jumped overthe lazy dog.” in 58 seconds, first try, then 44s!, with 2 errors as well.
Handwriting on paper: 13seconds
Xournal: 24seconds.

A 5-6 times increase in time is wretched. Especially if I in-line corrected about 4-6 characters thanks to a shaky nervous hand! No doubt I’ve cellwritten faster since this early test, but I seriously doubt it will ever come close to touch typing. The other variable is that when typing, I type faster than I think, so I’m always stopping to think about what I’m saying. But with cellwriter, I’m writing so slow, I can think about what I’m saying. Trouble is, if it’s too slow, I’m thinking about writing the characters & forgetting about what I’m saying.

Improvements

It’s amazing just how sensitive the nature of handwriting is. There’s 2 very strong components to pencil writing that is lacking with this digital pen.
1) Pencils are pressure sensitive across a gradient, not a binary on/off. You can swipe a pencil and get a line. When you lift a pencil while handwriting, it’s more a light drag across the paper than it is a full 1mm lift. Hopefully I’m explaining this right: the ipen requires a 1mm lifting or dropping of the pen to register a swipe. This is not natural, however oddly enough, when the mouse is super-slow, this problem dissipates, as well as with getting used to it.

2) Tracking. When we lift a pen and move it, it now resides to write in the new location. On the slowest mouse motion, the ‘mousing area’ is still 2″ wide x 1.5″ high. This is hardly a one-to-one (like true tabletPC’s have) with a 13.3″ diagonal screen! Second, this pen is very sensitive and you have to lift the pen a good centimeter off the surface to stop it from moving the mouse cursor (to get the mouse cursor where you want it, relative to the hand-on-paper position). This is also shown when setting down & picking up the pen.. a mouse or trackpad will leave the cursor & mouse, the pen must be set & picked up again.
One last comment, I’d prefer to have a scrollwheel where the right click button is. But some of that is solved by FF’s grab-and-drag plugin. If only that plugin was across all X/GNOME/KDE applications!

What makes bad software bad

Wednesday, April 29th, 2009

I spent the weekend installing a wireless HP 3-in-1 printer onto a Dell WinXP laptop. I don’t mind doing so for my grandparents-in-laws, but it gets tough explaining to them why the wireless software wouldn’t install. “The box says wireless, why isn’t it wireless?” I know. I’m sorry you have to deal with poor management of software.

  • When software installs, it should give options of what to install.
  • When software installs, it should give useful statistics of progress, not 9 flickering bars and a KBps rate (from a cd!)
  • When software uninstalls, it should remove everything. (including desktop icons to buy supplies!) This pseudo-overly helpful ploy of marketing is crap.

Gnome Shell: genius!

Thursday, April 2nd, 2009

Sometimes, just one in a rare while, someone has a good (understatement) idea. I’ve been trying for a long while to understand what a good, innovative, productive computer workspace would looks like. One that captures the needs of the task at hand, centralizing focus on that task, removing distractions, while providing context-relevant information on which to collaborate.

Friends, I introduce: Gnome Shell.
overlay_mode

I really cannot express the genius I feel seeing this. The traditional desktop workspace is the down-n-dirty ‘workbench’. I imagine myself as Dr. Manhattan putting the pieces of the project together in this area.

Not to be lost in the mundane work area, (and, just like the mind!) there is also this overlay, which could hold the sub-tasks, associated projects and documents and email (all through tagging).

The mind, when organizing and planning has such an ‘overlay’, but when ‘in the zone’ of working on a task, interruptions and excess information is hassle. I can furthermore foresee another screen like the overlay, where you’re in planning mode, an overarching taskmanager. All the while, the user status on IM shows the availability for interruption (and optionally the task and how long/deep (subtasks/due date) you are into completing it!)

I like this. I only hope Gnome 3.0 will be the start of something huge across all Desktop vendor-designs. The cluttered desktop of windows-everywhere must end.

Hardware Potential

Wednesday, March 18th, 2009

While everyone who cares is upset at the iPhone’s inability to run more than one application at once, honestly, it makes sense., especially to those of us who have owned WinMo phones and maxed them out.

One of the primary rules of software design has become “don’t make the user manage the memory”. This is good: if my system is maxed out because I’ve run too many programs that decided to not free their memory before closing, I’ll have a dead system fast.. something early WinMo devices fell prey too.

So on comes the iPhone which is determined to deliver the stability popularized by the BSD-based OSX. And most phones don’t run more than one Java app anyways. In my mind, issue resolved.

But what about the desktop? Especially with the low-powered netbooks? Microsoft will deliver a 4-application-only version of Vista. But why, oh why do all major desktops allow the user to slow them down to molasses? Why is there not a “user-friendly” version of the process/resources monitor overlaying the applications launcher, dimming the applications which are recommended to not run up to speed? This assumed-infinite potential leads to direct distrust in software, and leads to a pure guessing game for users: “Yeah, my system slows down after 4 programs.”

Now, I know each application uses different resources depending on the files (websites) opened, but this just shows a systemic failure in desktop design: why attempt to open a file why the system cannot support it? Surely there is a better way.