You could buy "nano" keys for each computer and just leave them installed all the time. And the backup would be one on your keychain. This is how I do it.

I'm not really that concerned about someone gaining physical access to my system compared to how concerned I am about someone on the Internet gaining access to my passwords somehow. Of course I look the doors to my house and don't leave my laptop just lying around :)