I've thought of this as a hardware product: A device that records your own voice and non vocal sounds, but which does not record the words of others. (That, plus maybe location and a video stream, provided one is in a location without "a reasonable expectation of privacy.")

Perhaps it doesn't even have to be hardware at this point! Maybe this could be installed as an app on an older smartphone?