It would ideally come with a removable caddy and a spray that makes it look dusty, so you can put it in the bottom of a old shoebox when it is not in use. THAT would add to the plausible deniability.

A scheme that could boot when there is a hole drilled into the platter would be even better :-)