In my experience much of the time to restore when using tape is traversing the 
actual tape to get to the file(s) that TSM is to restore.

You may want to think of colocation for your primary storage pool and copy pool.

Restore time seems to be one of the trade offs vs. shorter backup time, fewer 
tape hardware resources needed, less ethernet bandwidth, etc. when one uses TSM.