That should be fine.
You will be rebuilding your server offsite, defining the library there, and
checking in whichever tapes you want.
That library can be anything you want that supports your drives, or no
library at all.

 A lot of people don't even use a library at their DR site; they just have
drives.
if you have tape drives but no library, you just define your library as
"manual" and respond to mount requests yourself.