When I run amdump on the Amanda server, the client tars up one
filesystem at a time.  I looked through many of the docs and man pages,
but I didn't see any parameter to specify parallel tars on the client.
Is it possible to do that?

Check the amanda.conf man page again for the parameter "maxdumps".