ADSM-L

Re: Multiple Backups and Archives

2000-01-25 13:13:57
Subject: Re: Multiple Backups and Archives
From: Miles Purdy <PURDYM AT NISA.GC DOT CA>
Date: Tue, 25 Jan 2000 12:13:57 -0600
You should be able to archive to all your drives at once, I was able to. 
However performance was actually worse. I can get about 8.5-8.9 MB/s to ONE 
3575 model C. 

Use this little script to do some testing. Change the management class, number 
of streams, script directory and hostname. The script will be build 
$NUM_STREAMS scripts and orders the files by decreasing size, so that each 
stream backs up about the same amount of data.

Miles

#!/usr/bin/ksh
#
# Name: 
#
# Purpose: 
#
# Type: 
#
# Date: 
#
# Required Parameters:
# -------------------------------------------------------------------------
#
# Optional Parameters:
# -------------------------------------------------------------------------
#
# Change History:
#
# Date          Name            Comments
# _________________________________________________________________________
#

# set umask to prevent others from reading tmp files
umask 077

DIRECTORY=$1

RETCODE=0
MC=1day
NUM_STREAMS=7

echo $0 started at $(date).

WORK_DIR=${WORK_DIR:=/tmp}
SCR_DIR=$UNIX_SYSTEM_DIRECTORY/bin

if [[ `hostname` != 'unxr' ]]
then
   echo "This scripts should be run from unxr."
   exit
fi

COUNT=1
/usr/bin/find $DIRECTORY -fstype jfs -type f -xdev -ls | sort -bnr +6.0 -7.0 \
     | sed "s/^.* \//\//" | while read LINE
     | sed "s/^.* \//\//" | while read LINE
do

   if [[ ! -s /tmp/file_list.$$.$COUNT ]]
   then
      echo "#!/usr/bin/ksh"      > /tmp/file_list.$$.$COUNT
      echo ""                   >> /tmp/file_list.$$.$COUNT
      chmod +x /tmp/file_list.$$.$COUNT
   
   fi

   echo "$DSM_DIR/dsmc archive -archmc=$MC $LINE" >>/tmp/file_list.$$.$COUNT

   let "COUNT = COUNT + 1"
   if [[ $COUNT -eq $NUM_STREAMS ]]
   then
      COUNT=1
   fi

done

COUNT=1
while [[ $COUNT -lt $NUM_STREAMS ]]
do
   /tmp/file_list.$$.$COUNT 1>/tmp/$$.$COUNT 2>&1 &
   let "COUNT = COUNT + 1"
done

wait

COUNT=1
while [[ $COUNT -lt $NUM_STREAMS ]]
do
   cat /tmp/$$.$COUNT
   let "COUNT = COUNT + 1"
done

echo "==================================================================="
COUNT=1
while [[ $COUNT -lt $NUM_STREAMS ]]
do
   echo "Stream $COUNT:"
   cat /tmp/$$.$COUNT | grep -i "Total number of bytes transferred"
   cat /tmp/$$.$COUNT | grep -i "Elapsed processing time"
   cat /tmp/$$.$COUNT | grep -i "Aggregate data transfer rate"
   echo "-------------------------------------------------------------------"
   let "COUNT = COUNT + 1"
   let "COUNT = COUNT + 1"
done

# exit
echo $0 ended at $(date).
exit $RETCODE


-------------------------------------------------------------------------------------------
----------------
Miles Purdy
Miles Purdy
System Manager, NISA
(204) 984-1602
purdym AT nisa.gc DOT ca

>>> Ray Baughman <rbaughman AT NATIONALMACHINERY DOT COM> 01/25/00 11:19AM >>>
Hello All

My problem is we have a 3575 L18 with 3 3570 drives.  What I'd like to be
able to do is run a backup or archive to all three drives at the same time
using Korn shell scripts which will run 3 command line backups or archives
at the same time.  I have not tried the backups yet, but when I run the 2 or
more archives at the same time from the same client, the ADSM server
crashes.  This is worse than not using all 3 drives at the same time.  Any
help would be appreciated.

Ray Baughman
National Machinery Co.
Phone:   419-443-2257
Fax:     419-443-2376
Email:   rbaughman AT nationalmachinery DOT com
<Prev in Thread] Current Thread [Next in Thread>