The first part of the solution came from this link:
http://kb.vmware.com/selfservice/microsites/search.do?cmd=displayKC&docType=kc&docTypeID=DT_KB_1_1&externalId=5962168
This gave us the hint that we were not waiting long enough. We built in a 2
minute wait and the Oracle errors ceased.
Now we keep getting disconnects after 4 or 5 hours, so while the backup is now
running without killing the application, we are not completing the backup. We
have opened a case with IBM.
Thank you everyone for the help.
This is our new problem:
7/19/2013 03:25:27 ANS9365E VMware vStorage API error for virtual machine
'vm096'.
TSM function name : VixDiskLib_Read
TSM file : vmvddksdk.cpp (2770)
API return code : 14009
API error message : The server refused connection
07/19/2013 03:25:27 ANS0361I DIAG: VmProcessExtent(): Retrying failed read:
vddksdkRead() rc=-1, startSector=0, numSectorsToRead=512
07/19/2013 03:25:27 ANS9365E VMware vStorage API error for virtual machine
'vm096'.
TSM function name : VixDiskLib_Read
TSM file : vmvddksdk.cpp (2770)
API return code : 14009
API error message : The server refused connection
07/19/2013 03:25:27 ANS0361I DIAG: VmProcessExtent(): Read failed:
vddksdkRead() rc=-1, startSector=0, numSectorsToRead=512
07/19/2013 03:25:27 ANS1228E Sending of object 'vm096' failed
07/19/2013 03:25:27 ANS5283E The operation was unsuccessful.
Andy Huebner
-----Original Message-----
From: ADSM: Dist Stor Manager [mailto:ADSM-L AT VM.MARIST DOT EDU] On Behalf Of
Ryder, Michael S
Sent: Friday, July 19, 2013 9:02 AM
To: ADSM-L AT VM.MARIST DOT EDU
Subject: Re: [ADSM-L] TSM VE backup of Orcale Windows server
I realize that this might not directly apply to your "Oracle version: OLD"
situation, but maybe it's useful as a tool to convince others of the benefits
of an upgrade:
You can read more about how the Oracle VSS writer works at this link:
http://docs.oracle.com/cd/B28359_01/win.111/b32010/vss.htm
More info from the VMware side here:
http://blogs.vmware.com/vsphere/2013/03/quiescing-oracle-db-windows-vdpa.html
And from Microsoft, how VSS works:
http://technet.microsoft.com/en-us/library/cc785914(v=ws.10).aspx
If you can't leave "Oracle version: OLD" and Windows 2000, then I recommend you
use the VM tools on that guest to execute a scripted shutdown of your
application and the database in response to a VM tools snapshot request.
VM tools can also run scripts to start things back up when the snapshot
operation is complete. (deletion of snapshot after the backup does not incur
another shutdown). Depending on the speed of the computer, the shutdown should
only last as long as it takes to shutdown app, shutdown Oracle, take snapshot,
startup Oracle, startup app.
Good Luck!
Mike
Best regards,
Mike
RMD IT, x7942
On Fri, Jul 19, 2013 at 1:37 AM, Grigori Solonovitch < Grigori.Solonovitch AT
ahliunited DOT com> wrote:
> Hello Shawn,
> Oracle 11g has Oracle VSS driver similar to MS SQL. This driver is
> installed automatically during database installation, but it is
> running as a separate service. It is shown in the list of VSS writers
> when running. In addition, as far as I understand, it is possible to
> install this driver
> (11g?) for Oracle 10.2.0.3 and later as well.
> Kindest regards,
>
> Grigori Solonovitch, Senior Systems Architect, IT, Ahli United Bank
> Kuwait, www.ahliunited.com.kw
>
>
> -----Original Message-----
> From: ADSM: Dist Stor Manager [mailto:ADSM-L AT VM.MARIST DOT EDU] On Behalf
> Of Shawn DREW
> Sent: 19 07 2013 1:41 AM
> To: ADSM-L AT VM.MARIST DOT EDU
> Subject: Re: [ADSM-L] TSM VE backup of Orcale Windows server
>
> To expand on this... As I understand it, the newer versions of TSM
> for VE and Virtualcenter are trying to offer a
> better-than-crash-consistent snapshot. When an application supports
> it, VMware communicates through VSS to the application (MSSQL for
> example) and it will attempt to quiesce the database before the VMware
> snapshot occurs. This adds complexity and
> head-scratching when it doesn't work. I'm not sure if Oracle has this
> integration and you don't need it if you are manually quiescing the
> database. Maybe there is a driver in there that is attempting to make
> it work with Oracle. I never figured out how to disable this integration.
>
>
> Regards,
> Shawn
>
>
>
> > -----Original Message-----
> > From: ADSM-L AT VM.MARIST DOT EDU [mailto:ADSM-L AT VM.MARIST DOT EDU]
> > Sent: Thursday, July 18, 2013 3:14 AM
> > To: ADSM-L AT VM.MARIST DOT EDU
> > Subject: Re: [ADSM-L] TSM VE backup of Orcale Windows server
> >
> > TSM4VE does get VMWare to create a snapshot, it's VMWare that then
> > integrates with the VM to do the VSS stuff.
> >
> > As you don't have VSS, VMWare will use it's own driver to do this (SYNC).
> > it has been know for this quiesce stage to kill a busy server:
> >
> > http://kb.vmware.com/selfservice/microsites/search.do?cmd=displayKC&;
> > d
> > ocType=kc&docTypeID=DT_KB_1_1&externalId=5962168
> >
> > Feedback if it makes a difference.
> >
> > Steven
> >
> > P.S. loved your comment about old W2K servers!
> >
> >
> > On 17 July 2013 19:13, Huebner, Andy <andy.huebner AT alcon DOT com> wrote:
> >
> > > In the physical world, we stopped the application, used the SAN to
> > > make a snap shot of the disks then restarted the application. The
> > > snaps where then given to another server where they are backed up.
> > > The virtual version would be similar, stop the application, start
> > > the backup, start the application.
> > >
> > > Our understanding of the TSM VE process is that TSM has VMWare
> > > make a snap of the disks then TSM backs up the snap. If that is
> > > the case why would VSS matter on the guest? Or do we have it wrong?
> > >
> > > Our problem is we have been given about 30 minutes to backup an
> > > application that spans 3 servers and dozens of disks. On the
> > > disks we have Oracle and millions of files. All have to be in
> > > sync to be able to do a complete restoration of the application.
> > > The physical version of this process has worked for more than 10
> > > years, now we need to convert it to virtual.
> > >
> > >
> > > Andy Huebner
> > >
> > >
> > > -----Original Message-----
> > > From: ADSM: Dist Stor Manager [mailto:ADSM-L AT VM.MARIST DOT EDU] On
> > Behalf
> > > Of Ryder, Michael S
> > > Sent: Wednesday, July 17, 2013 11:25 AM
> > > To: ADSM-L AT VM.MARIST DOT EDU
> > > Subject: Re: [ADSM-L] TSM VE backup of Orcale Windows server
> > >
> > > Andy:
> > >
> > > VE uses Microsoft VSS (Volume Shadow copy Service), which was not
> > > available with Windows 2000.
> > > Oracle VSS Writer is only available with Oracle 9i or later.
> > >
> > > On Windows 2003 and newer, and Oracle 9i and alter, we have no
> > > trouble with hot-backups of Oracle systems where we have the
> > > Oracle writer for VSS installed.
> > >
> > > I can't explain why your DB would get corrupt, but without VSS and
> > > VSS-Writer for Oracle, there isn't any integration between Oracle
> > > and the snapshot process. That in itself might be enough to
> > > explain
> it.
> > >
> > > On servers where we couldn't get VSS Writer for Oracle installed,
> > > we only do cold-backups by using VMware tools to execute
> > > batch-commands to properly shutdown and restart applications and
> > > their Oracle
> databases.
> > >
> > > I think you will only be able to get away with cold-backups in
> > > your current configuration.
> > >
> > > Mike
> > >
> > > Best regards,
> > >
> > > Mike
> > > RMD IT, x7942
> > >
> > >
> > > On Wed, Jul 17, 2013 at 11:20 AM, Huebner, Andy
> > > <andy.huebner AT alcon DOT com
> > > >wrote:
> > >
> > > > We ran our first backup of a Oracle server using TSM VE and the
> > > > Oracle DB reported many errors and it caused the Oracle DB to
> > > > become
> > corrupt.
> > > > I believe Oracle crashed and it was later recovered.
> > > >
> > > > Has anyone had any issues backing up a live Oracle system with
> > > > TSM
> VE?
> > > >
> > > > Oracle - v.Old
> > > > Windows - 2000 (laugh it you want, but I bet you have some too)
> > > > TSM agent 6.4.0.0 TSM Server 6.2.3.100
> > > >
> > > > There is far more to the process and well thought out reasons,
> > > > but this is the bit that is having an issue.
> > > >
> > > >
> > > > Andy Huebner
> > > >
> > >
>
>
> This message and any attachments (the "message") is intended solely
> for the addressees and is confidential. If you receive this message in
> error, please delete it and immediately notify the sender. Any use not
> in accord with its purpose, any dissemination or disclosure, either
> whole or partial, is prohibited except formal approval. The internet
> can not guarantee the integrity of this message. BNP PARIBAS (and its
> subsidiaries) shall (will) not therefore be liable for the message if
> modified. Please note that certain functions and services for BNP
> Paribas may be performed by BNP Paribas RCC, Inc.
>
>
>
> Please consider the environment before printing this Email.
>
> ________________________________
>
> CONFIDENTIALITY AND WAIVER: The information contained in this
> electronic mail message and any attachments hereto may be legally
> privileged and confidential. The information is intended only for the
> recipient(s) named in this message. If you are not the intended
> recipient you are notified that any use, disclosure, copying or
> distribution is prohibited. If you have received this in error please
> contact the sender and delete this message and any attachments from
> your computer system. We do not guarantee that this message or any
> attachment to it is secure or free from errors, computer viruses or
> other conditions that may damage or interfere with data, hardware or software.
>
|
