VM backups fail with API RC 14009 - But successful in rerun

[Dinesh]

Hello Admins,

Have a great day...

I'm having issues with my VM backups where it's used to fail in scheduled backups ( 7 out of 35 VM's ). But when we rerun before business hours one by one or parallelly they are getting successful.

Requesting your advise on this how to proceed further.

Error message :-

01/28/2021 07:57:12 ANS0361I DIAG: vmRetryVirtualDiskRead(): vddk read failed, total retries=12.
01/28/2021 07:57:12 ANS0361I DIAG: VmReadVirtualDisk(): Disk Read failed: rc=-1, startSector=6144, numSectorsToRead=512
01/28/2021 07:57:12 ANS9365E VMware vStorage API error for virtual machine 'vm-machine'.
IBM Spectrum Protect function name : VixDiskLib_Read
IBM Spectrum Protect file : ..\..\common\vm\vmvddksdk.cpp (3194)
API return code : 14009
API error message : The server refused connection
01/28/2021 07:57:12 ANS0361I DIAG:
01/28/2021 07:57:12 ANS0361I DIAG: VmReadVirtualDisk(): retrying disk read operation for up to 120 seconds.
01/28/2021 07:57:12 ANS9365E VMware vStorage API error for virtual machine 'vm-machine'.
IBM Spectrum Protect function name : VixDiskLib_Read
IBM Spectrum Protect file : ..\..\common\vm\vmvddksdk.cpp (3194)
API return code : 14009
API error message : The server refused connection

 

[DanGiles]

Speak to your VM team to see if they are doing something with the vCentre during that time. Is the error consistent and at the same time? Is it only for one of the data movers? Or maybe the same ESXi server? Seems like the vCentre (or ESXi server, or VMs) was down or unavailable. Maybe even the set of VMs. Make sure they're not running some automated script that's messing with the backups.