Re: HP DataProtector NDMP session failed when backing up Netapp volume (660 Views)
Reply
Occasional Visitor
petr22
Posts: 2
Registered: ‎12-30-2013
Message 1 of 6 (705 Views)

HP DataProtector NDMP session failed when backing up Netapp volume

Hello, we have Netapp filer with several volumes, which we backup with HP DataProtector (version 7.03, all patches installed). Several weeks ago first volume backup started to fail when full NDMP dump backup is performed, but we are unable to find reason why - there is no error message in logs and failed status is displayed even before first tape is loaded into backup library. After session ends, there is no number of files and folders displayed. Only the first Netapp volume (that one which fails) is over 2TB in size. Incremental dump backup does not fail and smtape backup of same volume does not fail.

 

There is a log from backup task - everything is normal, no errors, until end of first volume:

 

[Normal] From: BMA-NDMP@OMNIBACK001 "HP:Ultrium 4-SCSI_1_U0"  Time: 12/30/2013 9:45:19 AM
    DUMP: Deleting "/vol/vol01/../snapshot_for_backup.805" snapshot.

[Normal] From: BMA-NDMP@OMNIBACK001 "HP:Ultrium 4-SCSI_1_U0"  Time: 12/30/2013 9:45:28 AM
    ABORTED Media Agent "HP:Ultrium 4-SCSI_1_U0"

[Critical] From: BSM@OMNIBACK001 "Daily_NDMP_Volumes"  Time: 12/30/2013 9:45:29 AM
    None of the Disk Agents completed successfully.
    Session has failed.

Is there a way how we can further investigate this problem, please? We are unable find any error in HP Data Protector logs, Netapp filer logs or Windows server logs. Maybe the problem is related to size of the volume - few weeks ago the size exceeded 2TB.

 

Please use plain text.
HP Expert
Bob_Clark
Posts: 1,385
Registered: ‎08-14-2013
Message 2 of 6 (681 Views)

Re: HP DataProtector NDMP session failed when backing up Netapp volume

On the server 'OMNIBACK001 ', check for any running processes

 

bma

bma-ndmp

 

at a time when nothing is supposed to be running

 

Windows

      Task Manager -> Process list  or run the command 'tasklist'

UNIX

       ps -ef | grep omni

 

If you find any, then kill them.  Also, again, at a time when nothing is supposed to be running, on the cell manager system, in your list of running processes, see if there are any session manager processes running

 

bsm

msm

rsm

csm

 

If there are, then kill them

 

Stop DP, check the process list for any hanging processes, restart DP, and run

 

Windows

       cd \Program Files\Omniback\bin

       omnidbutil -clear

UNIX

       /opt/omni/sbin/omnidbutil -clear

 

Your description of the problem makes it see like a hanging processes is keeping a new one from starting

 

If none of this helps, and if you get no other ideas from the forum, open a case with the response center, this will need to be debugged

Please use plain text.
Occasional Visitor
petr22
Posts: 2
Registered: ‎12-30-2013
Message 3 of 6 (660 Views)

Re: HP DataProtector NDMP session failed when backing up Netapp volume

It look like there ia s problem on the Netapp filer volume itself, because it fail in the middle of phase 1 of NDMP dump process. Full NDMP dump always ended with same error. Incremental backup of this volume and full backups of another 15 volumes are working. When debug is turned on, there is additional error message:

 

[Normal] From: BMA-NDMP@OMNIBACK001 "HP:Ultrium 4-SCSI_1_U0"  Time: 12/31/2013 4:47:28 PM
    DUMP: READ 39851

[Major] From: BSM@OMNIBACK001 "Daily_NDMP_Volumes"  Time: 12/31/2013 4:47:30 PM
[61:3003]      Lost connection to BMA named "HP:Ultrium 4-SCSI_1_U0"
    on host OMNIBACK001.
    Ipc subsystem reports: "IPC Read Error
    System error: [10054] Connection reset by peer
"

[Critical] From: BSM@OMNIBACK001 "Daily_NDMP_Volumes"  Time: 12/31/2013 4:48:06 PM
    None of the Disk Agents completed successfully.
    Session has failed.

 

I will try to reduce volume size under 2TB and try to start backup again.

Please use plain text.
Occasional Visitor
danielkeisling
Posts: 1
Registered: ‎01-30-2014
Message 4 of 6 (622 Views)

Re: HP DataProtector NDMP session failed when backing up Netapp volume

I am having the exact same problem after (I think) upgrading to 7.03.  Have you found a solution to this?  I am going to try and downgrade back to 7.01.

 

Please use plain text.
HP Expert
Mass2
Posts: 7
Registered: ‎11-26-2013
Message 5 of 6 (575 Views)

Re: HP DataProtector NDMP session failed when backing up Netapp volume

Ask support for a fix for NDMP DUMP. It's a known issue.
Please use plain text.
Occasional Visitor
Systemteam
Posts: 1
Registered: ‎04-23-2013
Message 6 of 6 (489 Views)

Re: HP DataProtector NDMP session failed when backing up Netapp volume

Hi

Got the same problem after updrading to 7.0.3 , any good news for solving this issue ?

BTW - I can see on the NDMPd debug ( Netapp side), that the DP is sending the command to reset the session:

 

0000000b.015b88f9 0b17ae05 Tue Mar 04 2014 15:16:06 +02:00 [kern_ndmpd:info:1462] [88192]   INFO: DATA: received ABORT command

 

 

Thanx,

Avi

Please use plain text.
The opinions expressed above are the personal opinions of the authors, not of HP. By using this site, you accept the Terms of Use and Rules of Participation