UNSOLVED

NewHanoverDave

updated

13 years ago

0

6902

October 23rd, 2013 15:00

Networker save give RPC service 390103 not registered on 127.0.0.1 message

I have a AIX 5.3 Networker client that just stopped backing up.  No changes on the Networker side.  When I run the backup from the Networker (version 8.0.1 on Windows 2008) via savegrp it stays in the "queued" state.

Has anyone seen this type of issue before?

Networker savegrp command: start savegrp -D8 -vvv -c mckhcr -G 300

Produces a queued state but does not move to a started state.

Message just hangs with this at the bottom and keeps repeating:

3:savegrp: Group 300 waiting for 1 jobs to complete
===== SAVEGROUP QUEUES =====
===== Savegroup stubs jobs: 0
===== Savegroup queued jobs: 0
===== Savegroup waiting jobs: 1
=====   id:    81237, type:   2, state:  20, name: /etc/.init.state, host: mckhc
r
===== Savegroup active jobs: 0
===== Savegroup completed jobs: 1
=====   id:    81236, type:   1, state:  70, name: mckhcr:savefs, host: mckhcr
===== QUEUES END=====
sg_pick_next_job(): Entry...
sg_pick_next_job(): Entry...
sg_pick_next_job(): Entry...
sgrp_update_progress old: |             probing|3/0/0|0/0/0|
sgrp_update_progress new: |              saving|3/1/0|0/0/0|
sgrp_update_progress: sending update
          savegrp exec state: saving;
            savegrp progress: 3/1/0|0/0/0;
Updating job attributes for job 81235
sg_pick_next_job(): Entry...
sgrp_update_progress old: |              saving|3/1/0|0/0/0|
sgrp_update_progress new: |              saving|3/1/0|0/0/0|
sg_pick_next_job(): Entry...
sg_pick_next_job(): Entry...
sg_pick_next_job(): Entry...
sg_pick_next_job(): Entry...
sg_pick_next_job(): Entry...
sgrp_update_progress old: |              saving|3/1/0|0/0/0|
sgrp_update_progress new: |              saving|3/1/0|0/0/0|
sg_pick_next_job(): Entry...
sg_pick_next_job(): Entry...


When running the save command from the AIX client it gives the following messages:

# save -vvv -D8 -b "dd" /etc/hosts.equiv.orig
Reduced cluster query.
clus_get_hostname:ENTRY:
clu_pathl_gethost:ENTRY
clu_pathl_gethost:EXIT:Clu_cluster_type is undefined
clus_get_hostname:EXIT:
nsr_getserverhost(): returning clus_get_hostname() = mckhcr.nhrmc.org
RPC service 390103 (vers 2) not registered on 127.0.0.1
RPC service 390103 (vers 2) not registered on 127.0.0.1
Failed to create RPC client handle: Program not registered
lgto_auth for `nsrexec' succeeded
3817:save: Using mckhcr.nhrmc.org as server
RPC service 390109 (vers 2) not registered on 127.0.0.1
RPC service 390109 (vers 2) not registered on 127.0.0.1
Failed to create RPC client handle: Program not registered
Failed to get server attributes for save: Program not registered
RPC service 390433 (vers 1) not registered on 127.0.0.1
RPC service 390433 (vers 1) not registered on 127.0.0.1
Failed to create RPC client handle: Program not registered
89987:save: Cannot determine the job ID: Program not registered. Continuing ...
Invalid or NULL session channel90842:save: Unable to update job with id '0' with command value 'save -vvv -D8 -b dd /etc/hosts.equiv.orig': Invalid or NULL session channelsetup_mntasm: adding /
setup_mntasm: adding /usr
70342:save: save: got prototype for /
setup_mntasm: adding /var
70342:save: save: got prototype for /
setup_mntasm: adding /tmp
70342:save: save: got prototype for /
setup_mntasm: adding /home
70342:save: save: got prototype for /
setup_mntasm: adding /proc
70342:save: save: got prototype for /
setup_mntasm: adding /opt
70342:save: save: got prototype for /
setup_mntasm: adding /dmbackup
70342:save: save: got prototype for /
setup_mntasm: adding /dmora0
70342:save: save: got prototype for /
setup_mntasm: adding /dmora1
70342:save: save: got prototype for /
setup_mntasm: adding /dmora2
70342:save: save: got prototype for /
setup_mntasm: adding /dmora3
70342:save: save: got prototype for /
setup_mntasm: adding /dmora4
70342:save: save: got prototype for /
setup_mntasm: adding /dmmisc
70342:save: save: got prototype for /
setup_mntasm: adding /dm_archive
70342:save: save: got prototype for /
setup_mntasm: adding /dm0
70342:save: save: got prototype for /
setup_mntasm: adding /dm1
70342:save: save: got prototype for /
setup_mntasm: adding /dm2
70342:save: save: got prototype for /
setup_mntasm: adding /dm3
70342:save: save: got prototype for /
setup_mntasm: adding /dm4
70342:save: save: got prototype for /
setup_mntasm: adding /dm5
70342:save: save: got prototype for /
setup_mntasm: adding /dm6
70342:save: save: got prototype for /
setup_mntasm: adding /dm7
70342:save: save: got prototype for /
setup_mntasm: adding /dm8
70342:save: save: got prototype for /
setup_mntasm: adding /dm9
70342:save: save: got prototype for /
setup_mntasm: adding /dm10
70342:save: save: got prototype for /
setup_mntasm: adding /dm11
70342:save: save: got prototype for /
setup_mntasm: adding /dm12
70342:save: save: got prototype for /
setup_mntasm: adding /dmtmp
70342:save: save: got prototype for /
setup_mntasm: adding /dmrb1
70342:save: save: got prototype for /
setup_mntasm: adding /dmrb2
70342:save: save: got prototype for /
setup_mntasm: adding /usr/clinicare
70342:save: save: got prototype for /usr/
setup_mntasm: adding /oracle
70342:save: save: got prototype for /
setup_mntasm: adding /u
70342:save: save: got prototype for /
setup_mntasm: adding /stage
70342:save: save: got prototype for /
setup_mntasm: adding /dm14
70342:save: save: got prototype for /
setup_mntasm: adding /nsr
70342:save: save: got prototype for /
setup_mntasm: adding /ddbkup
70342:save: save: got prototype for /
setup_mntasm: adding /mnt2
70342:save: save: got prototype for /

cluc_splitsaves(): ENTRY ...

No -c is specified.

addss(): ENTRY ...

clu_is_cluster_host_lc(): ENTRY ...
clu_pathl_gethost:ENTRY
clu_pathl_gethost:EXIT:Clu_cluster_type is undefined
clu_pathl_free:ENTRY
clu_pathl_free:EXIT
clu_is_cluster_host:ENTRY
clu_is_cluster_host:EXIT:returning FALSE
RPC service 390109 (vers 2) not registered on 127.0.0.1
RPC service 390109 (vers 2) not registered on 127.0.0.1
Failed to create RPC client handle: Program not registered
RAP query failed for client de-duplication attributes: Program not registered
RPC service 390103 (vers 2) not registered on 127.0.0.1
RPC service 390103 (vers 2) not registered on 127.0.0.1
Failed to create RPC client handle: Program not registered
42503:save: RPC cannot make a procedure call: Create failed: Program not registered
90017:save: Cannot open a save session with NetWorker server 'mckhcr.nhrmc.org'.
Invalid or NULL session channel90843:save: Unable to update job with id '0' with name value '/etc/hosts.equiv.orig': Invalid or NULL session channelroot@mckhcr [/etc]

  • ble1

    6 Operator

    •

    14354 Posts

    •

    56186 Points

    1991

    1

    Posted October 23rd, 2013 15:00

    That RPC service is nsrjobdb on your backup server.  Your command (save) is missing -s parameter.  This is why save tries to connect to localhost (AIX) to jobdb, but of course this does not exist on client.

  • 1991

    0

    Posted October 24th, 2013 07:00

    You are absolutely correct.  Thank you for pointing that out.  In the posting I did not have the server defined.  After defining the server correctly it appears I can get a client side save to work but still gets hung up on the Networker side when running the savegrp command.  Do you know of a way to further troubleshoot the Networker side "Hung in queued state" issue.

  • ble1

    6 Operator

    •

    14354 Posts

    •

    56186 Points

    1991

    0

    Posted October 28th, 2013 14:00

    Start it from server without any debug and see if you get any pending messages.  If not, check client and see what is the save command there built and compare it to what you already run manually.  Eventually, you can place into debug mode and see what is going on there as well when kicking scheduled backup.