UNSOLVED

DavidHampson

updated

21 years ago

D

DavidHampson

2 Intern

•

1080 Posts

0

2067

February 23rd, 2006 09:00

Very slow backups

I have a couple of W2K clients (7.2) here which are being newly configured. We set them up on ssbak13 (7.1.2) the other day and they went pretty slow (100Kb/s over a dedicated 100Mb network to LTO drives with nothing else running at the same time). The project manager didn't give me time to investigate but instead had me move them to another Networker server ssbak12 (7.3) where we had identical problems.

Running a save -D9 from one of the clients it fails as such:

save: mmsave setup failed: Warning, cannot resolve host 'UKWAP346' to '10.102.5.
12', name server may be misconfigured.
save: direct save returns: Warning, cannot resolve host 'UKWAP346' to '10.102.5.
12', name server may be misconfigured.
save: error, Warning, cannot resolve host 'UKWAP346' to '10.102.5.12', name serv
er may be misconfigured. (number -7)
save: Cannot open save session with ssbak12
save completion time: 2-23-06 4:54p
save: win32_post_save(): Called
C:\Documents and Settings\Administrator>

We have acknowledged there is a Windows reverse DNS issue on the backup interface card ukwap346-bak but I'm curious why it would be backing up at all if this was the case!?! All aliases are configured on the Networker resource; the UNIX DNS server correctly does reverse lookups of 10.102.5.12 to ukwap346-bak and the server network interface is configured as ssbak12-bk (we have also tried this with server network interface field blank).
  • brooks2

    12 Posts

    530

    0

    Posted February 23rd, 2006 11:00

    Verify the settings of the negotiation of the network adaptors and the switch ports they are connected to. Sometimes they are not in sync or should both be forced to full/100.

    -Brooks
  • ble1

    6 Operator

    •

    14354 Posts

    •

    56186 Points

    530

    0

    Posted February 23rd, 2006 14:00

    What Brooks said is suspect number one. Suspect number two (when it comes to system related stuff) are TCP settings on both end. Usually you are able to confirm something is wrong by doing ftp test with put and get (bare in mind that transaction in one direction may result in expected speed). But I would also start by checking what Brooks said and verifying that with some systems tools as well.
  • ble1

    6 Operator

    •

    14354 Posts

    •

    56186 Points

    530

    0

    Posted February 24th, 2006 01:00

    NIC setting can be correct, but if the port setting on switch is not set correctly you may see the same problem again so check that too.
  • DavidHampson

    2 Intern

    •

    1080 Posts

    530

    0

    Posted February 24th, 2006 01:00

    We have already verified the settings of the network cards hard set to 100M full duplex. We may move on to doing some ftp tests but first thing we are going to do is configure HOSTS file and see what impact that has.
  • DavidHampson

    2 Intern

    •

    1080 Posts

    530

    0

    Posted February 24th, 2006 03:00

    7.3 did not solve the problem...!

    The backup appears to hang - here are the final few lines from the save -D9:


    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: get_myaddrs: cache exist timing, LasTime 1140781868
    save: get_myaddrs: cache exist timing, CurrTime 1140781869
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 10124
    save: socket bound to port 20513
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 21508
    save: socket bound to port 20042
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: lgto_auth: redirected to ssbak12 prog 390103 vers 2
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: get_myaddrs: cache exist timing, LasTime 1140781868
    save: get_myaddrs: cache exist timing, CurrTime 1140781869
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 23962
    save: socket bound to port 13936
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 25351
    save: socket bound to port 21708
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: lgto_auth for `nsrd' succeeded
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 13396
    save: socket bound to port 12612
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: Calling clnttcp_create function
    save: socket bound to port 11598
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 24396
    save: socket bound to port 23053
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: lgto_parms: redirected to ssbak12 prog 390103 vers 2
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: get_myaddrs: cache exist timing, LasTime 1140781868
    save: get_myaddrs: cache exist timing, CurrTime 1140781869
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 28267
    save: socket bound to port 11838
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 22641
    save: socket bound to port 19521
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: lgto_parms for `nsrstat' succeeded
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: get_myaddrs: cache exist timing, LasTime 1140781868
    save: get_myaddrs: cache exist timing, CurrTime 1140781870
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 19722
    save: socket bound to port 19190
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: get_myaddrs: cache exist timing, LasTime 1140781868
    save: get_myaddrs: cache exist timing, CurrTime 1140781870
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 20427
    save: socket bound to port 18894
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 14321
    save: socket bound to port 14327
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: lgto_auth: redirected to ssbak12 prog 390103 vers 2
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: get_myaddrs: cache exist timing, LasTime 1140781868
    save: get_myaddrs: cache exist timing, CurrTime 1140781870
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 18918
    save: socket bound to port 15136
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 26509
    save: socket bound to port 13160
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: lgto_auth for `nsrd' succeeded
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 14112
    save: socket bound to port 25906
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: get_myaddrs: cache exist timing, LasTime 1140781868
    save: get_myaddrs: cache exist timing, CurrTime 1140781870
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 21504
    save: socket bound to port 15064
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: get_myaddrs: cache exist timing, LasTime 1140781868
    save: get_myaddrs: cache exist timing, CurrTime 1140781870
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 21335
    save: socket bound to port 11857
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 15502
    save: socket bound to port 23973
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: lgto_auth: redirected to ssbak12 prog 390103 vers 2
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: get_myaddrs: cache exist timing, LasTime 1140781868
    save: get_myaddrs: cache exist timing, CurrTime 1140781870
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 23750
    save: socket bound to port 22691
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 22074
    save: socket bound to port 17373
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: lgto_auth for `nsrd' succeeded
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 23474
    save: socket bound to port 13193
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: get_myaddrs: cache exist timing, LasTime 1140781868
    save: get_myaddrs: cache exist timing, CurrTime 1140781871
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 14481
    save: socket bound to port 17667
    save: This client is not licensed for VSS.
    save: getstats(c:\temp, 0011C624)
    save: fullcanon(name=c:\temp)
    save: exit fullcanon(fullname=C:\temp)
    save: lg_lstat(): Calling lgstat().
    save: ow_get_stats(): stat'ing ASR:\
    save: ow_find_first_component() called on ASR:\*.*
    save: ow_get_stats(): stat'ing SYSTEM FILES:\
    save: ow_find_first_component() called on SYSTEM FILES:\*.*
    save: ow_find_next_component() called on Extensible Firmware Interface Partition
    save: OW: Extensible Firmware Interface Partition - Returned FALSE for display in GUI
    save: ow_get_stats(): stat'ing SYSTEM DB:\
    save: ow_find_first_component() called on SYSTEM DB:\*.*
    save: ow_find_next_component() called on Removable Storage Database
    save: ow_find_next_component() called on Windows Management Instrumentation Database
    save: ow_find_next_component() called on Terminal Service Licensing Database
    save: OW: Terminal Service Licensing Database - Returned FALSE for display in GUI
    save: ow_find_next_component() called on Content Index Catalogs
    save: OW: Content Index Catalogs - Returned FALSE for display in GUI
    save: ow_get_stats(): stat'ing SYSTEM STATE:\
    save: ow_find_first_component() called on SYSTEM STATE:\*.*
    save: GetComputerName: 'UKWAP346'
    save: call to DsIsNTDSOnline failed, DS not found.
    save: ow_find_next_component() called on Performance Counters
    save: ow_find_next_component() called on Internet Information Services
    save: Metabase, xml file is C:\WINDOWS\system32\inetsrv\MetaBase.xml
    save: ow_find_next_component() called on COM+ Registration Database
    save: ow_find_next_component() called on Certificate Server
    save: cert_server_online(): The certificate server is not online
    save: OW: Certificate Server - Returned FALSE for display in GUI
    save: ow_find_next_component() called on Sys Vol
    save: OW: Sys Vol - Returned FALSE for display in GUI
    save: ow_find_next_component() called on Cluster Database
    save: OW: Cluster Database - Returned FALSE for display in GUI
    save: ow_find_next_component() called on Registry
    save: elogasm_setup_directives: Event Log Directives
    save: SYSTEM STATE: AD - SetupDirectives() function not defined!
    save: SYSTEM STATE: ASRSYSOW - asrsys_setupdirectives: Directives
    save: SYSTEM STATE: ASRSYSOW - saved_asr_path is C:\WINDOWS\repair\
    save: SYSTEM STATE: ASRSYSOW - Directives Setup
    save: SYSTEM STATE: PCNOW - pcnow_setup_directives: Performance Counter Directives
    save: SYSTEM STATE: PCNOW - Directives Setup
    save: SYSTEM STATE: IIS - Metabase, xml file is C:\WINDOWS\system32\inetsrv\MetaBase.xml
    save: SYSTEM STATE: IIS - Directives Setup
    save: SYSTEM STATE: COMPLUS - SetupDirectives() function not defined!
    save: SYSTEM STATE: CERT - cert_server_do_directives() called
    save: SYSTEM STATE: CERT - cert_server_online(): The certificate server is not online
    save: SYSTEM STATE: CERT - Failed to setup directives
    save: SYSTEM STATE: SYSVOL - frs_setupdirectives: SYSVOL Directives
    save: SYSTEM STATE: SYSVOL - Directives Setup
    save: SYSTEM STATE: NTCLUDB - ntcludb_setup_directives: Cluster Directives

    save: SYSTEM STATE: NTCLUDB - Directives Setup
    save: SYSTEM STATE: REGOW - regow_setup_directives: Registry Directives
    save: SYSTEM STATE: REGOW - Directives Setup
    save: SYSTEM STATE: - SetupDirectives() succeeded
    save: SYSTEM DB: QUOOW - quoow_setup_directives: Disk Quota Directives

    save: SYSTEM DB: QUOOW - Directives Setup
    save: SYSTEM DB: RSMOW - rsmow_setup_directives: RSM database Directives
    save: SYSTEM DB: RSMOW - Directives Setup
    save: SYSTEM DB: WMI - wmi_db_do_directives() called
    save: SYSTEM DB: WMI - Directives Setup
    save: SYSTEM DB: WTSOW - wtsow_setup_directives: WTS database Directives
    save: SYSTEM DB: WTSOW - Directives Setup
    save: SYSTEM DB: CINDEX - Directives Setup
    save: SYSTEM DB: - SetupDirectives() succeeded
    save: SYSTEM FILES: WPFOW - sfcow_setup_directives: Directives
    save: SYSTEM FILES: WPFOW - Directives Setup
    save: SYSTEM FILES: WEFIOW - Directives Setup
    save: SYSTEM FILES: - SetupDirectives() succeeded
    save: ASR: ASROW - asr_setup_directives: Directives
    save: ASR: ASROW - Directives Setup
    save: ASR: - SetupDirectives() succeeded
    save: win32_pre_save(): Calledsave:
    cluc_splitsaves(): ENTRY ...
    save:
    No -c is specified.
    save:
    addss(): ENTRY ...
    save: clu_pathl_gethost:ENTRY
    save: input path=c:\temp
    save: clu_pathl_gethost:EXIT:Clu_cluster_type is undefined
    save: clu_pathl_free:ENTRY
    save: clu_pathl_free:EXIT
    save: clu_is_cluster_host:ENTRY
    save: clu_is_cluster_host:EXIT:returning FALSE
    save: clu_is_cluster_host:ENTRY
    save: clu_is_cluster_host:EXIT:returning FALSE
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: get_myaddrs: cache exist timing, LasTime 1140781868
    save: get_myaddrs: cache exist timing, CurrTime 1140781872
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 23104
    save: socket bound to port 14049
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 29732
    save: socket bound to port 18804
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: lgto_parms for `nsrmmd' succeeded
    save: got `store index entries' value of `Yes'
    save: server enabled for immediate mode
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ssbak12
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: lgto_auth for `nsrmmd' succeeded
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 20105
    save: socket bound to port 10415
    save: RPC Authentication: Client successfully authenticated using GSS Legato
    save: clu_is_localvirthost:ENTRY
    save: input hostname=ukwbak20.vf-uk.internal.vodafone.com
    save: clu_is_localvirthost():EXIT unknown cluster type
    save: get_myaddrs: cache exist timing, LasTime 1140781868
    save: get_myaddrs: cache exist timing, CurrTime 1140781872
    save: Calling clnttcp_create function
    save: Calling clnttcp_create function
    save: socket bound to port 13500
    save: socket bound to port 12010

    We are seeing some activity on the backup interface but the backup itself just seems to sit there... I'm going to pass this one to EMC to see what they can suggest!
  • ble1

    6 Operator

    •

    14354 Posts

    •

    56186 Points

    530

    0

    Posted February 24th, 2006 03:00

    Do you get this only with one client or more than one? What about ftp test? Good luck with 7.3, but it's not going to solve this problem I'm afraid...
  • DavidHampson

    2 Intern

    •

    1080 Posts

    530

    0

    Posted February 24th, 2006 03:00

    Hosts tables did not resolve the problem - it remained the same. We looked at the routing tables and the default gateway on the backup network was coming up as the backup interface; we cleared the routing table and then had to restart the server as it dropped off the network (!)

    When it rebuilt the routing table we no longer get the "cannot resolve hostname to backup interface IP" message, but now we get as far as it starting to back up a file but just sits there doing nothing!?!

    We are going to reinstall the client software to see where that brings us (and upgrade to 7.3)
  • DavidHampson

    2 Intern

    •

    1080 Posts

    530

    0

    Posted February 24th, 2006 07:00

    Another update here; we have mapped a drive to ukwap346-bak\c$ from another box and copied data from it - there was no problem, the data copied at a good speed.
  • ble1

    6 Operator

    •

    14354 Posts

    •

    56186 Points

    95

    0

    Posted February 24th, 2006 08:00

    One more thing; check netstat -es on the client before and after the test. What is the backup server? If Solaris run snoop for connection toward the client and see what happens. What you are looking for is any kind of drop there might be.

    It would be also interesting to see if you can replicate this while nsrexecd on client is running in debug mode (remember something like few years ago where if you would run nsrexecd from cmd on wintel box things would run).
  • ble1

    6 Operator

    •

    14354 Posts

    •

    56186 Points

    530

    0

    Posted February 24th, 2006 08:00

    Did you get the access to the client? If yes do following:
    - check if you can communicate with your backup server (usual rpcinfo exercise)
    - do the ftp session or if ftpd is disabled use scp (pscp.exe from putty package is your friend)
    - try to copy something back
    - make sure this client is not using some strange server backup interface in resource
    - do the manual save in debug mode of one file (yes, I said one file :D) - if that works try directory and then...

    You didn't answer if this is for one or more client; if you get the same for more clients (under assumption those clients are not identical build) it is more likely that issue is on server/sn side of the thing. Also, don't forget switch :)