Home | Site Map | Cisco How ToNet How To | Wireless |Search | Forums | Services | Donations | Careers | About Us | Contact Us|

Exchange 2010 Replication Service down

Network Sharing , TCP/IP, Internet, Wireless, Exchange, IIS, ISA and Print

Exchange 2010 Replication Service down

Postby guest » Thu Mar 10, 2011 4:08 pm

We have two Windows 2008 R2 servers running 4 excahnge 2010 servers on Hyper-V. They are exch-mail01, exch-mail02, exch-cas1 and exch-cas02. We can't ping and access the exch-mail02 using RDC. I can access the Exch-mail02 from Hyper-V and I can ping other servers from exch-mail02. There are a log evet logs as listed. How do you troubvleshoot this issue?


Log Name: Application

Source: MSExchange Store Driver

Event ID: 1020

Task Category: MSExchangeStoreDriver

Level: Error

Keywords: Classic

User: N/A

Computer: EXCH-CAS02.chicagotech.net

Description:

The store driver couldn't deliver the public folder replication message "Folder Content (PublicFolderDatabase1943033573@chicagotech.net)" because the following error occurred: Cannot open mailbox /o=chicagotech/ou=Exchange Administrative Group (FYDIBOHF23SPDLT)/cn=Configuration/cn=Servers/cn=EXCH-MAIL01/cn=Microsoft System Attendant..





Log Name: Application

Source: MSExchange Mailbox Replication

Event ID: 1007

Task Category: Service

Level: Warning

Keywords: Classic

User: N/A

Computer: EXCH-CAS02.chicagotech.net

Description:

The Mailbox Replication service was unable to determine the set of active mailbox databases on a mailbox server.

Mailbox server: EXCH-MAIL02.chicagotech.net

Error: MapiExceptionNetworkError: Unable to make admin interface connection to server. (hr=0x80040115, ec=-2147221227)

Diagnostic context:

......

Lid: 15000 dwParam: 0x6BA Msg: EEInfo: prm[1]: Pointer val: 0x0000000000000000

Lid: 15000 dwParam: 0x6BA Msg: EEInfo: prm[2]: Pointer val: 0xD605000A00000000

Lid: 16280 dwParam: 0x6BA Msg: EEInfo: ComputerName: n/a

Lid: 8600 dwParam: 0x6BA Msg: EEInfo: ProcessID: 2588

Lid: 12696 dwParam: 0x6BA Msg: EEInfo: Generation Time: 2010-12-17 05:00:31:731

Lid: 10648 dwParam: 0x6BA Msg: EEInfo: Generating component: 18

Lid: 14744 dwParam: 0x6BA Msg: EEInfo: Status: 10060

Lid: 9624 dwParam: 0x6BA Msg: EEInfo: Detection location: 318

Lid: 13720 dwParam: 0x6BA Msg: EEInfo: Flags: 0

Lid: 11672 dwParam: 0x6BA Msg: EEInfo: NumberOfParameters: 0

Lid: 24060 StoreEc: 0x80040115

Lid: 23746

Lid: 31938 StoreEc: 0x80040115

Lid: 19650

Lid: 27842 StoreEc: 0x80040115

Lid: 20866

Lid: 29058 StoreEc: 0x80040115



Log Name: System

Source: VMSMP

Date: 12/16/2010 5:36:13 PM

Event ID: 28

Task Category: None

Level: Warning

Keywords: Classic

User: N/A

Computer: HPV-DELL02.chicagotech.net

Description:

Port '8683DA1C-2A40-4D65-B7E4-D3C88ACE2244' was prevented from using MAC address '00-15-5D-00-93-00' because it is pinned to port 'E6DF37EC-36CC-4641-90F0-85D3FF51B2AC'.



Log Name: System

Source: VMSMP

Date: 12/16/2010 5:36:13 PM

Event ID: 28

Task Category: None

Level: Warning

Keywords: Classic

User: N/A

Computer: HPV-DELL02.chicagotech.net

Description:

Port '8683DA1C-2A40-4D65-B7E4-D3C88ACE2244' was prevented from using MAC address '00-15-5D-00-93-00' because it is pinned to port 'E6DF37EC-36CC-4641-90F0-85D3FF51B2AC'.





Log Name: System

Source: VMSMP

Date: 12/16/2010 5:36:13 PM

Event ID: 28

Task Category: None

Level: Warning

Keywords: Classic

User: N/A

Computer: HPV-DELL02.chicagotech.net

Description:

Port '8683DA1C-2A40-4D65-B7E4-D3C88ACE2244' was prevented from using MAC address '00-15-5D-00-93-00' because it is pinned to port 'E6DF37EC-36CC-4641-90F0-85D3FF51B2AC'.




--------------------------------------------------------------------------------
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 9690
Joined: Mon Nov 27, 2006 1:10 pm

Re: Exchange 2010 Replication Service down

Postby guest » Thu Mar 10, 2011 4:08 pm

I noticed all tests in your description all occurred from the CAS server, and the errors all related to the network connectivity is unavailable to one of mailbox servers. However, the events you pasted is not enough for troubleshooting, so except below questions, I need you help to collect more information for further investigating.



1. Does another node EXCH-MAIL02 work properly right now? For example, user's mailboxes in EXCH-MAIL02 are accessible from OWA or outlook.

2. What's the HPV-DELL02 server? Is your domain controller?

3. Are you able to ping each other from the DAG nodes (exch-mail01 and exch-mail02), which include public IP and private IP?

4. Can you verify the Hyper-V network configurations are correct from the both nodes? Some cases indicated the network configuration from Hyper-V may cause this issue.



In addition, below entries are the requested logs for further investigating, please take your time to perform these steps and upload them to me.



1. Cluster verifying:

a. Login to your exch-mail01 server, and open the Failover Cluster Manager from the Administrative Tools.

b. Right-click the cluster FQDN name and select Validate This Cluster…, follow the wizard to perform a full scanning (Run all tests option).

c. After scanning, review the report for any network related errors. Meanwhile, save the report and upload to me.

2. Exchange BPA scanning:

a. Login to one of your exchange servers, for example CAS server, open the Exchange BPA from the Toolboxes.

b. Follow the wizard to perform a Health Check, and a Connectivity Test. Those two checks should be done with two separate steps, after that, save two reports from the BPA as .XML files, and upload to me.

3. Cluster log:

a. Login to one of mailbox servers, and open an elevated Command Prompt, type "cluster log /g", and a clusterl.log file will be generated and stored in the %windir%\Cluster\Reports directory on each node of the cluster.

b. Collect the %windir%\Cluster\Reports folder from both nodes, and upload to me.
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 9690
Joined: Mon Nov 27, 2006 1:10 pm

Re: Exchange 2010 Replication Service down

Postby guest » Thu Mar 10, 2011 4:09 pm

1. Does another node EXCH-MAIL02 work properly right now? For example, user's mailboxes in EXCH-MAIL02 are accessible from OWA or outlook - Exch-mail02 is the promatic computer, no one can access. It is srorage exchange server not CAS server. We access OWA via exch-cas01 or exch-cas02 not exch-mail01 or exch-mail02.

2. What's the HPV-DELL02 server? Is your domain controller? - HPV-Dell02 works fine without any errors. It is not DC.

3. Are you able to ping each other from the DAG nodes (exch-mail01 and exch-mail02), which include public IP and private IP? - As mentioned, no computers including exch-mail01 can ping exch-mail02. exch-mail02 can ping exch-mail01, but reply back with IPv6 address. Exch-mail02 can't ping any computers using IPv4 address

4. Can you verify the Hyper-V network configurations are correct from the both nodes? Some cases indicated the network configuration from Hyper-V may cause this issue. - I think this is the problem. Perhaps it is NIC teaming issue. But how do you troubelshoot it.


I will send those logs to you later.


--------------------------------------------------------------------------------
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 9690
Joined: Mon Nov 27, 2006 1:10 pm

Re: Exchange 2010 Replication Service down

Postby guest » Thu Mar 10, 2011 4:10 pm

Sorry for the delay due to the weekend.



I understand the Exch-mail02 currently is inaccessible, but what I first question is test the connectivity from the CAS server, in order to test the mailbox who stored in the exch-mail02. For example, user02's mailbox is stored in exch-mail02, does user02 is able to access his mailbox from Outlook or OWA?



Question 2, generally you will have two IP addresses on both nodes, public IP and private IP. According to your description I only saw the public IP is inaccessible, so I was thinking if the private IP address is accessible. In addition, you mentioned the exch-mail02 can ping exch-mail01, but reply back with IPv6 address, so do you configure IPv6 infrastructure? If not, you should not receive any IPv6 reply with PING command.



Regarding the Hyper-V issue, if I am right, I suspect the network adapter configuration is incorrect, or the IP info is messed up from the guests at least. From the cluster.log I addressed below errors:



a7c:afc.09/30[11:23:37.286](000000) INFO [CS] Reporting to SCM that cluster service has started.

a7c:a78.09/30[11:23:38.598](000000) DBG [NETFTAPI] received NsiParameterNotification for fe80::983d:dc07:40ec:db02 (IpDadStatePreferred )

a7c:a78.09/30[11:23:40.598](000000) WARN [NETFTAPI] Failed to query parameters for 169.254.219.2 (status 80070490)

a7c:a78.09/30[11:23:40.614](000000) WARN [NETFTAPI] Failed to query parameters for 169.254.219.2 (status 80070490)

a7c:a78.09/30[11:23:40.614](000000) DBG [NETFTAPI] received NsiParameterNotification for 169.254.1.24 (IpDadStatePreferred )

a7c:14c.09/30[11:23:43.286](000000) INFO [GEM] Node 1: EnterRepairStage1: Gem agent for node 1

a7c:8ac.09/30[11:23:43.567](000000) INFO [GEM] Node 1: EnterRepairStage2: Gem agent for node 1

5e8:cdc.09/30[11:21:09.343](000000) INFO [RCM] rcm::RcmGroup::Offline: deferring offline of quorum resource 'File Share Witness (\\cbgarc.chicagobotanic.org\Exch-DAG.chicagobotanic.org)' until all other resources are offline.
5e8:1b8.09/30[11:21:09.358](000000) WARN [RCM] rcm::RcmApi::GroupControl: Call has failed with error 5073 and API calls on this node are disabled due to RCM is shutting down. Stopping to chase the owner.
5e8:1b8.09/30[11:21:09.374](000000) WARN [NETFTAPI] Failed to query parameters for 10.0.6.10 (status 80070490)

e90:5c0.09/30[11:21:09.374](000000) ERR [RES] IP Address <Cluster IP Address>: WorkerThread: GetClusterNotify failed with status 6.

5e8:46c.09/30[11:21:09.405](000000) INFO [RCM] rcm::RcmGroup::DeferredQuorumOffline: Quorum resource can now be offlined. Rest of group is offline.

5e8:f58.09/30[11:21:10.078](000000) INFO [CS] Service Stopped...

e1c:e30.09/30[11:23:46.176](000000) ERR [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'

a7c:a78.09/30[11:23:46.176](000000) WARN [RCM] Failed to load restype 'MSMQ': error 21.



The verification tried to contact the IP address 169.254.219.2, which is an invalid IP address. However I have not receive the MPS report so far, and currently you can follow below action/plan for further troubleshooting.



1. If the exch-mail02 unable to get internet access, try to access the virtual IP address from Hyper-V host, and copy the requested logs to the host.

2. Compare the network configuration with exch-mail01, which I believe is correct. There are few steps need to do, from the Hyper-V's setting dialog box, check the Network Adapter part. Then go to guest itself, and open the Network and Sharing Center, check both private and public NIC's configuration are all correct.

3. Review the exchange server 2010 deployment document to ensure the network configuration is all correct.



If this issue already caused business impact, I'd like to suggest you drop a call to our incident support, so that a dedicated Support Professional can assist with this request, they can remotely connect to your server to check the settings more timely and effectively. For more detail on Professional Support Options and incident submission methods, please visit the following web site:

http://support.microsoft.com/?LN=en-us& ... erprophone.
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 9690
Joined: Mon Nov 27, 2006 1:10 pm

Re: Exchange 2010 Replication Service down

Postby guest » Thu Mar 10, 2011 4:10 pm

Sorry for the delay. It must be the network configuration issue. I found the exch-mail02 NIC was disable and I could not enable it until I reboot it. Today we had the same issue again. I will double check the configuration and may post back.
--------------------------------------------------------------------------------
Tablet and Smartphone Setup Guide
http://www.quicksetupguide.com

Troubleshooting Vista Wireless
http://chicagotech.net/
guest
 
Posts: 9690
Joined: Mon Nov 27, 2006 1:10 pm


Return to Networking

Your Ad Here

Who is online

Users browsing this forum: Google [Bot], Yahoo [Bot] and 3 guests