新しい会話を開始

Solved!

ソリューションへ移動

1 Rookie

 • 

2 メッセージ

68

2024年1月26日 08:55

VCF on VxRailのCloud BuilderのBring-up作業にて、Externalize vCenterでFailedしてしまう件について

いつもお世話になっております。

VCF on VxRailのCloud BuilderのBring-up作業についてお聞きしたいです。

VCF on VxRailのCloud BuilderにてBring-up作業実行したのですが、Externalize vCenterでFailedしてしまいます。

上記事象の原因と解決方法について何か情報お持ちでないでしょうか。

※下記コンポートにて時刻同期と名前解決については問題ありません

・VxRail Manager

・vCenter Server

・ESXi

▼バージョン情報

VCF:5.1

▼Cloud builderのログとなります

/var/log/vmware/vcf/bringup/vcf-bringup.log

2024-01-25T08:02:52.509+0000 [bringup,744cd936081c97b7,73cf] INFO  [c.v.v.c.f.p.a.i.ExternalizeVCAction,pool-3-thread-3] Inside execute {"vxrmFqdn":"vxrail-mng.test.nsx.lan","userName":"administrator@vsphere.local","password":"*****","temporaryTrustStorePath":"/opt/vmware/bringup/tmp/cacerts-98b8a1f3-205d-4104-87e8-b321ee5ba9fd","tempTrustStorePassword":"*****"}
2024-01-25T08:02:52.511+0000 [bringup,744cd936081c97b7,73cf] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] Externalizing VC for VxRail Manager vxrail-mng.test.nsx.lan using endpoint /rest/vxm/v1/vc/mode
2024-01-25T08:02:54.653+0000 [bringup,744cd936081c97b7,73cf] INFO  [c.v.v.secure.http.HttpClientService,pool-3-thread-3] Response Body: {"vc_mode":"EMBEDDED","psc_mode":"EMBEDDED"}
2024-01-25T08:02:54.653+0000 [bringup,744cd936081c97b7,73cf] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] VxRail Manager response status: 200
2024-01-25T08:02:54.653+0000 [bringup,744cd936081c97b7,73cf] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] Parsing VxRail Manager response /rest/vxm/v1/vc/mode for request {"vc_mode":"EMBEDDED","psc_mode":"EMBEDDED"}...
2024-01-25T08:02:54.653+0000 [bringup,744cd936081c97b7,73cf] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] VC mode EMBEDDED
2024-01-25T08:02:54.653+0000 [bringup,744cd936081c97b7,73cf] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] Value of VC Mode EMBEDDED
2024-01-25T08:02:54.656+0000 [bringup,744cd936081c97b7,73cf] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] Externalizing VC for VxRail Manager vxrail-mng.test.nsx.lan using endpoint /rest/vxm/v1/vc/mode
2024-01-25T08:02:54.656+0000 [bringup,744cd936081c97b7,73cf] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] Payload to externalize vc {"psc_mode":"EMBEDDED","vc_admin_user":{"username":"administrator@vsphere.local","password":"*****"},"vc_mode":"EXTERNAL"}
2024-01-25T08:03:00.650+0000 [bringup,744cd936081c97b7,73cf] INFO  [c.v.v.secure.http.HttpClientService,pool-3-thread-3] Response Body: {"request_id":"SBI_7"}
2024-01-25T08:03:00.650+0000 [bringup,744cd936081c97b7,73cf] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] Value of API /rest/vxm/v1/vc/mode response {status-code=202, response-message={"request_id":"SBI_7"}}
2024-01-25T08:03:00.650+0000 [bringup,744cd936081c97b7,73cf] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] VxRail Manager response status: 202
2024-01-25T08:03:00.650+0000 [bringup,744cd936081c97b7,73cf] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] VxRail Manager response message: {"request_id":"SBI_7"}
2024-01-25T08:13:00.652+0000 [bringup,744cd936081c97b7,73cf] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] Querying VxRail Manager request SBI_7 status using endpoint /rest/vxm/v1/requests/SBI_7
2024-01-25T08:13:00.681+0000 [bringup,744cd936081c97b7,73cf] ERROR [c.v.e.s.o.model.error.ErrorFactory,pool-3-thread-3] [57LNO9] EXTERNALIZE_VC_FAILED Externalize Management VC Failed.
com.vmware.evo.sddc.orchestrator.exceptions.OrchTaskException: Externalize Management VC Failed.
 at com.vmware.vcf.common.fsm.plugins.action.impl.ExternalizeVCAction.execute(ExternalizeVCAction.java:70)
 at com.vmware.vcf.common.fsm.plugins.action.impl.ExternalizeVCAction.execute(ExternalizeVCAction.java:24)
 at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionState.invoke(FsmActionState.java:62)
 at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionPlugin.invoke(FsmActionPlugin.java:159)
 at com.vmware.evo.sddc.orchestrator.platform.action.FsmActionPlugin.invoke(FsmActionPlugin.java:144)
 at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.invokeMethod(ProcessingTaskSubscriber.java:400)
 at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.processTask(ProcessingTaskSubscriber.java:520)
 at com.vmware.evo.sddc.orchestrator.core.ProcessingTaskSubscriber.accept(ProcessingTaskSubscriber.java:124)
 at jdk.internal.reflect.GeneratedMethodAccessor149.invoke(Unknown Source)
 at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 at java.base/java.lang.reflect.Method.invoke(Method.java:568)
 at com.google.common.eventbus.Subscriber.invokeSubscriberMethod(Subscriber.java:85)
 at com.google.common.eventbus.Subscriber.lambda$dispatchEvent$0(Subscriber.java:71)
 at org.springframework.cloud.sleuth.instrument.async.TraceRunnable.run(TraceRunnable.java:64)
 at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
 at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
 at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: com.vmware.evo.sddc.common.vxrail.error.VxRailManagerException: Unable to fetch VC mode
 at com.vmware.evo.sddc.common.vxrail.VxRailManagerService.externalizeVc(VxRailManagerService.java:2794)
 at com.vmware.vcf.common.fsm.plugins.action.impl.ExternalizeVCAction.execute(ExternalizeVCAction.java:63)
 ... 16 common frames omitted
Caused by: com.vmware.evo.sddc.common.vxrail.error.VxRailManagerException: Unable to update VC mode
 at com.vmware.evo.sddc.common.vxrail.VxRailManagerService.externalizeVc(VxRailManagerService.java:2782)
 ... 17 common frames omitted
Caused by: com.vmware.evo.sddc.common.vxrail.error.VxRailManagerException: Error in executing VxRail async request SBI_7
 at com.vmware.evo.sddc.common.vxrail.VxRailManagerService.waitForAsyncRequestCompletion(VxRailManagerService.java:2728)
 at com.vmware.evo.sddc.common.vxrail.VxRailManagerService.externalizeVc(VxRailManagerService.java:2778)
 ... 17 common frames omitted
Caused by: javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
 at java.base/sun.security.ssl.Alert.createSSLException(Alert.java:131)
 at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:371)
 at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:314)
 at java.base/sun.security.ssl.TransportContext.fatal(TransportContext.java:309)
 at java.base/sun.security.ssl.CertificateMessage$T13CertificateConsumer.checkServerCerts(CertificateMessage.java:1357)
 at java.base/sun.security.ssl.CertificateMessage$T13CertificateConsumer.onConsumeCertificate(CertificateMessage.java:1232)
 at java.base/sun.security.ssl.CertificateMessage$T13CertificateConsumer.consume(CertificateMessage.java:1175)
 at java.base/sun.security.ssl.SSLHandshake.consume(SSLHandshake.java:396)
 at java.base/sun.security.ssl.HandshakeContext.dispatch(HandshakeContext.java:480)
 at java.base/sun.security.ssl.HandshakeContext.dispatch(HandshakeContext.java:458)
 at java.base/sun.security.ssl.TransportContext.dispatch(TransportContext.java:201)
 at java.base/sun.security.ssl.SSLTransport.decode(SSLTransport.java:172)
 at java.base/sun.security.ssl.SSLSocketImpl.decode(SSLSocketImpl.java:1505)
 at java.base/sun.security.ssl.SSLSocketImpl.readHandshakeRecord(SSLSocketImpl.java:1420)
 at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:455)
 at java.base/sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:426)
 at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:436)
 at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:384)
 at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
 at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:376)
 at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:393)
 at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
 at brave.httpclient.TracingMainExec.execute(TracingMainExec.java:65)
 at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
 at brave.httpclient.TracingProtocolExec.execute(TracingProtocolExec.java:66)
 at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
 at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
 at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
 at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
 at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108)
 at com.vmware.vcf.secure.http.HttpClientService.getHTTPResponse(HttpClientService.java:1073)
 at com.vmware.vcf.secure.http.HttpClientService.getHTTPResponseStatusAndMessage(HttpClientService.java:796)
 at com.vmware.vcf.secure.http.HttpClientService.getForResponseCodeAndMessage(HttpClientService.java:329)
 at com.vmware.vcf.secure.http.HttpClientService.getForResponseCodeAndMessage(HttpClientService.java:314)
 at com.vmware.evo.sddc.common.vxrail.VxRailManagerService.waitForAsyncRequestCompletion(VxRailManagerService.java:2664)
 ... 18 common frames omitted
Caused by: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
 at java.base/sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:439)
 at java.base/sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:306)
 at java.base/sun.security.validator.Validator.validate(Validator.java:264)
 at java.base/sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:242)
 at java.base/sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:113)
 at com.vmware.vcf.secure.truststore.DynamicTrustManager.checkServerTrustedRecheck(DynamicTrustManager.java:75)
 at com.vmware.vcf.secure.truststore.DynamicTrustManager.checkServerTrusted(DynamicTrustManager.java:53)
 at java.base/sun.security.ssl.AbstractTrustManagerWrapper.checkServerTrusted(SSLContextImpl.java:1441)
 at java.base/sun.security.ssl.CertificateMessage$T13CertificateConsumer.checkServerCerts(CertificateMessage.java:1341)
 ... 48 common frames omitted
Caused by: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
 at java.base/sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:141)
 at java.base/sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:126)
 at java.base/java.security.cert.CertPathBuilder.build(CertPathBuilder.java:297)
 at java.base/sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:434)
 ... 56 common frames omitted
2024-01-25T08:13:01.274+0000 [bringup,744cd936081c97b7,ba19] INFO  [c.v.v.c.f.p.a.i.ExternalizeVCAction,pool-3-thread-3] Inside execute {"vxrmFqdn":"vxrail-mng.test.nsx.lan","userName":"administrator@vsphere.local","password":"*****","temporaryTrustStorePath":"/opt/vmware/bringup/tmp/cacerts-98b8a1f3-205d-4104-87e8-b321ee5ba9fd","tempTrustStorePassword":"*****"}
2024-01-25T08:13:01.279+0000 [bringup,744cd936081c97b7,ba19] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] Externalizing VC for VxRail Manager vxrail-mng.test.nsx.lan using endpoint /rest/vxm/v1/vc/mode
2024-01-25T08:13:03.380+0000 [bringup,744cd936081c97b7,ba19] INFO  [c.v.v.secure.http.HttpClientService,pool-3-thread-3] Response Body: {"vc_mode":"EMBEDDED","psc_mode":"EMBEDDED"}
2024-01-25T08:13:03.380+0000 [bringup,744cd936081c97b7,ba19] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] VxRail Manager response status: 200
2024-01-25T08:13:03.380+0000 [bringup,744cd936081c97b7,ba19] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] Parsing VxRail Manager response /rest/vxm/v1/vc/mode for request {"vc_mode":"EMBEDDED","psc_mode":"EMBEDDED"}...
2024-01-25T08:13:03.380+0000 [bringup,744cd936081c97b7,ba19] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] VC mode EMBEDDED
2024-01-25T08:13:03.380+0000 [bringup,744cd936081c97b7,ba19] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] Value of VC Mode EMBEDDED
2024-01-25T08:13:03.383+0000 [bringup,744cd936081c97b7,ba19] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] Externalizing VC for VxRail Manager vxrail-mng.test.nsx.lan using endpoint /rest/vxm/v1/vc/mode
2024-01-25T08:13:03.383+0000 [bringup,744cd936081c97b7,ba19] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] Payload to externalize vc {"psc_mode":"EMBEDDED","vc_admin_user":{"username":"administrator@vsphere.local","password":"*****"},"vc_mode":"EXTERNAL"}
2024-01-25T08:13:09.671+0000 [bringup,744cd936081c97b7,ba19] INFO  [c.v.v.secure.http.HttpClientService,pool-3-thread-3] Response Body: {"request_id":"SBI_8"}
2024-01-25T08:13:09.671+0000 [bringup,744cd936081c97b7,ba19] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] Value of API /rest/vxm/v1/vc/mode response {status-code=202, response-message={"request_id":"SBI_8"}}
2024-01-25T08:13:09.671+0000 [bringup,744cd936081c97b7,ba19] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] VxRail Manager response status: 202
2024-01-25T08:13:09.671+0000 [bringup,744cd936081c97b7,ba19] INFO  [c.v.e.s.c.v.VxRailManagerService,pool-3-thread-3] VxRail Manager response message: {"request_id":"SBI_8"}
root@cloud-builder [ /var/log/vmware/vcf/bringup ]# 

4 Operator

 • 

1.7K メッセージ

2024年1月26日 10:24

ログを見る限り、証明書のインポートを実施した後に、VxRail APIでvCenerのExternalizeをしているように見受けられました。

VxRail APIは /rest/vxm/v1/vc/mode のようです。このAPIのGet/PatchメソッドでそれぞれVCモードの確認と変更を実施していると想定されます。

VCモード変更のRequestIDとして、"request_id":"SBI_7" が返されていますので、VxRail側でこのRequestIDに一致するジョブの詳細を見れば原因がわかるかもしれません。

そのジョブが失敗していれば、失敗した理由をVxRail観点で調査が必要です。

ジョブが成功してれば、なぜCloud Builderがエラー終了したのかをCloud Builder観点での調査が必要です。

1 Rookie

 • 

2 メッセージ

2024年1月26日 11:30

@DELL-Naoyuki K​ 

回答ありがとうございます。

こちらの問題ですが

vCenterの

 [クラスタ] > [監視] > [vSAN] > [Skyline Health] > [vSAN HCL DB の更新状態] 

でエラーになっており下記kbにそってエラー解除した後にRetryしたところ

bringup実行完了しました。

情報いただきありがとうございました。

https://kb.vmware.com/s/article/54945?lang=ja

イベントは見つかりませんでした!

Top