Comments (27)
good92
commented on August 22, 2024
Issue Log for updateDomain version 3.2.1 running WebLogic version 12.2.1.4.0 online mode:
Issue Log for updateDomain version 3.1.0 running WebLogic version 12.2.1.4.0 online mode:
WLSDPLY-20035: updateDomain encountered an unexpected runtime exception. Please file an issue on GitHub and attach the log file and stdout. Exception: java.lang.IllegalArgumentException
vi +106 aux/weblogic-deploy/lib/python/wlsdeploy/util/tool_main.py
from weblogic-kubernetes-operator.
good92
commented on August 22, 2024
YAML 4 spaces indentation and quote around the application below appDeployments: Application: , seems to fix WLSDPLY-20035: updateDomain encountered
the indentation error is caused by example here: https://oracle.github.io/weblogic-kubernetes-operator/managing-domains/model-in-image/model-files/
now facing
WLSDPLY-05026: my-cluster-x-template is not one of the folder names allowed in model location topology:/Server/ServerTemplate.
Valid names are WebServer, SingleSignOnServices, ServerDiagnosticConfig, DefaultFileStore, ServerStart, DataSource, COM, CoherenceMemberConfig,
NetworkAccessPoint, TransactionLogJDBCStore, IIOP, ConfigurationProperty, SSL, ServerDebug, FederationServices, ExecuteQueue, Log, WebService,
JTAMigratableTarget, OverloadProtection
from weblogic-kubernetes-operator.
robertpatrick
commented on August 22, 2024
@good92 I don't understand the issue.
The WKTUI issue has nothing to do with the underlying tools--it is related to the WKTUI and WebLogic Remote Console integration. If you are not using WKTUI, this issue does not impact you.
If you are using the WDT model to submit a change to the application to point to a different WAR file, did you update the SourcePath for the application in the model file? The managed servers get their configuration at startup from the admin server so I don't understand what you mean by the "SourcePath is not updated in the managed servers". In terms of application deployment, the managed servers get a copy of the application WAR file pushed to them from the AdminServer. What is the behavior you are seeing that led you to try to start looking at config.xml on the managed servers?
I suspect that the issue might be that you added a new application WAR file with a different name and forgot to update the model SourcePath element to account for the new file name.
from weblogic-kubernetes-operator.
robertpatrick
commented on August 22, 2024
WLSDPLY-05026: my-cluster-x-template is not one of the folder names allowed in model location topology:/Server/ServerTemplate.
Valid names are WebServer, SingleSignOnServices, ServerDiagnosticConfig, DefaultFileStore, ServerStart, DataSource, COM, CoherenceMemberConfig,
NetworkAccessPoint, TransactionLogJDBCStore, IIOP, ConfigurationProperty, SSL, ServerDebug, FederationServices, ExecuteQueue, Log, WebService,
JTAMigratableTarget, OverloadProtection
I would need to see the model to comment but it looks like your model is not valid. If you are trying to specify the ServerTemplate for a particular server, it should look something like this:
topology:
Server:
myserver:
ServerTemplate: mytemplate
ServerTemplate:
mytemplate:
ListenPort: 8888
The error tells me that you probably don't have a value for the ServerTemplate attribute so WDT is trying to treat it as a folder because it looks something like this:
topology:
Server:
myserver:
ServerTemplate:
from weblogic-kubernetes-operator.
good92
commented on August 22, 2024
@robertpatrick Thanks, I did not changed the app name.
After generating a new image with WDT, I only changed the image version with the model.image.image[0] in a git repo GitOpsed by ArgoCD.
offline updates, are used with spec.image change.
The issue is that the SourcePath is correct in /aux/models/model.yaml
and in /u01/domains/dmt-application/config/config.xml, it seems not updated.
It then produce the errors:
Deployment service servlet encountered an Exception while handling the deployment datatransfer message for request id "0" from server "managed-server1".
Exception is: "java.io.IOException: Invalid source path : /u01/domains/my-application/wlsdeploy/applications/APP_OLD.war
Deployment service servlet encountered an Exception while handling the deployment datatransfer message for request id "0" from server "managed-server2".
Exception is: "java.io.IOException: Invalid source path : /u01/domains/my-application/wlsdeploy/applications/APP_OLD.war
On WLSDPLY-05026, you are right, it is another indentation issue: ServerTemplate was under Server
It would be great to have CUE YAML specifications to validate the files. https://cuelang.org/docs/integrations/yaml/
from weblogic-kubernetes-operator.
good92
commented on August 22, 2024
i see also "[SEVERE] Online update failed (the Domain resource specified 'spec.configuration.model.onlineUpdate.enabled=true').
Depending on the type of failure, the model may have an unsupported change, you may need to try an offline update, or you may need to shutdown the entire domain and then restart it."
probably due to the downsizing of the cluster size - Altering cluster size:
from weblogic-kubernetes-operator.
robertpatrick
commented on August 22, 2024
YAML 4 spaces indentation and quote around the application below appDeployments: Application: , seems to fix WLSDPLY-20035: updateDomain encountered
the indentation error is caused by example here: https://oracle.github.io/weblogic-kubernetes-operator/managing-domains/model-in-image/model-files/
@good92 I cannot reproduce this problem. I copied and pasted the model into a YAML file and ran validateModel on it.
weblogic-deploy/bin/validateModel.sh -oracle_home $MW_HOME -method lax -model_file wkomodel.yaml
...
Issue Log for validateModel version 3.2.2-SNAPSHOT running WebLogic version 12.2.1.4.0.210930 offline mode:
Total: SEVERE : 0 WARNING : 0
validateModel.sh completed successfully (exit code = 0)
from weblogic-kubernetes-operator.
robertpatrick
commented on August 22, 2024
It would be great to have CUE YAML specifications to validate the files. https://cuelang.org/docs/integrations/yaml/
@good92 Unfortunately, it is not that simple. What is allowed depends on the WLS version/patch level and whether it is online versus offline. Have you tried the modelHelp tool?
weblogic-deploy/bin/modelHelp.sh -oracle_home $MW_HOME topology:/Machine
...
Attributes and sub-folders for topology:/Machine
topology:
Machine:
'NM-1':
Address: # delimited_string (default='') -
Notes: # string +
NodeManager:
# see /Machine/NodeManager
This bean represents a machine on which servers may be booted.
A server is bound to a machine by calling to 'ServerMBean.setMachine()'.
Although it is typical that one 'MachineMBean' refers to one
physical machine and vice versa, it is possible to have a multihomed
machine represented by multiple 'MachineMBeans'. The only restriction
is that each 'MachineMBean' be configured with non-overlapping
addresses. A configuration may contain one or more of 'MachineMBeans'
which may be looked up by their logical names.
Issue Log for modelHelp version 3.2.2-SNAPSHOT running WebLogic version 12.2.1.4.0.210930 offline mode:
Total: SEVERE : 0 WARNING : 0
modelHelp.sh completed successfully (exit code = 0)
from weblogic-kubernetes-operator.
good92
commented on August 22, 2024
On YAML 4 spaces, I saw that there examples with 2 spaces indentations and 4 indentations in the documentation.
I will retry with 2 spaces indentation.
I missed the weblogic-deploy/bin/modelHelp.sh, thanks.
from weblogic-kubernetes-operator.
robertpatrick
commented on August 22, 2024
In terms of the YAML indention, the SnakeYAML parser is picky so it doesn't like it when one subsection uses 2 spaces and a peer subsection uses 4. We don't really have much control over that but if you find samples that generate parse errors, please file separate issues to let us know.
@good92 We should focus on the application problem in this issue. If there are new issues, I will ask you to create a separate issues if I feel they are not related.
offline updates, are used with spec.image change.
The issue is that the SourcePath is correct in /aux/models/model.yaml
and in /u01/domains/dmt-application/config/config.xml, it seems not updated.
It then produce the errors:
Deployment service servlet encountered an Exception while handling the deployment datatransfer message for request id "0" from server "managed-server1".
Exception is: "java.io.IOException: Invalid source path : /u01/domains/my-application/wlsdeploy/applications/APP_OLD.war
Deployment service servlet encountered an Exception while handling the deployment datatransfer message for request id "0" from server "managed-server2".
Exception is: "java.io.IOException: Invalid source path : /u01/domains/my-application/wlsdeploy/applications/APP_OLD.war
Can you provide me the steps needed (or some other way) to reproduce this issue?
from weblogic-kubernetes-operator.
good92
commented on August 22, 2024
@robertpatrick it will be really hard to have simple way to reproduce, as i am using Terraform to create the argocd and apps of apps and argocd vault plugin.
On the oracle@app-application-admin-server
/aux/weblogic-deploy/bin/modelHelp.sh -oracle_home /u01/oracle/wlserver/server/ topology:/Machine
JDK version is 1.8.0_361-b09
JAVA_HOME = /u01/jdk
CLASSPATH = /aux/weblogic-deploy/lib/weblogic-deploy-core.jar:/u01/oracle/wlserver/server//wlserver/server/lib/weblogic.jar
JAVA_PROPERTIES = -Djava.util.logging.config.class=oracle.weblogic.deploy.logging.WLSDeployLoggingConfig -Dpython.cachedir.skip=true -Dpython.console=
/u01/jdk/bin/java -cp /aux/weblogic-deploy/lib/weblogic-deploy-core.jar:/u01/oracle/wlserver/server//wlserver/server/lib/weblogic.jar -Djava.util.logging.config.class=oracle.weblogic.deploy.logging.WLSDeployLoggingConfig -Dpython.cachedir.skip=true -Dpython.console= -Dpython.path=/u01/oracle/wlserver/server//wlserver/common/wlst/modules/jython-modules.jar/Lib org.python.util.jython /aux/weblogic-deploy/lib/python/model_help.py -oracle_home /u01/oracle/wlserver/server/ topology:/Machine
Error: Could not find or load main class org.python.util.jython
i have the same issue with wko 4.0.5.
error
<Error> <Deployer> <BEA-149205> <Failed to initialize the application "APP" due to error
weblogic.management.DeploymentException: Exception occured while downloading files
at weblogic.deploy.internal.targetserver.datamanagement.AppDataUpdate.doDownload(AppDataUpdate.java:50)
at weblogic.deploy.internal.targetserver.datamanagement.DataUpdate.download(DataUpdate.java:59)
at weblogic.deploy.internal.targetserver.datamanagement.Data.prepareDataUpdate(Data.java:126)
at weblogic.deploy.internal.targetserver.BasicDeployment.prepareDataUpdate(BasicDeployment.java:907)
at weblogic.deploy.internal.targetserver.BasicDeployment.stageFilesForStatic(BasicDeployment.java:960)
Truncated. see log file for complete stacktrace
Caused By: java.io.IOException: [DeploymentService:290066]Error occurred while downloading files from Administration Server for deployment request "0".
Underlying error is: "[DeploymentService:290065]Deployment service servlet encountered an Exception while handling the deployment datatransfer message
for request id "0" from server "managed-server2". Exception is: "Invalid source path : /u01/domains/app-application/wlsdeploy/applications/APP_OLD_VERSION.war"."
at weblogic.deploy.service.datatransferhandlers.HttpDataTransferHandler.getDataAsStream(HttpDataTransferHandler.java:92)
at weblogic.deploy.service.datatransferhandlers.DataHandlerManager$RemoteDataTransferHandler.getDataAsStream(DataHandlerManager.java:175)
at weblogic.deploy.internal.targetserver.datamanagement.AppDataUpdate.doDownload(AppDataUpdate.java:46)
at weblogic.deploy.internal.targetserver.datamanagement.DataUpdate.download(DataUpdate.java:59)
at weblogic.deploy.internal.targetserver.datamanagement.Data.prepareDataUpdate(Data.java:126)
Truncated. see log file for complete stacktrace
from weblogic-kubernetes-operator.
robertpatrick
commented on August 22, 2024
@good92 Likewise, it will be virtually impossible for us to help you based on little snippets of information. My suggestion is to eliminate terraform and ArgoCD from the equation and try running the process manually. Once we identify the issue and correct it, you can add back the automation software.
from weblogic-kubernetes-operator.
robertpatrick
commented on August 22, 2024
@good92 As for the modelHelp error, notice the double slash in the classpath element for weblogic.jar you provided? This was a bug that has already been fixed. You just need to upgrade WDT to the latest version.
from weblogic-kubernetes-operator.
robertpatrick
commented on August 22, 2024
The error you are showing is a WLS error so please grab the corresponding WebLogic Server server log file so that we might get more complete information. You will need to kubectl exec into the container to grab it, assuming you haven't set the log home to an external disk.
from weblogic-kubernetes-operator.
good92
commented on August 22, 2024
export WLSDEPLOY_HOME=/aux/weblogic-deploy;
export WLSDEPLOY_PROPERTIES=/aux/models;
/aux/weblogic-deploy/bin/modelHelp.sh -oracle_home /u01/oracle/wlserver/server topology:/Machine;
JDK version is 1.8.0_361-b09
JAVA_HOME = /u01/jdk
CLASSPATH = /aux/weblogic-deploy/lib/weblogic-deploy-core.jar:/u01/oracle/wlserver/server/wlserver/server/lib/weblogic.jar
JAVA_PROPERTIES = -Djava.util.logging.config.class=oracle.weblogic.deploy.logging.WLSDeployLoggingConfig -Dpython.cachedir.skip=true -Dpython.console= /aux/models
/u01/jdk/bin/java -cp /aux/weblogic-deploy/lib/weblogic-deploy-core.jar:/u01/oracle/wlserver/server/wlserver/server/lib/weblogic.jar -Djava.util.logging.config.class=oracle.weblogic.deploy.logging.WLSDeployLoggingConfig -Dpython.cachedir.skip=true -Dpython.console= /aux/models -Dpython.path=/u01/oracle/wlserver/server/wlserver/common/wlst/modules/jython-modules.jar/Lib org.python.util.jython /aux/weblogic-deploy/lib/python/model_help.py -oracle_home /u01/oracle/wlserver/server topology:/Machine
Error: Could not find or load main class .aux.models
modelHelp.sh completed but with some issues (exit code = 1)
from weblogic-kubernetes-operator.
good92
commented on August 22, 2024
weblogic log
####<Jun 22, 2023 12:29:23,641 PM UTC> <Info> <JDBC> <app-application-managed-server1> <managed-server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'>
<<WLS Kernel>> <> <d23e0595-3851-42db-97bb-5d4b83296325-00000008> <1687436963641> <[severity-value: 64] [rid: 0] [partition-id: 0] [partition-name: DOMAIN] > <BEA-001512> <Data source Quartz has been successfully created.>
####<Jun 22, 2023 12:29:23,730 PM UTC> <Error> <Deployer> <app-application-managed-server1> <managed-server1> <[STANDBY] ExecuteThread: '1' for queue:
'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <d23e0595-3851-42db-97bb-5d4b83296325-00000008> <1687436963730> <[severity-value: 8] [rid: 0]
[partition-id: 0] [partition-name: DOMAIN] > <BEA-149205> <Failed to initialize the application "APP" due to error weblogic.management.DeploymentException: Exception occured while downloading files
at weblogic.deploy.internal.targetserver.datamanagement.AppDataUpdate.doDownload(AppDataUpdate.java:50)
at weblogic.deploy.internal.targetserver.datamanagement.DataUpdate.download(DataUpdate.java:59)
at weblogic.deploy.internal.targetserver.datamanagement.Data.prepareDataUpdate(Data.java:126)
at weblogic.deploy.internal.targetserver.BasicDeployment.prepareDataUpdate(BasicDeployment.java:907)
at weblogic.deploy.internal.targetserver.BasicDeployment.stageFilesForStatic(BasicDeployment.java:960)
at weblogic.deploy.internal.targetserver.AppDeployment.prepare(AppDeployment.java:116)
at weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdapter.java:41)
at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:193)
at weblogic.management.deploy.internal.AppTransition$1.transitionAppInternal(AppTransition.java:32)
at weblogic.management.deploy.internal.AppTransition.transitionApp(AppTransition.java:138)
at weblogic.management.deploy.internal.ConfiguredDeployments$2.doItem(ConfiguredDeployments.java:741)
at weblogic.management.deploy.internal.parallel.BucketInvoker.invoke(BucketInvoker.java:138)
at weblogic.management.deploy.internal.ConfiguredDeployments.transitionAppsParallel(ConfiguredDeployments.java:749)
at weblogic.management.deploy.internal.ConfiguredDeployments.prepare(ConfiguredDeployments.java:363)
at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:232)
at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:219)
at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:133)
at weblogic.server.AbstractServerService.postConstruct(AbstractServerService.java:76)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.glassfish.hk2.utilities.reflection.ReflectionHelper.invoke(ReflectionHelper.java:1287)
at org.jvnet.hk2.internal.ClazzCreator.postConstructMe(ClazzCreator.java:333)
at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:375)
at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:487)
at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:305)
at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:85)
at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2126)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:116)
at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:698)
at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:78)
at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:212)
at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:235)
at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:358)
at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:487)
at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:305)
at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:85)
at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2126)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:116)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:90)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.oneJob(CurrentTaskFuture.java:1237)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.run(CurrentTaskFuture.java:1168)
at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
Caused By: java.io.IOException: [DeploymentService:290066]Error occurred while downloading files from Administration Server for deployment request "0". Underlying error is:
"[DeploymentService:290065]Deployment service servlet encountered an Exception while handling the deployment datatransfer message for request id "0" from server "managed-server1".
Exception is: "Invalid source path : /u01/domains/app-application/wlsdeploy/applications/APP_OLD.war"."
at weblogic.deploy.service.datatransferhandlers.HttpDataTransferHandler.getDataAsStream(HttpDataTransferHandler.java:92)
at weblogic.deploy.service.datatransferhandlers.DataHandlerManager$RemoteDataTransferHandler.getDataAsStream(DataHandlerManager.java:175)
at weblogic.deploy.internal.targetserver.datamanagement.AppDataUpdate.doDownload(AppDataUpdate.java:46)
at weblogic.deploy.internal.targetserver.datamanagement.DataUpdate.download(DataUpdate.java:59)
at weblogic.deploy.internal.targetserver.datamanagement.Data.prepareDataUpdate(Data.java:126)
at weblogic.deploy.internal.targetserver.BasicDeployment.prepareDataUpdate(BasicDeployment.java:907)
at weblogic.deploy.internal.targetserver.BasicDeployment.stageFilesForStatic(BasicDeployment.java:960)
at weblogic.deploy.internal.targetserver.AppDeployment.prepare(AppDeployment.java:116)
at weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdapter.java:41)
at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:193)
at weblogic.management.deploy.internal.AppTransition$1.transitionAppInternal(AppTransition.java:32)
at weblogic.management.deploy.internal.AppTransition.transitionApp(AppTransition.java:138)
at weblogic.management.deploy.internal.ConfiguredDeployments$2.doItem(ConfiguredDeployments.java:741)
at weblogic.management.deploy.internal.parallel.BucketInvoker.invoke(BucketInvoker.java:138)
at weblogic.management.deploy.internal.ConfiguredDeployments.transitionAppsParallel(ConfiguredDeployments.java:749)
at weblogic.management.deploy.internal.ConfiguredDeployments.prepare(ConfiguredDeployments.java:363)
at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:232)
at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:219)
at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:133)
at weblogic.server.AbstractServerService.postConstruct(AbstractServerService.java:76)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.glassfish.hk2.utilities.reflection.ReflectionHelper.invoke(ReflectionHelper.java:1287)
at org.jvnet.hk2.internal.ClazzCreator.postConstructMe(ClazzCreator.java:333)
at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:375)
at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:487)
at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:305)
at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:85)
at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2126)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:116)
at org.jvnet.hk2.internal.ServiceLocatorImpl.getService(ServiceLocatorImpl.java:698)
at org.jvnet.hk2.internal.ThreeThirtyResolver.resolve(ThreeThirtyResolver.java:78)
at org.jvnet.hk2.internal.ClazzCreator.resolve(ClazzCreator.java:212)
at org.jvnet.hk2.internal.ClazzCreator.resolveAllDependencies(ClazzCreator.java:235)
at org.jvnet.hk2.internal.ClazzCreator.create(ClazzCreator.java:358)
at org.jvnet.hk2.internal.SystemDescriptor.create(SystemDescriptor.java:487)
at org.glassfish.hk2.runlevel.internal.AsyncRunLevelContext.findOrCreate(AsyncRunLevelContext.java:305)
at org.glassfish.hk2.runlevel.RunLevelContext.findOrCreate(RunLevelContext.java:85)
at org.jvnet.hk2.internal.Utilities.createService(Utilities.java:2126)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:116)
at org.jvnet.hk2.internal.ServiceHandleImpl.getService(ServiceHandleImpl.java:90)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.oneJob(CurrentTaskFuture.java:1237)
at org.glassfish.hk2.runlevel.internal.CurrentTaskFuture$QueueRunner.run(CurrentTaskFuture.java:1168)
at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:681)
at weblogic.invocation.ComponentInvocationContextManager._runAs(ComponentInvocationContextManager.java:352)
at weblogic.invocation.ComponentInvocationContextManager.runAs(ComponentInvocationContextManager.java:337)
at weblogic.work.LivePartitionUtility.doRunWorkUnderContext(LivePartitionUtility.java:57)
at weblogic.work.PartitionUtility.runWorkUnderContext(PartitionUtility.java:41)
at weblogic.work.SelfTuningWorkManagerImpl.runWorkUnderContext(SelfTuningWorkManagerImpl.java:655)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:420)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:360)
from weblogic-kubernetes-operator.
good92
commented on August 22, 2024
the log before sounds ok:
managed-server1 auxiliaryImageLogs]$ cat operator-aux-container1.out
@[2023-06-22T12:28:01.%NZ][auxImage.sh:64][FINE] Auxiliary Image: About to copy WDT installation files from '/auxiliary/weblogic-deploy' in container image='xxxxxxx.dkr.ecr.REGION.amazonaws.com/APP:NEW'.
@[2023-06-22T12:28:01.%NZ][auxImage.sh:64][FINE] Creating folder '/tmpAuxiliaryImage/weblogic-deploy' using command 'mkdir -m 750 -p /tmpAuxiliaryImage/weblogic-deploy'. This is the target directory for WDT installation files.
@[2023-06-22T12:28:01.%NZ][auxImage.sh:64][FINE] Auxiliary Image: About to copy WDT model files from '/auxiliary/models' in container image='xxxxxxxxx.dkr.ecr.REGION.amazonaws.com/APP:NEW'.
@[2023-06-22T12:28:01.%NZ][auxImage.sh:64][FINE] Creating folder '/tmpAuxiliaryImage/models' using command 'mkdir -m 750 -p /tmpAuxiliaryImage/models'. This is the target directory for WDT model files.
@[2023-06-22T12:28:01.%NZ][auxImage.sh:64][FINE] Auxiliary Image: Commands executed successfully.
from weblogic-kubernetes-operator.
robertpatrick
commented on August 22, 2024
Can you show us the admin server log file to see if it has anything more about why the download failed?
from weblogic-kubernetes-operator.
jshum2479
commented on August 22, 2024
@good92 Are you using online or offline update - online update to deploy/update an application is not supported. Can you check the domain resource YAML in memory to verify? (e.g. k get domain -o yaml) and disable it if it is enabled
i see also "[SEVERE] Online update failed (the Domain resource specified 'spec.configuration.model.onlineUpdate.enabled=true').
Depending on the type of failure, the model may have an unsupported change, you may need to try an offline update, or you may need to shutdown the entire domain and then restart it."
from weblogic-kubernetes-operator.
good92
commented on August 22, 2024
@jshum2479 i do not see this anymore with wko 4.0.5 and potential fixes
i am using offline updates in spec.image.
@robertpatrick The download of the auxiliary image did not failed, it is using the wrong old source path in config.xml
i am trying to introspect the introspector:
application-introspector ####<Jun 22, 2023 1:57:38 PM> <INFO> <WebLogicDeployToolingVersion> <logVersionInfo> <WLSDPLY-01750> <The WebLogic Deploy Tooling updateDomain version is 3.2.1:.18a7eda:Jun 15, 2023 20:35 UTC>
application-introspector ####<Jun 22, 2023 1:57:38 PM> <INFO> <WLSDeployLoggingConfig> <logLoggingDirectory> <WLSDPLY-01755> <The updateDomain program will write its log to directory /aux/weblogic-deploy/logs> │
application-introspector Please enter the WebLogic administrator password: ####<Jun 22, 2023 1:57:39 PM> <INFO> <ModelContext> <__copy_from_args> <WLSDPLY-01050> <WebLogic version for aliases is 12.2.1.4.0> │
application-introspector ####<Jun 22, 2023 1:57:39 PM> <INFO> <filter_helper> <_apply_filter> <WLSDPLY-20033> <Applying filter with name "update_mii_filter"> │
application-introspector ####<Jun 22, 2023 1:57:40 PM> <INFO> <cla_helper> <persist_model> <WLSDPLY-01650> <Saving the model to file /u01/domains/app-application/wlsdeploy/domain_model.json> │
application-introspector ####<Jun 22, 2023 1:57:40 PM> <INFO> <update> <__update_online> <WLSDPLY-09005> <Connecting to domain at t3://app-application-admin-server:7001 with timeout value of 120000 ...> │
application-introspector
application-introspector ####<Jun 22, 2023 1:57:47 PM> <INFO> <update> <__update_online> <WLSDPLY-09007> <Connected to domain at t3://app-application-admin-server:7001> │
application-introspector ####<Jun 22, 2023 1:57:50 PM> <INFO> <LibraryHelper> <install_domain_libraries> <WLSDPLY-12213> <The model did not specify any domain libraries to install> │
application-introspector ####<Jun 22, 2023 1:57:50 PM> <INFO> <LibraryHelper> <extract_classpath_libraries> <WLSDPLY-12218> <The archive file /aux/models/archive.zip contains no classpath libraries to install> │
application-introspector ####<Jun 22, 2023 1:57:50 PM> <INFO> <LibraryHelper> <extract_custom_files> <WLSDPLY-12567> <The archive file /aux/models/archive.zip contains no user custom files to install> │
application-introspector ####<Jun 22, 2023 1:57:50 PM> <INFO> <LibraryHelper> <install_domain_scripts> <WLSDPLY-12241> <The model did not specify any domain scripts to install> │
application-introspector ####<Jun 22, 2023 1:57:53 PM> <SEVERE> <update> <main> <WLSDPLY-20035> <updateDomain encountered an unexpected runtime exception.
Please file an issue on GitHub and attach the log file and stdout. Excepti │
application-introspector
application-introspector Issue Log for updateDomain version 3.2.1 running WebLogic version 12.2.1.4.0 online mode:
application-introspector
application-introspector SEVERE Messages:
application-introspector
application-introspector 1. WLSDPLY-20035: updateDomain encountered an unexpected runtime exception. Please file an issue on GitHub and attach the log file and stdout. Exception: java.lang.IllegalArgumentException
ps -aux > ps.log
cat /aux/weblogic-deploy/bin/updateDomain.sh
tail -f /tmp/introspector_script.out
from weblogic-kubernetes-operator.
good92
commented on August 22, 2024
application-introspector-vv8bl oracle]$ cat ps.log
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
oracle 1 0.2 0.0 119884 4112 ? Ss 15:00 0:00 /bin/bash /weblogic-operator/scripts/introspectDomain.sh
oracle 556 0.2 0.0 120016 3840 ? S 15:00 0:00 /bin/bash /weblogic-operator/scripts/introspectDomain.sh
oracle 557 0.0 0.0 109540 1724 ? S 15:00 0:00 tee /tmp/introspector_script.out
oracle 1069 0.0 0.0 119096 3328 pts/0 Ss 15:00 0:00 bash
oracle 1383 0.0 0.0 119092 3272 ? S 15:01 0:00 /bin/sh /aux/weblogic-deploy/bin/compareModel.sh -oracle_home /u01/oracle -output_dir /tmp /tmp/new_merged_model.json /tmp/decrypted_merged_model.json
oracle 1410 78.0 1.1 3888680 92592 ? Sl 15:01 0:00 /u01/jdk/bin/java -cp /aux/weblogic-deploy/lib/weblogic-deploy-core.jar:/u01/oracle/wlserver/server/lib/weblogic.jar
-Djava.util.logging.config.class=oracle.weblogic.deploy.logging.WLSDeployLoggingConfig -Dpython.cachedir.skip=true -Dpython.console=
-Dpython.path=/u01/oracle/wlserver/common/wlst/modules/jython-modules.jar/Lib org.python.util.jython /aux/weblogic-deploy/lib/python/compare_model.py
-oracle_home /u01/oracle -output_dir /tmp /tmp/new_merged_model.json /tmp/decrypted_merged_model.json
oracle 1420 0.0 0.0 156912 3760 pts/0 R+ 15:01 0:00 ps -aux
from weblogic-kubernetes-operator.
robertpatrick
commented on August 22, 2024
@good92 We need to see the WDT updateDomain.log file from the introspector pod (this will allow us to see the details of the what was happening and what generated this IllegalArgumentException). While you are in there, please grab the entire appDeployments section of the model file.
from weblogic-kubernetes-operator.
good92
commented on August 22, 2024
[oracle@APP-application-introspector-zzh8n oracle]$ cat /tmp/decrypted_merged_model.json
...
"appDeployments" : {
"Application" : {
"DMTSec" : {
"SourcePath" : "wlsdeploy/applications/APP_OLD.war",
"ModuleType" : "war",
"Target" : "mcluster-1"
}
}
},
..
oracleAPP-application-introspector-8qqx5 oracle]$ cat /tmp/diffed_model.yaml;
appDeployments:
Application:
DMTSec:
# SourcePath: 'wlsdeploy/applications/APP_OLD.war'
SourcePath: wlsdeploy/applications/APP_NEW.war
ModuleType: war
Target: mcluster-1
checker:
grep -nA 5 appDeployments /aux/models/model.10.yaml;
grep -nA 1 -B 4 'source-path' /u01/domains/dmt-application/config/config.xml
from weblogic-kubernetes-operator.
jshum2479
commented on August 22, 2024
You are using online update
application-introspector ####<Jun 22, 2023 1:57:47 PM> <__update_online> <Connected to domain at t3://app-application-admin-server:7001> │
Can you show
kubectl -n get domain -o jsonpath="{.spec.configuration.model}"
from weblogic-kubernetes-operator.
good92
commented on August 22, 2024
@jshum2479 Thanks yes, you are right.
from weblogic-kubernetes-operator.
jshum2479
commented on August 22, 2024
You should try to disabled it when deploying/updating app from your new image. A running pod will never have the bits from new image(s) until it is recycled. You should use offline update (disable the onlineUpdate) instead.
from weblogic-kubernetes-operator.
good92
commented on August 22, 2024
Many thanks it is now solved.
from weblogic-kubernetes-operator.
Related Issues (20)
- Solution for Windows: vm.max_map_count=262144 (Docker compose) HOT 1
- Weblogic Operator-3.3.8 rolling restart not happening when the pod is not in Ready State HOT 9
- Consider updating "/scaling" to reference newer blog posts about scaling
- Is it possible for the wko introspector auxiliary image config version diff/merge to use the memory instead of the /tmp? HOT 5
- project version 4.1.0-SNAPSHOT in 4.0.6 release HOT 2
- Weblogic SQLAuthenticator AuthenticationProvider delete all users and groups from DB on the creation domain step HOT 4
- Domain resource can't be created successfully on Azure kubernetes Service HOT 18
- JMS Server Health And Active Destinations Are Not Showing In Console If Target is Cluster HOT 2
- Couldn't create a domain by following steps in WLS on AKS Domain on PV sample HOT 3
- OWSM Policies - Caching HOT 6
- Fixing FAILED_NOT_RESTARTABLE HOT 2
- Weblogic operator 4.1.1 and 4.1.2 mount issues HOT 1
- wdt-and-wit-utility.sh used wrong url and filename in function install_wit HOT 2
- Helm chart value, tolerations, is not applied to webhook deployment HOT 1
- Server Start Arguments from Server Template not used in Dynamic Server instance. HOT 2
- Request for Helm Charts to Facilitate WebLogic Operator and WebLogic Monitoring Exporter Installation on OpenShift HOT 1
- ReadyApp framework does not detect failed deployment HOT 15
- kubectl scale up fails- weblogic.validating.webhook validation error HOT 3
- Add possibility to add extra Service Selector HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from weblogic-kubernetes-operator.