Quartz在Weblogic上的问题

Question

Quartz在Weblogic12c上部署，将quartz-all-2.1.7.jar文件放在应用下，一启动weblogic的JVM就当掉了，生成了jrockit.15586.dump文件，加大内存也没用，

不放quartz-all-2.1.7.jar就没事，可以正常启动，谁遇到过这个问题，之前用quartz1.6在weblogic11g上也没问题。

===== BEGIN DUMP =============================================================
JRockit dump produced after 0 days, 00:00:31 on Mon May 27 17:57:13 2013

**************************************************************************
* If you see this dump, please go to *
* http://download.oracle.com/docs/cd/E15289_01/go2troubleshooting.html *
* for troubleshooting information. *
**************************************************************************

Additional information is available in:
/home/wls12/Oracle/Middleware/user_projects/domains/CcDomain/jrockit.15586.dump
/home/wls12/Oracle/Middleware/user_projects/domains/CcDomain/core or core.15586

Error Message: Illegal memory access. [54]
Signal info : si_signo=11, si_code=1 si_addr=(nil)
Version : Oracle JRockit(R) R28.2.0-79-146777-1.6.0_29-20111005-1807-linux-ia32
CPU : Intel Westmere SSE SSE2 SSE3 SSSE3 SSE4.1 SSE4.2 Core Intel64
Number CPUs : 4
Tot Phys Mem : 8370712576 (7982 MB)
OS version : Red Hat Enterprise Linux Server release 5.6 (Tikanga)
Linux version 2.6.18-238.el5 (mockbuild@x86-012.build.bos.redhat.com) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-50)) #1 SMP Sun Dec 19 14:22:44 EST 2010 (x86_64)
Hypervisor : Unknown (but probably running on a hypervisor)
Thread System: Linux NPTL
LibC release : 2.5-stable
Java locking : Lazy unlocking enabled (class banning) (transfer banning)
State : JVM is running
Command Line : -Xms512m -Xmx512m -Dweblogic.Name=Server7010 -Djava.security.policy=/home/wls12/Oracle/Middleware/wlserver_12.1/server/lib/weblogic.policy -Dweblogic.security.SSL.trustedCAKeyStore=/home/wls12/Oracle/Middleware/wlserver_12.1/server/lib/cacerts -Xverify:none -Djava.endorsed.dirs=/home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/endorsed:/home/wls12/Oracle/Middleware/wlserver_12.1/endorsed -da -Dplatform.home=/home/wls12/Oracle/Middleware/wlserver_12.1 -Dwls.home=/home/wls12/Oracle/Middleware/wlserver_12.1/server -Dweblogic.home=/home/wls12/Oracle/Middleware/wlserver_12.1/server -Dweblogic.management.discover=false -Dweblogic.management.server=http://127.0.0.1:7001 -Dwlw.iterativeDev=false -Dwlw.testConsole=false -Dwlw.logErrorsToConsole=false -Dweblogic.ext.dirs=/home/wls12/Oracle/Middleware/patch_wls1211/profiles/default/sysext_manifest_classpath:/home/wls12/Oracle/Middleware/patch_ocp371/profiles/default/sysext_manifest_classpath -Dsun.java.command=weblogic.Server -Dsun.java.launcher=SUN_STANDARD weblogic.Server
Repository : /tmp/2013_05_27_17_56_47_15586
java.home : /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre
j.class.path : /home/wls12/Oracle/Middleware/patch_wls1211/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/home/wls12/Oracle/Middleware/patch_ocp371/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/lib/tools.jar:/home/wls12/Oracle/Middleware/wlserver_12.1/server/lib/weblogic_sp.jar:/home/wls12/Oracle/Middleware/wlserver_12.1/server/lib/weblogic.jar:/home/wls12/Oracle/Middleware/modules/features/weblogic.server.modules_12.1.1.0.jar:/home/wls12/Oracle/Middleware/wlserver_12.1/server/lib/webservices.jar:/home/wls12/Oracle/Middleware/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/home/wls12/Oracle/Middleware/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar:/home/wls12/Oracle/Middleware/wlserver_12.1/common/derby/lib/derbyclient.jar:/home/wls12/Oracle/Middleware/wlserver_12.1/server/lib/xqrl.jar
j.lib.path : /usr/java/packages/lib/i386:/home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/jrockit:/home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386:/home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/../lib/i386:/home/wls12/Oracle/Middleware/patch_wls1211/profiles/default/native:/home/wls12/Oracle/Middleware/patch_ocp371/profiles/default/native:/home/wls12/Oracle/Middleware/wlserver_12.1/server/native/linux/i686:/home/wls12/Oracle/Middleware/wlserver_12.1/server/native/linux/i686/oci920_8
JAVA_HOME : /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10
_JAVA_OPTIONS: <not set>
LD_LIBRARY_PATH: /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/jrockit:/home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386:/home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/../lib/i386:/home/wls12/Oracle/Middleware/patch_wls1211/profiles/default/native:/home/wls12/Oracle/Middleware/patch_ocp371/profiles/default/native:/home/wls12/Oracle/Middleware/wlserver_12.1/server/native/linux/i686:/home/wls12/Oracle/Middleware/wlserver_12.1/server/native/linux/i686/oci920_8
LD_ASSUME_KERNEL: <not set>
LD_PRELOAD : <not set>
StackOverFlow: 0 StackOverFlowErrors have occured
OutOfMemory : 0 OutOfMemoryErrors have occured
C Heap : Good; no memory allocations have failed
GC Strategy : Mode: throughput, with strategy: genparpar (basic strategy: genparpar)
GC Status : OC is not running. Last finished OC was OC#0.
: YC is not running. Last finished YC was YC#3.
YC Promotion : Last YC successfully promoted all objects
YC History : Ran 3 YCs since last OC.
Heap : 0xd6688000 - 0xf6688000 (Size: 512 MB)
Compaction : (no compaction area)
Allocation : TLA-min: 2048, TLA-preferred: 65536 TLA-waste limit: 2048
NurseryList : 0xd6688000 - 0xe6688000
KeepArea : 0xde687fe0 - 0xe2687fd0
KA Markers : [ 0xde687fe0, 0xe2687fd0 , 0xe6688000 ]
Forbidden A : (none)
Previous KA : 0xe2687fd0 - 0xe6688000
Previous FA : (none)
CompRefs : References are 32-bit.

Registers (from ThreadContext: 0xd36830fc:
eax = 00000000 ecx = ca1b0470 edx = ca1b1978 ebx = 00000000
esp = d36833e8 ebp = d36834c0 esi = 0000000a edi = ca1b1878
es = 0000002b cs = 00000023 ss = 0000002b ds = 0000002b
fs = 00000003 gs = 00000063
eip = f7cf0f74 eflags = 00000202

Loaded modules:
(* denotes the module where the exception occured)
08048000-08057313 /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/bin/java
ffffe000-ffffe7d7 /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/bin/java
00cfc000-00cfe0fb /lib/libdl.so.2
00cb6000-00ccaf17 /lib/libpthread.so.0
00b5b000-00cad363 /lib/libc.so.6
00b3c000-00b56417 /lib/ld-linux.so.2
f7c2e000-f7ef1a17 */home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/jrockit/libjvm.so
f7f70000-f7f8a7cf /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/libjrosal.so
f7c22000-f7c2c607 /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/libjrutil.so
00cd1000-00cf7a23 /lib/libm.so.6
00388000-0038eebf /lib/librt.so.1
f70f1000-f70fa39b /lib/libnss_files.so.2
f7107000-f711386b /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/libjfr.so
d5479000-d54839bb /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/libverify.so
d5454000-d5476f07 /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/libjava.so
00312000-003267a7 /lib/libnsl.so.1
d53ed000-d53f2e50 /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/native_threads/libhpi.so
d4e8f000-d4e9d6e4 /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/libzip.so
d4a27000-d4a3a150 /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/libnet.so
d4399000-d439e013 /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/liborii.so
f70ff000-f71054e4 /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/libnio.so
d35fc000-d3601a06 /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/libmanagement.so
d294c000-d2954f93 /home/wls12/Oracle/Middleware/jrockit_160_29_D1.2.0-10/jre/lib/i386/libjmapi.so
d275c000-d275fc2f /lib/libnss_dns.so.2
00243000-0025274b /lib/libresolv.so.2
f7f6c000-f7f6e2c3 /home/wls12/Oracle/Middleware/wlserver_12.1/server/native/linux/i686/libwlfileio3.so
ceed0000-ceefb36f /usr/lib/gconv/GB18030.so

Stack:
(* marks the word pointed to by the stack pointer)
d36833e8: d36834a8* d36834a8 00000003 0f4a1cd8 0f4a2ac0 0f4db2d0
d3683400: 0fcae5e0 0f4da840 00000000 00000000 00000000 00000000
d3683418: 00000009 00000009 00000004 00000008 00000016 0000000a
d3683430: 00000000 ca1b1978 ca1b19b8 ca1b14b0 cb262698 00000000

Code:
(* marks the word pointed to by the instruction pointer)
f7cf0f44: 85d81c8d 789d89d2 0fffffff 00014284 b4458900 00cc45c7
f7cf0f5c: 8b000000 5d8b0855 34428bcc 8bd4558b 428b980c b4558b2c
f7cf0f74: 8bd8048b* ffff709d c3048dff 8b844589 0289c845 ff789d8b
f7cf0f8c: 5a89ffff 91b70f04 00000106 0a81b70f 29000001 8c5589c2


Last optimized methods:
No methods optimized.

Thread:
"[ACTIVE] ExecuteThread: '0' for" id=15 idx=0x44 tid=15605 lastJavaFrame=0xd3683b30
Stack 0: start=0xd3663000, end=0xd3685000, guards=0xd3668000 (ok), forbidden=0xd3666000

Thread Stack Trace:
at dtCreateDTable+1940(dispatchtables.c:289)@0xf7cf0f74
at defineClass+210(defineclass.c:72)@0xf7cec963
at lib_define_class+67(library.c:619)@0xf7dbf094
at libDefineClass+65(library.c:670)@0xf7dbf202
at defineclass_with_source_cond+131(jvmclass.c:76)@0xf7d89314
at JVM_DefineClassWithSourceCond+174(jvmclass.c:110)@0xf7d8944f
at Java_java_lang_ClassLoader_defineClass1+501()@0xd545f606
-- Java stack --
at java/lang/ClassLoader.defineClass1(Ljava/lang/String;[BIILjava/security/ProtectionDomain;Ljava/lang/String;Z)Ljava/lang/Class;(Native Method)
at java/lang/ClassLoader.defineClassCond(ClassLoader.java:631)
at java/lang/ClassLoader.defineClass(ClassLoader.java:615)
at java/security/SecureClassLoader.defineClass(SecureClassLoader.java:141)
at weblogic/utils/classloaders/GenericClassLoader.defineClass(GenericClassLoader.java:343)
at weblogic/utils/classloaders/GenericClassLoader.findLocalClass(GenericClassLoader.java:302)
at weblogic/utils/classloaders/GenericClassLoader.findClass(GenericClassLoader.java:270)
at java/lang/ClassLoader.loadClass(ClassLoader.java:306)
at java/lang/ClassLoader.loadClass(ClassLoader.java:247)
at weblogic/utils/classloaders/GenericClassLoader.loadClass(GenericClassLoader.java:179)
at jrockit/vm/Classes.loadClassInternal(Classes.java:76)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
at jrockit/vm/Classes.forName0(Ljava/lang/String;ZLjava/lang/ClassLoader;)Ljava/lang/Class;(Native Method)
at java/lang/Class.forName0(Ljava/lang/String;ZLjava/lang/ClassLoader;)Ljava/lang/Class;(Native Method)
at java/lang/Class.forName(Class.java:247)
at weblogic/application/utils/annotation/ClassfinderClassInfos.loadClass(ClassfinderClassInfos.java:109)
at weblogic/application/utils/annotation/ClassfinderClassInfos.getHandlesImpls(ClassfinderClassInfos.java:68)
at weblogic/servlet/internal/War.getHandlesImpls(War.java:413)
at weblogic/servlet/internal/WebAppServletContext.initContainerInitializer(WebAppServletContext.java:1279)
at weblogic/servlet/internal/WebAppServletContext.initContainerInitializers(WebAppServletContext.java:1229)
at weblogic/servlet/internal/WebAppServletContext.preloadResources(WebAppServletContext.java:1726)
at weblogic/servlet/internal/WebAppServletContext.start(WebAppServletContext.java:2740)
at weblogic/servlet/internal/WebAppModule.startContexts(WebAppModule.java:1704)
at weblogic/servlet/internal/WebAppModule.start(WebAppModule.java:781)
at weblogic/application/internal/flow/ModuleStateDriver$3.next(ModuleStateDriver.java:213)
at weblogic/application/internal/flow/ModuleStateDriver$3.next(ModuleStateDriver.java:208)
at weblogic/application/utils/StateMachineDriver.nextState(StateMachineDriver.java:35)
at weblogic/application/internal/flow/ModuleStateDriver.start(ModuleStateDriver.java:70)
at weblogic/application/internal/flow/ScopedModuleDriver.start(ScopedModuleDriver.java:212)
at weblogic/application/internal/ExtensibleModuleWrapper.start(ExtensibleModuleWrapper.java:111)
at weblogic/application/internal/flow/ModuleListenerInvoker.start(ModuleListenerInvoker.java:124)
at weblogic/application/internal/flow/ModuleStateDriver$3.next(ModuleStateDriver.java:213)
at weblogic/application/internal/flow/ModuleStateDriver$3.next(ModuleStateDriver.java:208)
at weblogic/application/utils/StateMachineDriver.nextState(StateMachineDriver.java:35)
at weblogic/application/internal/flow/ModuleStateDriver.start(ModuleStateDriver.java:70)
at weblogic/application/internal/flow/StartModulesFlow.activate(StartModulesFlow.java:24)
at weblogic/application/internal/BaseDeployment$2.next(BaseDeployment.java:729)
at weblogic/application/utils/StateMachineDriver.nextState(StateMachineDriver.java:35)
at weblogic/application/internal/BaseDeployment.activate(BaseDeployment.java:258)
at weblogic/application/internal/SingleModuleDeployment.activate(SingleModuleDeployment.java:48)
at weblogic/application/internal/DeploymentStateChecker.activate(DeploymentStateChecker.java:165)
at weblogic/deploy/internal/targetserver/AppContainerInvoker.activate(AppContainerInvoker.java:79)
at weblogic/deploy/internal/targetserver/BasicDeployment.activate(BasicDeployment.java:192)
at weblogic/deploy/internal/targetserver/BasicDeployment.activateFromServerLifecycle(BasicDeployment.java:369)
at weblogic/management/deploy/internal/DeploymentAdapter$1.doActivate(DeploymentAdapter.java:51)
at weblogic/management/deploy/internal/DeploymentAdapter.activate(DeploymentAdapter.java:200)
at weblogic/management/deploy/internal/AppTransition$2.transitionApp(AppTransition.java:30)
at weblogic/management/deploy/internal/ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:240)
at weblogic/management/deploy/internal/ConfiguredDeployments.activate(ConfiguredDeployments.java:169)
at weblogic/management/deploy/internal/ConfiguredDeployments.deploy(ConfiguredDeployments.java:123)
at weblogic/management/deploy/internal/DeploymentServerService.resume(DeploymentServerService.java:186)
at weblogic/management/deploy/internal/DeploymentServerService.start(DeploymentServerService.java:94)
at weblogic/t3/srvr/SubsystemRequest.run(SubsystemRequest.java:64)
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:256)
at weblogic/work/ExecuteThread.run(ExecuteThread.java:221)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace

Memory usage report:
Total mapped 902032KB (reserved=1780KB)
- Java heap 524288KB (reserved=0KB)
- GC tables 17548KB
- Thread stacks 14692KB (#threads=29)
- Compiled code 8832KB (used=8706KB)
- Internal 776KB
- OS 144716KB
- Other 112844KB
- Java class data 77312KB (malloced=77250KB #107227 in 19269 classes)
Not tracing sites.

- Native memory tracking 1024KB (malloced=69KB #8)
Not tracing sites.


Set the env variable TRACE_ALLOC_SITES=1 or use the print_memusage switch
trace_alloc_sites=true to enable alloc site tracing.

**************************************************************************
* If you see this dump, please go to *
* http://download.oracle.com/docs/cd/E15289_01/go2troubleshooting.html *
* for troubleshooting information. *
**************************************************************************

===== END DUMP ===============================================================

Answer 1

After some research and advice from Oracle Support team we were able to start our servers without the crash only if we add the JVM flag "-Xverify:all".