宁夏挂帐帐号缴费查询导致中间件服务mainserver挂死问题分析报告

DocumentTitleSecurityLevel2020-01-03HUAWEIConfidentialPage1,Total10宁夏挂帐帐号缴费查询导致中间件服务mainserver挂死问题分析报告1业务流程介绍本问题中的挂帐帐号缴费查询，是通过前台“营业缴费-收费”界面进行受理，输入挂帐帐号下挂着的任一服务号码，点击查询按钮后，会调用后台tuxedo服务mainserver进行处理，mainserver会根据前台输入的服务号码，查询用户所挂的挂帐帐号，然后循环调用tuxedo服务AccSrv查询挂帐帐号下挂的每个用户的费用，最终将挂帐帐号下明细的用户费用列表返回给前台2mainserver挂死问题重现过程测试前重启中间件，并停止所有对中间件的使用，从前台界面提交查询，观察后台服务状态，情况如下：2.1mainserver运行状态记录（从服务被调用前，到挂死）tuxedo:p595_2:/tuxedodateThuOct1509:46:25BEIST2009tuxedo:p595_2:/tuxedotuxedo:p595_2:/tuxedotmadmintmadmin-Copyright(c)1996-1999BEASystems,Inc.Portions*Copyright1986-1997RSADataSecurity,Inc.AllRightsReserved.DistributedunderlicensebyBEASystems,Inc.Tuxedoisaregisteredtrademark.TMADMIN_CAT:199:WARN:Cannotbecomeadministrator.Limitedsetofcommandsavailable.psr-qq_recs952DocumentTitleSecurityLevel2020-01-03HUAWEIConfidentialPage2,Total10psr-qTUXINV1ProgNameQueueNameGrpNameIDRqDoneLoadDoneCurrentService-----------------------------------------------------------mainserverq_recs952G_YZ728150(IDLE)mainserverq_recs952G_YZ719150(IDLE)mainserverq_recs952G_YZ718150(IDLE)mainserverq_recs952G_YZ717150(IDLE)mainserverq_recs952G_YZ716150(IDLE)mainserverq_recs952G_YZ715150(IDLE)mainserverq_recs952G_YZ727150(IDLE)mainserverq_recs952G_YZ726150(IDLE)mainserverq_recs952G_YZ725150(IDLE)mainserverq_recs952G_YZ724150(IDLE)mainserverq_recs952G_YZ723150(IDLE)mainserverq_recs952G_YZ722150(IDLE)mainserverq_recs952G_YZ721150(IDLE)mainserverq_recs952G_YZ729150(IDLE)mainserverq_recs952G_YZ720150RECS952psr–i720ProgNameQueueNameGrpNameIDRqDoneLoadDoneCurrentService-----------------------------------------------------------mainserverq_recs952G_YZ720150RECS952psr–i720ProgNameQueueNameGrpNameIDRqDoneLoadDoneCurrentService-----------------------------------------------------------mainserverq_recs952G_YZ720150RECS952psr–i720ProgNameQueueNameGrpNameIDRqDoneLoadDoneCurrentService-----------------------------------------------------------mainserverq_recs952G_YZ720150RECS952psr–i720ProgNameQueueNameGrpNameIDRqDoneLoadDoneCurrentDocumentTitleSecurityLevel2020-01-03HUAWEIConfidentialPage3,Total10Service-----------------------------------------------------------mainserverq_recs952G_YZ720150RECS952psr–i720ProgNameQueueNameGrpNameIDRqDoneLoadDoneCurrentService-----------------------------------------------------------mainserverq_recs952G_YZ720150RECS952qtuxedo:p595_2:/tuxedodateThuOct1509:48:17BEIST20092.2AccSrv运行状态记录（从服务被调用前，到mainserver挂死后）tuxedo:p595_2:/tuxedodateThuOct1509:47:32BEIST2009tuxedo:p595_2:/tuxedoechopsr–q_accsrv|tmadmin|grep–vIDLEechopsr–r|tmadmin|grep–vIDLEtmadmin-Copyright(c)1996-1999BEASystems,Inc.Portions*Copyright1986-1997RSADataSecurity,Inc.AllRightsReserved.DistributedunderlicensebyBEASystems,Inc.Tuxedoisaregisteredtrademark.TMADMIN_CAT:199:WARN:Cannotbecomeadministrator.Limitedsetofcommandsavailable.ProgNameQueueNameGrpNameIDRqDoneLoadDoneCurrentService-----------------------------------------------------------AccSrvq_accsrvG_JF12162100ACCSERVERtuxedo:p595_2:/tuxedoechopsr–q_accsrv|tmadmin|grep–vIDLEtmadmin-Copyright(c)1996-1999BEASystems,Inc.Portions*Copyright1986-1997RSADataSecurity,Inc.AllRightsReserved.DistributedunderlicensebyBEASystems,Inc.Tuxedoisaregisteredtrademark.TMADMIN_CAT:199:WARN:Cannotbecomeadministrator.Limitedsetofcommandsavailable.DocumentTitleSecurityLevel2020-01-03HUAWEIConfidentialPage4,Total10ProgNameQueueNameGrpNameIDRqDoneLoadDoneCurrentService-----------------------------------------------------------AccSrvq_accsrvG_JF12162100ACCSERVERtuxedo:p595_2:/tuxedoechopsr–q_accsrv|tmadmin|grep–vIDLEtmadmin-Copyright(c)1996-1999BEASystems,Inc.Portions*Copyright1986-1997RSADataSecurity,Inc.AllRightsReserved.DistributedunderlicensebyBEASystems,Inc.Tuxedoisaregisteredtrademark.TMADMIN_CAT:199:WARN:Cannotbecomeadministrator.Limitedsetofcommandsavailable.ProgNameQueueNameGrpNameIDRqDoneLoadDoneCurrentService-----------------------------------------------------------AccSrvq_accsrvG_JF12172100ACCSERVERtuxedo:p595_2:/tuxedoechopsr–q_accsrv|tmadmin|grep–vIDLEtmadmin-Copyright(c)1996-1999BEASystems,Inc.Portions*Copyright1986-1997RSADataSecurity,Inc.AllRightsReserved.DistributedunderlicensebyBEASystems,Inc.Tuxedoisaregisteredtrademark.TMADMIN_CAT:199:WARN:Cannotbecomeadministrator.Limitedsetofcommandsavailable.ProgNameQueueNameGrpNameIDRqDoneLoadDoneCurrentService-----------------------------------------------------------AccSrvq_accsrvG_JF12302100ACCSERVERtuxedo:p595_2:/tuxedoechopsr–q_accsrv|tmadmin|grep–vIDLEtmadmin-Copyright(c)1996-1999BEASystems,Inc.Portions*Copyright1986-1997RSADataSecurity,Inc.AllRightsReserved.DistributedunderlicensebyBEASystems,Inc.Tuxedoisaregisteredtrademark.TMADMIN_CAT:199:WARN:Cannotbecomeadministrator.Limitedsetofcommandsavailable.DocumentTitleSecurityLevel2020-01-03HUAWEIConfidentialPage5,Total10ProgNameQueueNameGrpNameIDRqDoneLoadDoneCurrentService-----------------------------------------------------------tuxedo:p595_2:/tuxedodateThuOct1509:48:11BEIST2009tuxedo:p595_2:/tuxedo这时查看正在“忙”的服务：tu