非线性最优化计算方法与算法

毕业论文题目非线性最优化计算方法与算法学院数学科学学院专业信息与计算科学班级计算1201学生陶红学号20120921104指导教师邢顺来二〇一六年五月二十五日济南大学毕业论文-I-摘要非线性规划问题是一般形式的非线性最优化问题。本文针对非线性规划的最优化问题进行方法和算法分析。传统的求解非线性规划的方法有最速下降法、牛顿法、可行方向法、函数逼近法、信赖域法，近来研究发现了更多的求解非线性规划问题的方法如遗传算法、粒子群算法。本文对非线性规划分别从约束规划和无约束规划两个方面进行理论分析。利用最速下降法和牛顿法两种典型算法求解无约束条件非线性规划问题，通过MATLAB程序求解最优值，探讨其收敛性和稳定性。另外给出了阻尼牛顿法，探讨其算法的收敛性和稳定性，求解无约束非线性规划比牛顿法的精确度更高，收敛速度更快。惩罚函数是经典的求解约束非线性的方法，本文采用以惩罚函数法为核心的遗传算法求解有约束条件非线性规划问题，通过MATLAB程序求解最优值，探讨其收敛性和稳定性。并改进遗传算法，给出适应度函数，通过变换适应度函数，提高算法的收敛性和稳定性。关键词：非线性规划；最速下降法；牛顿法；遗传算法济南大学毕业论文-II-ABSTRACTNonlinearprogrammingproblemisthegeneralformofthenonlinearoptimizationproblem.Inthispaper,wecarryontheanalysisofthemethodandalgorithmaimingattheoptimizationproblemofnonlinearprogramming.Thetraditionalmethodsofsolvingnonlinearprogrammingproblemsincludesteepestdescentmethod,Newtonmethod,thefeasibledirectionmethod,functionapproximationmethodandtrustregionmethod.Recentstudiesfoundmoremethodofsolvingnonlinearprogrammingproblems,suchasgeneticalgorithm,particleswarmoptimization(pso)algorithm.Inthispaper,thenonlinearprogrammingisanalyzedfromtwoaspects:theconstraintprogrammingandtheunconstrainedprogramming.WesolveunconstrainedconditionnonlinearprogrammingproblembysteepestdescentmethodandNewton'smethod,andgettheoptimalvaluethroughMATLAB.Thentheconvergenceandstabilityarediscussed.Besides,thedampedNewtonmethodisfurnished.Bydiscussingtheconvergenceandstabilityofthealgorithm,thedampedNewtonmethodhashigheraccuracyandfasterconvergentspeedthanNewton'smethodinsolvingunconstrainednonlinearprogrammingproblems.Punishmentfunctionisaclassicalmethodforsolvingconstrainednonlinear.Thispapersolvesnonlinearprogrammingproblemwithconstraintsbyusinggeneticalgorithmmethod,thecoreofwhichisSUMT.GettheoptimalvaluethroughMATLAB,thentheconvergenceandstabilityarediscussed.Improvegeneticalgorithm,givethefitnessfunction,andimprovetheconvergenceandstabilityofthealgorithmthroughtransformingthefitnessfunction.Keywords：NonlinearProgramming;PteepestDescentMethod;NewtonMethod;GeneticAlgorithm济南大学毕业论文-III-目录摘要........................................................................................................................................IABSTRACT..........................................................................................................................II1前言...................................................................................................................................11.1引言.........................................................................................................................11.2非线性规划的发展背景.........................................................................................21.3国内外研究现状.....................................................................................................21.4研究主要内容及研究方案.....................................................................................31.4.1研究的主要内容...........................................................................................31.4.2研究方案.......................................................................................................31.5研究难点.................................................................................................................42预备知识...........................................................................................................................52.1向量和矩阵范数.....................................................................................................52.1.1常见的向量范数...........................................................................................52.1.2谱范数...........................................................................................................62.2符号和定义..............................................................................................................62.3数值误差.................................................................................................................72.4算法的稳定性.........................................................................................................72.5收敛性.....................................................................................................................93非线性规划模型.............................................................................................................103.1非线性规划模型...................................................................................................103.2无约束非线性规划...............................................................................................113.2.1最速下降法.................................................................................................133.2.2牛顿法.........................................................................................................153.2.2阻尼牛顿法.................................................................................................163.3约束非线性规划...................................................................................................173.3.1惩罚函数法.............................................................................