• Home
  • Search
  • Derivative Free Optimization in Higher Dimension
  • Cite Icon3
  • https://doi.org/10.1111/1475-3995.00266Copy DOI Icon

Derivative Free Optimization in Higher Dimension

Show More
  • Abstract
  • Literature Map
  • Citations
  • Similar Papers
Abstract

Non‐linear optimizations that do not require explicit or implicit derivative information of an objective function are an alternate search strategy when the derivative of the objective function is not available. In factorial design, the number of trials for experimental identification method in Em is about (m+ 1). These (m+ 1) equally spaced points are allowed to form a geometry that is known as regular simplex. The simplex method is attributed to Spendley, Hext and Himsworth. The method is improved by maintaining a set of (m+ 1) points in m dimensional space to generate a non‐regular simplex. This study suggests re‐scaling the simplex in higher dimensions for a restart phase. The direction of search is also changed when the simplex degenerates.The performance of this derivative free search method is measured based on the number of function evaluations, number of restart attempts and improvements in function value. An algorithm that describes the improved method is presented and compared with the Nelder and Mead simplex method. The performance of this algorithm is also tested with artificial neural network (ANN) problem. The numbers of function evaluations are about 40 times less with the improved method against the Nelder and Mead (1965) method to train an ANN problem with 36 variables.

Similar Papers
  • Research Article

OPTIMAL DESIGN OF OXYGEN PRODUCTION SYSTEM BY PATTREN SEARCH METHODS

  • Jan 04, 2023
  • Pakistan Journal of Science
  • M F Tabassum
  • Research Article

Using generalized simplex methods to approximate derivatives

  • Jun 28, 2025
  • IMA Journal of Numerical Analysis
  • Gabriel Jarry-Bolduc +1
  • Research Article
  • Citations1

Collaboration and Competition Process

  • Jul 01, 2010
  • International Journal of Artificial Life Research
  • Ping-Teng Chang +4
  • Conference Article
  • Citations2

Missile system design using a hybrid Evolving Swarm Algorithm

  • Mar 01, 2014
  • Timothy W Ledlow +2
  • Conference Article

New choices of search directions used in constructing quadratic interpolation models

  • Jul 01, 2008
  • Qing-Hua Zhou +2
  • PDF
  • Research Article
  • Citations5

A three-term conjugate gradient descent method with some applications

  • May 28, 2024
  • Journal of Inequalities and Applications
  • Ahmad Alhawarat +4
  • Research Article
  • Citations522

Calibration of rainfall‐runoff models: Application of global optimization to the Sacramento Soil Moisture Accounting Model

  • Apr 01, 1993
  • Water Resources Research
  • Soroosh Sorooshian +2
  • Research Article
  • Citations12

Considering radial basis function neural network for effective solution generation in metaheuristic algorithms

  • Jul 22, 2024
  • Scientific Reports
  • Erik Cuevas +3
  • Research Article

Multilevel Strategies Improve History Matching of Complex Reservoir Models

  • Apr 01, 2020
  • Journal of Petroleum Technology
  • Chris Carpenter
  • Research Article
  • Citations5

Comments on “An efficient search direction for linear programming problems” by H. Luh and R. Tsaih

  • Jan 20, 2003
  • Computers and Operations Research
  • Bruce J Chaderjian +1
  • Conference Article
  • Citations1

Intelligent Particle Swarm Optimization of Superconducting Magnetic Energy Storage devices

  • Nov 01, 2014
  • Ruxandra Barbulescu +4
  • Book Chapter
  • Citations3

A Derivative Free Minimization Method For Noisy Functions

  • Apr 01, 2002
  • V P Plagianakos +1
  • Research Article
  • Citations33

MEMPSODE: A global optimization software based on hybridization of population-based algorithms and local searches

  • Jan 12, 2012
  • Computer Physics Communications
  • C Voglis +4
  • Research Article
  • Citations86

Adsorptive removal of arsenic by novel iron/olivine composite: Insights into preparation and adsorption process by response surface methodology and artificial neural network

  • Jan 04, 2018
  • Journal of Environmental Management
  • Partha S Ghosal +3
  • Research Article
  • Citations211

A Progressive Barrier for Derivative-Free Nonlinear Programming

  • Jan 01, 2009
  • SIAM Journal on Optimization
  • Charles Audet +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.