{"data":{"markdownRemark":{"htmlAst":{"type":"root","children":[{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Evolutionary computing (or computation) draws inspiration directly from evolutionary biology to develop search and optimization techniques for solving complex problems. They are usually rooted in Darwinian theory of evolution. From "},{"type":"element","tagName":"a","properties":{"href":"https://en.wikipedia.org/wiki/Darwinism","target":"_blank","rel":["nofollow","noopener","noreferrer"]},"children":[{"type":"text","value":"Wikipedia"}]},{"type":"text","value":", the "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"Darwinian theory"}]},{"type":"text","value":" states that:"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"blockquote","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"…all species of organisms arise and develop through the natural selection of small, inherited variations that increase the individual’s ability to compete, survive, and reproduce."}]},{"type":"text","value":"\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"This suggests that as organisms evolve, they tend to be more fit to their environment, through processes of reproduction, genetic variations and natural selection. This theory gives rise to the natural computing approach called "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"evolutionary algorithms (EAs)"}]},{"type":"text","value":". There are different types of EAs, but the most popular ones are "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"genetic algorithms (GA), genetic programming (GP), evolution strategies (ES)"}]},{"type":"text","value":" and "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"evolutionary programming (EP)"}]},{"type":"text","value":". This post will be talking primary primary about GA, and GP, and briefly about ES and EP. Before diving into these algorithms, we need to understand what problem-solving as a search task is. We will briefly discuss some search techniques, such as "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"hill climbing"}]},{"type":"text","value":" and "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"simulated annealing"}]},{"type":"text","value":". These are single individual based search algorithms, as opposed to the EAs which are population-based, with a concept of competition. Understanding these single search algorithms provides the foundation needed for a better understanding of the EAs."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"h2","properties":{"id":"problem-solving-as-a-search-technique"},"children":[{"type":"element","tagName":"a","properties":{"href":"#problem-solving-as-a-search-technique","ariaHidden":true,"className":["anchor"]},"children":[{"type":"element","tagName":"svg","properties":{"ariaHidden":"true","height":16,"version":"1.1","viewBox":"0 0 16 16","width":16},"children":[{"type":"element","tagName":"path","properties":{"fillRule":"evenodd","d":"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z"},"children":[]}]}]},{"type":"text","value":"Problem-solving as a search technique"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"From the evolutionary perspective, a problem can be seen as a collection of information from which knowledge is to be extracted. This could be as simple as determining the value of "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.43056em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.43056em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"text","value":" that minimizes the function "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"f"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":")"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mn","properties":{},"children":[{"type":"text","value":"3"}]}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"+"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"+"}]},{"type":"element","tagName":"mn","properties":{},"children":[{"type":"text","value":"3"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"f(x) = x^3 + x + 3"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.8141079999999999em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:1.064108em;vertical-align:-0.25em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.10764em;"},"children":[{"type":"text","value":"f"}]},{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":")"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.8141079999999999em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.063em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"3"}]}]}]}]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2222222222222222em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mbin"]},"children":[{"type":"text","value":"+"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2222222222222222em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2222222222222222em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mbin"]},"children":[{"type":"text","value":"+"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2222222222222222em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"3"}]}]}]}]},{"type":"text","value":" (a minimization problem), or to assign classes to a set of students (a timetable problem). For each of these, the problem of solving them corresponds to taking a sequence of steps that leads to either a desired global performance or an improved individual performance. The process of looking for this performance gain is called a search. Search algorithms take a problem as input and return a solution. The problem needs to be first formulated though, and that involves 3 main concepts:"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"ol","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"Choice of representation i.e. encoding possible candidate solutions as a search space. This is primarily defined by the initial solution state and a set of other possible states. These are also called the "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"feasible"}]},{"type":"text","value":" solutions."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"Specification of the objective i.e. accurate description of what is to be achieved, in form of a mathematical statement. Then the maximization problem indicated above, the objective can be written as "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"m"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"i"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"n"}]},{"type":"element","tagName":"mtext","properties":{},"children":[{"type":"text","value":" "}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"f"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":")"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"min\\ f(x)"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.75em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:1em;vertical-align:-0.25em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"m"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"i"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"n"}]},{"type":"element","tagName":"span","properties":{"className":["mspace"]},"children":[{"type":"text","value":" "}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.10764em;"},"children":[{"type":"text","value":"f"}]},{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":")"}]}]}]}]},{"type":"text","value":"."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"Definition of the evaluation function i.e. a function that returns a specific value that indicates the quality of a candidate solution. It can also serve as a means of comparing between multiple individuals for one or more candidate solutions. Solutions to the evaluation function by the individual candidates is a response surface which is termed the "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"fitness landscape"}]},{"type":"text","value":"."}]},{"type":"text","value":"\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"A definition of the minimization problem in the example given above will look like:"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"blockquote","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"For search space "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"S"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"S"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.68333em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.68333em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"S"}]}]}]}]},{"type":"text","value":", with feasible solutions "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"F"}]},{"type":"element","tagName":"mo","properties":{"separator":"true"},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"mtext","properties":{},"children":[{"type":"text","value":" "}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"F"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"⊆"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"S"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"F,\\ F \\subseteq S"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.68333em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.8777699999999999em;vertical-align:-0.19444em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.13889em;"},"children":[{"type":"text","value":"F"}]},{"type":"element","tagName":"span","properties":{"className":["mpunct"]},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.16666666666666666em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mspace"]},"children":[{"type":"text","value":" "}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.13889em;"},"children":[{"type":"text","value":"F"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"⊆"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"S"}]}]}]}]},{"type":"text","value":", find "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"∗"}]}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x^*"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.688696em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.688696em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.688696em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.063em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mbin","mtight"]},"children":[{"type":"text","value":"∗"}]}]}]}]}]}]}]}]}]}]}]},{"type":"text","value":" such that "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"e"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"v"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"a"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"l"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"∗"}]}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":")"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"≤"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"e"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"v"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"a"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"l"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":")"}]},{"type":"element","tagName":"mo","properties":{"separator":"true"},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"∀"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"∈"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"F"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"eval(x^*) \\le eval(x), \\forall x \\in F"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.75em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:1em;vertical-align:-0.25em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"e"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.03588em;"},"children":[{"type":"text","value":"v"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"a"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.01968em;"},"children":[{"type":"text","value":"l"}]},{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.688696em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.063em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mbin","mtight"]},"children":[{"type":"text","value":"∗"}]}]}]}]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":")"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"≤"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"e"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.03588em;"},"children":[{"type":"text","value":"v"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"a"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.01968em;"},"children":[{"type":"text","value":"l"}]},{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":")"}]},{"type":"element","tagName":"span","properties":{"className":["mpunct"]},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.16666666666666666em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"∀"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"∈"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.13889em;"},"children":[{"type":"text","value":"F"}]}]}]}]},{"type":"text","value":"."}]},{"type":"text","value":"\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"The evaluation function (represented as "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"e"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"v"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"a"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"l"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":")"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"eval(x)"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.75em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:1em;vertical-align:-0.25em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"e"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.03588em;"},"children":[{"type":"text","value":"v"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"a"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.01968em;"},"children":[{"type":"text","value":"l"}]},{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":")"}]}]}]}]},{"type":"text","value":") with the lowest value for "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.43056em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.43056em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"text","value":" is considered the better one. It might also not be straightforward to get a "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"global solution"}]},{"type":"text","value":"  or "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"global optimum"}]},{"type":"text","value":" to a search problem. In contrast to a "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"global optimum"}]},{"type":"text","value":", a "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"local optimum"}]},{"type":"text","value":" will be a solution that is only optimal, in comparison to its neighbourhood, and there could be a much better solution in the overall search space, as shown in the illustration below."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"element","tagName":"img","properties":{"src":"/local_global_optima-f5e5272f428f6d931d1a157549d1ab9c.svg","alt":"Local and global optima"},"children":[]}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"In a maximization problem, the global optimum (maximum) will be the peak value of the fitness landscape, as against the local optima (maxima). Two popular search techniques are "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"hill-climbing"}]},{"type":"text","value":" and "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"simulated annealing"}]},{"type":"text","value":"."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"h3","properties":{"id":"hill-climbing"},"children":[{"type":"element","tagName":"a","properties":{"href":"#hill-climbing","ariaHidden":true,"className":["anchor"]},"children":[{"type":"element","tagName":"svg","properties":{"ariaHidden":"true","height":16,"version":"1.1","viewBox":"0 0 16 16","width":16},"children":[{"type":"element","tagName":"path","properties":{"fillRule":"evenodd","d":"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z"},"children":[]}]}]},{"type":"text","value":"Hill Climbing"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Hill climbing is a "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"local"}]},{"type":"text","value":" search method that uses am iterative improvement strategy. At initialization, the strategy is applied to a single (randomly selected) point ("},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.43056em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.43056em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"text","value":") in the search space. At each iteration, a new point is selected by performing a small "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"perturbation"}]},{"type":"text","value":" (displacement) of the current point, by selecting a new point "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"′"}]}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x'"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.751892em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.751892em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.751892em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.063em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"′"}]}]}]}]}]}]}]}]}]}]}]}]},{"type":"text","value":" in the neighbourhood of "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.43056em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.43056em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"text","value":", i.e. "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"′"}]}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"∈"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"N"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":")"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x' \\in N(x)"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.751892em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:1.001892em;vertical-align:-0.25em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.751892em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.063em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"′"}]}]}]}]}]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"∈"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.10903em;"},"children":[{"type":"text","value":"N"}]},{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":")"}]}]}]}]},{"type":"text","value":". This can be by simply adding a small random number to the current value of "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.43056em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.43056em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"text","value":" i.e. "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"′"}]}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"+"}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"Δ"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x'=x+ \\Delta x"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.751892em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.835222em;vertical-align:-0.08333em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.751892em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.063em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"′"}]}]}]}]}]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2222222222222222em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mbin"]},"children":[{"type":"text","value":"+"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2222222222222222em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"Δ"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"text","value":". If the new point provides a better value of the evaluation function, then it becomes the current point, else another displacement is done. Termination is achieved when no further improvement is achievable, a fixed number of iteration is done or a goal is attained. The algorithm can be seen below:"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"h4","properties":{"id":"a-simple-hill-climbing-algorithm"},"children":[{"type":"element","tagName":"a","properties":{"href":"#a-simple-hill-climbing-algorithm","ariaHidden":true,"className":["anchor"]},"children":[{"type":"element","tagName":"svg","properties":{"ariaHidden":"true","height":16,"version":"1.1","viewBox":"0 0 16 16","width":16},"children":[{"type":"element","tagName":"path","properties":{"fillRule":"evenodd","d":"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z"},"children":[]}]}]},{"type":"text","value":"A simple hill-climbing algorithm"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"dl","properties":{"className":["algorithm"]},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"procedure"}]},{"type":"text","value":" ["},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"text","value":"] = hill-climbing(max_it, "},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"g"}]},{"type":"text","value":")\n\tinitialize "},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"text","value":"\n\teval("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"text","value":")\n\tt <- 1\n\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"while"}]},{"type":"text","value":" t < max_it & "},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"text","value":" != "},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"g"}]},{"type":"text","value":" & no_improvement "},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"do"}]},{"type":"text","value":"\n\t\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x'"}]},{"type":"text","value":" <- displace("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"text","value":")\n\t\teval("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x'"}]},{"type":"text","value":")\n\t\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"if"}]},{"type":"text","value":" eval("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x'"}]},{"type":"text","value":") is better than eval("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"text","value":")\n\t\t\tthen "},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x <- x'"}]},{"type":"text","value":"\n\t\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"end"}]},{"type":"text","value":" if\n\t\tt <- t + 1\n\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"end"}]},{"type":"text","value":" while\n"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"end"}]},{"type":"text","value":" procedure\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"As might have been already observed, this simple hill climbing has some weakness:"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"ul","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"It can easily terminate at a local optimum, based on the initialization point;"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"There is no information about the distance between the solution found and the global optimum;"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"It is quite impossible to provide an upper bound for the computational time."}]},{"type":"text","value":"\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"To help with some of these problems, there is an "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"iterated hill-climbing"}]},{"type":"text","value":" that starts from multiple initialization positions, and mentions a memory of best solution so far. There is also a "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"stochastic hill-climbing"}]},{"type":"text","value":" procedure that associate a probability value to the likelihood of a new point "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"′"}]}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x'"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.751892em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.751892em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.751892em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.063em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"′"}]}]}]}]}]}]}]}]}]}]}]}]},{"type":"text","value":" to be selected, providing a possibility of escaping from a local optimum."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"h3","properties":{"id":"simulated-annealing"},"children":[{"type":"element","tagName":"a","properties":{"href":"#simulated-annealing","ariaHidden":true,"className":["anchor"]},"children":[{"type":"element","tagName":"svg","properties":{"ariaHidden":"true","height":16,"version":"1.1","viewBox":"0 0 16 16","width":16},"children":[{"type":"element","tagName":"path","properties":{"fillRule":"evenodd","d":"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z"},"children":[]}]}]},{"type":"text","value":"Simulated Annealing"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Simulated annealing is inspired by the annealing process in physics. Annealing is the process of allowing a heated material (glass or metal) to cool down slowly, in order to toughen it up, and remove internal stress, thereby reducing brittleness. The origin idea of simulated annealing (SA) algorithm is from statistical thermodynamics, which suggests that:"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"blockquote","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"large systems at a given temperature approach the equilibrium state spontaneously, characterized by a mean value of energy, depending on the temperature. By simulating the transition to equilibrium and decreasing the temperature, it is possible to find smaller and smaller values of the system’s mean energy."}]},{"type":"text","value":"\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Given "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.43056em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.43056em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"text","value":" as the current system configuration, and "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{"separator":"true"},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"T"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"Ex, T"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.68333em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.8777699999999999em;vertical-align:-0.19444em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["mpunct"]},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.16666666666666666em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.13889em;"},"children":[{"type":"text","value":"T"}]}]}]}]},{"type":"text","value":" are the energy and temperature of "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.43056em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.43056em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"text","value":" respectively, the probability of "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.43056em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.43056em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"text","value":" is given by the "},{"type":"element","tagName":"a","properties":{"href":"https://en.wikipedia.org/wiki/Boltzmann_distribution","target":"_blank","rel":["nofollow","noopener","noreferrer"]},"children":[{"type":"text","value":"Bolzmann-Gibbs distribution"}]},{"type":"text","value":", "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"P"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":")"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"k"}]},{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"e"}]},{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"−"}]},{"type":"element","tagName":"mfrac","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]}]},{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"T"}]}]}]}]}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"P(x) = k e^{{-\\frac{E}{T}}}"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.973465em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:1.223465em;vertical-align:-0.25em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.13889em;"},"children":[{"type":"text","value":"P"}]},{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":")"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.03148em;"},"children":[{"type":"text","value":"k"}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"e"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.973465em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.363em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"−"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mopen","nulldelimiter","sizing","reset-size3","size6"]},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mfrac"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t","vlist-t2"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.8720928571428572em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-2.656em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size3","size1","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"],"style":"margin-right:0.13889em;"},"children":[{"type":"text","value":"T"}]}]}]}]},{"type":"element","tagName":"span","properties":{"style":"top:-3.1275em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["stretchy","mtight"],"style":"height:0.245em;"},"children":[{"type":"element","tagName":"svg","properties":{"width":"400em","height":"0.245em","viewBox":"0 0 400000 200","preserveAspectRatio":"xMinYMin slice"},"children":[{"type":"element","tagName":"path","properties":{"d":"M0 80H400000 v40H0z M0 80H400000 v40H0z"},"children":[]}]}]}]},{"type":"element","tagName":"span","properties":{"style":"top:-3.384em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size3","size1","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-s"]},"children":[{"type":"text","value":"​"}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.344em;"},"children":[]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mclose","nulldelimiter","sizing","reset-size3","size6"]},"children":[]}]}]}]}]}]}]}]}]}]}]}]}]}]},{"type":"text","value":", where k is a system constant. In a system with multiple possible states (i.e. a search space), the mean energy on the system is given by:"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"span","properties":{"className":["katex-display"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"msub","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"m"}]}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"mfrac","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"munder","properties":{},"children":[{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"∑"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"i"}]}]},{"type":"element","tagName":"msub","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"i"}]}]},{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"e"}]},{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"−"}]},{"type":"element","tagName":"mfrac","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"msub","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"i"}]}]}]},{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"T"}]}]}]}]}]}]},{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"munder","properties":{},"children":[{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"∑"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"i"}]}]},{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"e"}]},{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"−"}]},{"type":"element","tagName":"mfrac","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"msub","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"i"}]}]}]},{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"T"}]}]}]}]}]}]}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"E_m = \\frac{\\sum_iE_i e^{{-\\frac{E_i}{T}}}}\n\t\t\t{\\sum_i e^{{-\\frac{E_i}{T}}}}"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:1.7781850000000001em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:3.04192em;vertical-align:-1.263735em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t","vlist-t2"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.151392em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-2.5500000000000003em;margin-left:-0.05764em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"]},"children":[{"type":"text","value":"m"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-s"]},"children":[{"type":"text","value":"​"}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.15em;"},"children":[]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mopen","nulldelimiter"]},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mfrac"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t","vlist-t2"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:1.7781850000000001em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-2.12445em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3.088475em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mop"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mop","op-symbol","small-op"],"style":"position:relative;top:-0.0000050000000000050004em;"},"children":[{"type":"text","value":"∑"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t","vlist-t2"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.16195399999999993em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-2.40029em;margin-left:0em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"]},"children":[{"type":"text","value":"i"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-s"]},"children":[{"type":"text","value":"​"}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.29971000000000003em;"},"children":[]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.16666666666666666em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"e"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:1.074025em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.3485500000000004em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"−"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mopen","nulldelimiter","sizing","reset-size3","size6"]},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mfrac"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t","vlist-t2"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:1.0363928571428573em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-2.656em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size3","size1","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"],"style":"margin-right:0.13889em;"},"children":[{"type":"text","value":"T"}]}]}]}]},{"type":"element","tagName":"span","properties":{"style":"top:-3.1275em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["stretchy","mtight"],"style":"height:0.245em;"},"children":[{"type":"element","tagName":"svg","properties":{"width":"400em","height":"0.245em","viewBox":"0 0 400000 200","preserveAspectRatio":"xMinYMin slice"},"children":[{"type":"element","tagName":"path","properties":{"d":"M0 80H400000 v40H0z M0 80H400000 v40H0z"},"children":[]}]}]}]},{"type":"element","tagName":"span","properties":{"style":"top:-3.5483000000000002em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size3","size1","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t","vlist-t2"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.3448em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-2.3448em;margin-left:-0.05764em;margin-right:0.1em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.65952em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"]},"children":[{"type":"text","value":"i"}]}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-s"]},"children":[{"type":"text","value":"​"}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.31472em;"},"children":[]}]}]}]}]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-s"]},"children":[{"type":"text","value":"​"}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.344em;"},"children":[]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mclose","nulldelimiter","sizing","reset-size3","size6"]},"children":[]}]}]}]}]}]}]}]}]}]}]}]}]},{"type":"element","tagName":"span","properties":{"style":"top:-3.2384749999999998em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3.088475em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["stretchy"],"style":"height:0.2em;"},"children":[{"type":"element","tagName":"svg","properties":{"width":"400em","height":"0.2em","viewBox":"0 0 400000 200","preserveAspectRatio":"xMinYMin slice"},"children":[{"type":"element","tagName":"path","properties":{"d":"M0 80H400000 v40H0z M0 80H400000 v40H0z"},"children":[]}]}]}]},{"type":"element","tagName":"span","properties":{"style":"top:-3.778185em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3.088475em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mop"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mop","op-symbol","small-op"],"style":"position:relative;top:-0.0000050000000000050004em;"},"children":[{"type":"text","value":"∑"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t","vlist-t2"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.16195399999999993em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-2.40029em;margin-left:0em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"]},"children":[{"type":"text","value":"i"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-s"]},"children":[{"type":"text","value":"​"}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.29971000000000003em;"},"children":[]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.16666666666666666em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t","vlist-t2"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.31166399999999994em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-2.5500000000000003em;margin-left:-0.05764em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"]},"children":[{"type":"text","value":"i"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-s"]},"children":[{"type":"text","value":"​"}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.15em;"},"children":[]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"e"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:1.088475em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.363em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"−"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mopen","nulldelimiter","sizing","reset-size3","size6"]},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mfrac"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t","vlist-t2"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:1.0363928571428573em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-2.656em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size3","size1","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"],"style":"margin-right:0.13889em;"},"children":[{"type":"text","value":"T"}]}]}]}]},{"type":"element","tagName":"span","properties":{"style":"top:-3.1275em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["stretchy","mtight"],"style":"height:0.245em;"},"children":[{"type":"element","tagName":"svg","properties":{"width":"400em","height":"0.245em","viewBox":"0 0 400000 200","preserveAspectRatio":"xMinYMin slice"},"children":[{"type":"element","tagName":"path","properties":{"d":"M0 80H400000 v40H0z M0 80H400000 v40H0z"},"children":[]}]}]}]},{"type":"element","tagName":"span","properties":{"style":"top:-3.5483000000000002em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size3","size1","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t","vlist-t2"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.3448em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-2.3448em;margin-left:-0.05764em;margin-right:0.1em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.65952em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"]},"children":[{"type":"text","value":"i"}]}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-s"]},"children":[{"type":"text","value":"​"}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.31472em;"},"children":[]}]}]}]}]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-s"]},"children":[{"type":"text","value":"​"}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.344em;"},"children":[]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mclose","nulldelimiter","sizing","reset-size3","size6"]},"children":[]}]}]}]}]}]}]}]}]}]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-s"]},"children":[{"type":"text","value":"​"}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:1.263735em;"},"children":[]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mclose","nulldelimiter"]},"children":[]}]}]}]}]}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"The computation might take a long time for a large number of configurations, but we can randomly sample the configurations (i.e. using "},{"type":"element","tagName":"a","properties":{"href":"https://en.wikipedia.org/wiki/Monte_Carlo_method","target":"_blank","rel":["nofollow","noopener","noreferrer"]},"children":[{"type":"text","value":"Monte Carlo method"}]},{"type":"text","value":") to simulate equilibrium."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"In SA algorithms, the evaluation function is used to represent the energy, and the fitness function is used to represent the temperature. We are in essence searching by reducing the value of "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"T"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"T"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.68333em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.68333em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.13889em;"},"children":[{"type":"text","value":"T"}]}]}]}]},{"type":"text","value":". Given this details, the SA algorithm works as follow:"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"blockquote","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Assuming a current configuration of "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.43056em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.43056em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]}]}]}]},{"type":"text","value":", it is given a small random displacement, resulting in "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"′"}]}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"∈"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"N"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":")"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x' \\in N(x)"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.751892em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:1.001892em;vertical-align:-0.25em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.751892em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.063em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"′"}]}]}]}]}]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"∈"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.10903em;"},"children":[{"type":"text","value":"N"}]},{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":")"}]}]}]}]},{"type":"text","value":". The energy "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"′"}]}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":")"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"E(x')"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.751892em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:1.001892em;vertical-align:-0.25em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.751892em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.063em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"′"}]}]}]}]}]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":")"}]}]}]}]},{"type":"text","value":" of the new position is computed and the difference, "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"Δ"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"′"}]}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":")"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"−"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":")"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"\\Delta E = E(x') - E(x)"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.751892em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:1.001892em;vertical-align:-0.25em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"Δ"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.751892em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.063em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"′"}]}]}]}]}]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":")"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2222222222222222em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mbin"]},"children":[{"type":"text","value":"−"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2222222222222222em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":")"}]}]}]}]},{"type":"text","value":" helps to decide if to accept the new configuration or not."}]},{"type":"text","value":"\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"If "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"Δ"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"<"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"mn","properties":{},"children":[{"type":"text","value":"0"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"\\Delta E<=0"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.68333em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.72243em;vertical-align:-0.0391em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"Δ"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"<"}]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"0"}]}]}]}]},{"type":"text","value":", the displacement is accept, and "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"′"}]}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x'"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.751892em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.751892em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.751892em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.063em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"′"}]}]}]}]}]}]}]}]}]}]}]}]},{"type":"text","value":" becomes "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"′"}]}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x'"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.751892em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.751892em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.751892em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.063em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"′"}]}]}]}]}]}]}]}]}]}]}]}]},{"type":"text","value":" for the next iteration. If "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"Δ"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":">"}]},{"type":"element","tagName":"mn","properties":{},"children":[{"type":"text","value":"0"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"\\Delta E> 0"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.68333em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.72243em;vertical-align:-0.0391em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"Δ"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":">"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"0"}]}]}]}]},{"type":"text","value":", the probability of accepting "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mo","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"′"}]}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"x'"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.751892em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.751892em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.751892em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.063em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"′"}]}]}]}]}]}]}]}]}]}]}]}]},{"type":"text","value":" is given by "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"P"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"Δ"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":")"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"msup","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"e"}]},{"type":"element","tagName":"mfrac","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"Δ"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]}]},{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"T"}]}]}]}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"P(\\Delta E) = e^{\\frac{\\Delta E}{T}}"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.973465em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:1.223465em;vertical-align:-0.25em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.13889em;"},"children":[{"type":"text","value":"P"}]},{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"Δ"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":")"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"e"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.973465em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-3.363em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mopen","nulldelimiter","sizing","reset-size3","size6"]},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mfrac"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t","vlist-t2"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.8720928571428572em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-2.656em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size3","size1","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"],"style":"margin-right:0.13889em;"},"children":[{"type":"text","value":"T"}]}]}]}]},{"type":"element","tagName":"span","properties":{"style":"top:-3.1275em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["stretchy","mtight"],"style":"height:0.245em;"},"children":[{"type":"element","tagName":"svg","properties":{"width":"400em","height":"0.245em","viewBox":"0 0 400000 200","preserveAspectRatio":"xMinYMin slice"},"children":[{"type":"element","tagName":"path","properties":{"d":"M0 80H400000 v40H0z M0 80H400000 v40H0z"},"children":[]}]}]}]},{"type":"element","tagName":"span","properties":{"style":"top:-3.384em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:3em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size3","size1","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"Δ"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-s"]},"children":[{"type":"text","value":"​"}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.344em;"},"children":[]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mclose","nulldelimiter","sizing","reset-size3","size6"]},"children":[]}]}]}]}]}]}]}]}]}]}]}]}]},{"type":"text","value":". The algorithm can be seen below."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"h4","properties":{"id":"a-simple-simulated-annealing-algorithm"},"children":[{"type":"element","tagName":"a","properties":{"href":"#a-simple-simulated-annealing-algorithm","ariaHidden":true,"className":["anchor"]},"children":[{"type":"element","tagName":"svg","properties":{"ariaHidden":"true","height":16,"version":"1.1","viewBox":"0 0 16 16","width":16},"children":[{"type":"element","tagName":"path","properties":{"fillRule":"evenodd","d":"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z"},"children":[]}]}]},{"type":"text","value":"A simple simulated annealing algorithm"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"dl","properties":{"className":["algorithm"]},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"procedure"}]},{"type":"text","value":" ["},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"text","value":"] = simulated_annealing("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"g"}]},{"type":"text","value":")\n\tinitialize T\n\tinitialize "},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"text","value":"\n\teval("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"text","value":")\n\tt <- 1\n\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"while"}]},{"type":"text","value":" not_stopping_criterion "},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"do"}]},{"type":"text","value":"\n\t\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x'"}]},{"type":"text","value":" <- displace("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"text","value":")\n\t\teval("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x'"}]},{"type":"text","value":")\n\t\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"if"}]},{"type":"text","value":" eval("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x'"}]},{"type":"text","value":") <= eval("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"text","value":")\n\t\t\tthen "},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x <- x'"}]},{"type":"text","value":"\n\t\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"else if"}]},{"type":"text","value":" random[0,1) < exp[(eval("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"text","value":")-eval("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"text","value":"))/T]\n\t\t\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"then"}]},{"type":"text","value":" x <- x'\n\t\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"end"}]},{"type":"text","value":" if\n\t\tT <- g(T,t)\n\t\tt <- t + 1\n\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"end"}]},{"type":"text","value":" while\n"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"end"}]},{"type":"text","value":" procedure\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"By repeating the steps in the algorithm, we are simulating the thermal motion of atoms in thermal contacts with a heat bath at temperature T. Using equation "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"P"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"Δ"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":")"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"P(\\Delta E)"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.75em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:1em;vertical-align:-0.25em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.13889em;"},"children":[{"type":"text","value":"P"}]},{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"Δ"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.05764em;"},"children":[{"type":"text","value":"E"}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":")"}]}]}]}]},{"type":"text","value":" enables the system to evolve into a Boltzmann distribution."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"h2","properties":{"id":"evolutionary-algorithms"},"children":[{"type":"element","tagName":"a","properties":{"href":"#evolutionary-algorithms","ariaHidden":true,"className":["anchor"]},"children":[{"type":"element","tagName":"svg","properties":{"ariaHidden":"true","height":16,"version":"1.1","viewBox":"0 0 16 16","width":16},"children":[{"type":"element","tagName":"path","properties":{"fillRule":"evenodd","d":"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z"},"children":[]}]}]},{"type":"text","value":"Evolutionary Algorithms"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Evolution can be regarded as a search process that is capable of locating solutions problems offered by environmental problems. Iterative (search and optimization) problems that are inspired by nature, are generally referred to as evolutionary algorithms (EAs). They can be applied to a variety of domains with a requirement for problem-solving. "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"Evolutionary computation"}]},{"type":"text","value":" (EC) is the name that describes the field of research dedicated to EAs. The main types of EC are "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"genetic algorithms (GA), genetic programming (GP) evolution strategies (ES),"}]},{"type":"text","value":" and "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"evolutionary programming (EP)"}]},{"type":"text","value":". A standard EA is expected to have the following characteristics:"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"ul","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"A population of individuals that reproduce with inheritance. Each individual represents an encoded point in the search space. They can reproduce (sexually or asexually), generating offspring that inherits some of their features/traits, causing some resemblance between offspring and parent."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"Genetics variation. Offspring are genetically different from parents through mutation. Mutation allows the appearance of new traits in offspring, hence potentially new regions in the search space to explore."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"Natural Selection. There is a measure of fitness/quality to each individual, which dictates their competition survival and reproduction in the environment. Individuals with higher fitness have a selective advantage."}]},{"type":"text","value":"\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"A standard EA is a generative, iterative and probabilistic algorithm, maintaining a population "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"P"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"P"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.68333em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.68333em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.13889em;"},"children":[{"type":"text","value":"P"}]}]}]}]},{"type":"text","value":" of "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"N"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"N"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.68333em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.68333em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.10903em;"},"children":[{"type":"text","value":"N"}]}]}]}]},{"type":"text","value":" individuals, "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"P"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"msub","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mn","properties":{},"children":[{"type":"text","value":"1"}]}]},{"type":"element","tagName":"mo","properties":{"separator":"true"},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"msub","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"N"}]}]}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"P = {x_1,...x_N}"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.68333em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.8777699999999999em;vertical-align:-0.19444em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.13889em;"},"children":[{"type":"text","value":"P"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t","vlist-t2"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.30110799999999993em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-2.5500000000000003em;margin-left:0em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mtight"]},"children":[{"type":"text","value":"1"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-s"]},"children":[{"type":"text","value":"​"}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.15em;"},"children":[]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mpunct"]},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.16666666666666666em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"x"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t","vlist-t2"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.32833099999999993em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-2.5500000000000003em;margin-left:0em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"],"style":"margin-right:0.10903em;"},"children":[{"type":"text","value":"N"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-s"]},"children":[{"type":"text","value":"​"}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.15em;"},"children":[]}]}]}]}]}]}]}]}]},{"type":"text","value":". At each iteration, "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"t"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"t"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.61508em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.61508em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"t"}]}]}]}]},{"type":"text","value":", each individual in the population corresponds to a potential solution to a search problem that needs to be solved, and they are evaluated to give their fitness (a measure of adaptability). At iteration "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"t"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"+"}]},{"type":"element","tagName":"mn","properties":{},"children":[{"type":"text","value":"1"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"t+1"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.64444em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.72777em;vertical-align:-0.08333em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"t"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2222222222222222em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mbin"]},"children":[{"type":"text","value":"+"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2222222222222222em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"1"}]}]}]}]},{"type":"text","value":", a new population is generated by selecting some (typically the fittest) of the individuals from the population and reproducing them, sexually or asexually. Genetic variable through mutation can affect some of the offspring. The end of this process constitutes a generation."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"An example of a simple EA is presented below. An initialization parameter is typically used to generate the initial population. Parameters "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"p"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"c"}]},{"type":"element","tagName":"mtext","properties":{},"children":[{"type":"text","value":" "}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"&"}]},{"type":"element","tagName":"mtext","properties":{},"children":[{"type":"text","value":" "}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"p"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"m"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"pc\\ \\&\\ pm"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.69444em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.8888799999999999em;vertical-align:-0.19444em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"p"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"c"}]},{"type":"element","tagName":"span","properties":{"className":["mspace"]},"children":[{"type":"text","value":" "}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"&"}]},{"type":"element","tagName":"span","properties":{"className":["mspace"]},"children":[{"type":"text","value":" "}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"p"}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"m"}]}]}]}]},{"type":"text","value":" is also used, corresponding to the "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"crossover"}]},{"type":"text","value":" (recombination) and "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"mutation"}]},{"type":"text","value":" (variation) probabilities. The stopping criteria is typically a maximum number of generations, or once the specified objective function is achieved."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"h4","properties":{"id":"a-standard-evolutionary-algorithm"},"children":[{"type":"element","tagName":"a","properties":{"href":"#a-standard-evolutionary-algorithm","ariaHidden":true,"className":["anchor"]},"children":[{"type":"element","tagName":"svg","properties":{"ariaHidden":"true","height":16,"version":"1.1","viewBox":"0 0 16 16","width":16},"children":[{"type":"element","tagName":"path","properties":{"fillRule":"evenodd","d":"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z"},"children":[]}]}]},{"type":"text","value":"A standard evolutionary algorithm"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"dl","properties":{"className":["algorithm"]},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"procedure"}]},{"type":"text","value":" ["},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"P"}]},{"type":"text","value":"] = standard_EA(pc, pm)\n\tinitialize "},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"P"}]},{"type":"text","value":"\n\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"f"}]},{"type":"text","value":" <- eval("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"P"}]},{"type":"text","value":")\n\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"P"}]},{"type":"text","value":" <- select("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"P,f"}]},{"type":"text","value":")\n\tt <- 1\n\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"while"}]},{"type":"text","value":" not_stopping_criterion "},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"do"}]},{"type":"text","value":"\n\t\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"P"}]},{"type":"text","value":" <- reproduce("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"P,f, pc"}]},{"type":"text","value":")\n\t\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"P"}]},{"type":"text","value":" <- variate("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"P,pm"}]},{"type":"text","value":")\n\t\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"P"}]},{"type":"text","value":" <- eval("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"P"}]},{"type":"text","value":")\n\t\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"P"}]},{"type":"text","value":" <- select("},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"P,f"}]},{"type":"text","value":")\n\t\tt <- t + 1\n\t"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"end"}]},{"type":"text","value":" while\n"},{"type":"element","tagName":"b","properties":{},"children":[{"type":"text","value":"end"}]},{"type":"text","value":" procedure\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Most EAs can be represented using this standard algorithm, with the difference lying in the representation, selection, reproduction and variation operators, as well as in the order that they are applied."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"h3","properties":{"id":"genetics-algorithms"},"children":[{"type":"element","tagName":"a","properties":{"href":"#genetics-algorithms","ariaHidden":true,"className":["anchor"]},"children":[{"type":"element","tagName":"svg","properties":{"ariaHidden":"true","height":16,"version":"1.1","viewBox":"0 0 16 16","width":16},"children":[{"type":"element","tagName":"path","properties":{"fillRule":"evenodd","d":"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z"},"children":[]}]}]},{"type":"text","value":"Genetics Algorithms"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"Genetic algorithms (GA)"}]},{"type":"text","value":" borrow vocabulary directly from natural "},{"type":"element","tagName":"a","properties":{"href":"https://en.wikipedia.org/wiki/Genetics","target":"_blank","rel":["nofollow","noopener","noreferrer"]},"children":[{"type":"text","value":"genetics"}]},{"type":"text","value":". The data structure representing the individuals in the population is often called "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"chromosomes"}]},{"type":"text","value":". In standard GAs, the individuals are represented as binary digits, "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mn","properties":{},"children":[{"type":"text","value":"0"}]},{"type":"element","tagName":"mo","properties":{"separator":"true"},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"mn","properties":{},"children":[{"type":"text","value":"1"}]}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"{0, 1}"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.64444em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.8388800000000001em;vertical-align:-0.19444em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"0"}]},{"type":"element","tagName":"span","properties":{"className":["mpunct"]},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.16666666666666666em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"1"}]}]}]}]}]},{"type":"text","value":" ("},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"bitstrings"}]},{"type":"text","value":"). Each unit of a chromosome is called a "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"gene"}]},{"type":"text","value":", and their location in the chromosome is called a "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"locus"}]},{"type":"text","value":". Different forms a gene can assume ("},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mn","properties":{},"children":[{"type":"text","value":"0"}]},{"type":"element","tagName":"mtext","properties":{},"children":[{"type":"text","value":" "}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"&"}]},{"type":"element","tagName":"mtext","properties":{},"children":[{"type":"text","value":" "}]},{"type":"element","tagName":"mn","properties":{},"children":[{"type":"text","value":"1"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"0\\ \\&\\ 1"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.69444em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.69444em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"0"}]},{"type":"element","tagName":"span","properties":{"className":["mspace"]},"children":[{"type":"text","value":" "}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"&"}]},{"type":"element","tagName":"span","properties":{"className":["mspace"]},"children":[{"type":"text","value":" "}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"1"}]}]}]}]},{"type":"text","value":" when bitstrings) are called "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"alleles"}]},{"type":"text","value":"."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"element","tagName":"img","properties":{"src":"/chromosome-6952e4c0d55071ee31eaf70c80fff0db.svg","alt":"Chromosome"},"children":[]}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Image above shows a bitstring of length 10, representing a standard chromosome in GA. The meaning of a particular chromosome (its phenotype) is defined according to the search problem - they present a potential solution to the problem. Each one of the chromosomes is assigned a probability of reproduction, "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"msub","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"p"}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"i"}]}]},{"type":"element","tagName":"mo","properties":{"separator":"true"},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"i"}]},{"type":"element","tagName":"mo","properties":{"separator":"true"},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"mo","properties":{"separator":"true"},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"N"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"p_i, i,...,N"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.68333em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.8777699999999999em;vertical-align:-0.19444em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"p"}]},{"type":"element","tagName":"span","properties":{"className":["msupsub"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-t","vlist-t2"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.31166399999999994em;"},"children":[{"type":"element","tagName":"span","properties":{"style":"top:-2.5500000000000003em;margin-left:0em;margin-right:0.05em;"},"children":[{"type":"element","tagName":"span","properties":{"className":["pstrut"],"style":"height:2.7em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["sizing","reset-size6","size3","mtight"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit","mtight"]},"children":[{"type":"text","value":"i"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-s"]},"children":[{"type":"text","value":"​"}]}]},{"type":"element","tagName":"span","properties":{"className":["vlist-r"]},"children":[{"type":"element","tagName":"span","properties":{"className":["vlist"],"style":"height:0.15em;"},"children":[]}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["mpunct"]},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.16666666666666666em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"]},"children":[{"type":"text","value":"i"}]},{"type":"element","tagName":"span","properties":{"className":["mpunct"]},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.16666666666666666em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"span","properties":{"className":["mpunct"]},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.16666666666666666em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.10903em;"},"children":[{"type":"text","value":"N"}]}]}]}]},{"type":"text","value":", such that its likelihood of been selected is directly proportional to its fitness, in comparison with other chromosomes in the population. The higher the fitness, the higher the likelihood of selection. Selection is typically performed via an algorithm called "},{"type":"element","tagName":"a","properties":{"href":"https://en.wikipedia.org/wiki/Fitness_proportionate_selection","target":"_blank","rel":["nofollow","noopener","noreferrer"]},"children":[{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"fitness proportionate selection"}]}]},{"type":"text","value":", (aka "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"Roulette Wheel selection"}]},{"type":"text","value":")."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"element","tagName":"img","properties":{"src":"/crossover-2c1e810561e6d2bb13587335c56a119d.svg","alt":"Crossover"},"children":[]}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"element","tagName":"img","properties":{"src":"/mutation-1f733ebbac44de74e7cab53859e90259.svg","alt":"Mutation"},"children":[]}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"The selected chromosomes generate offspring using genetic operators, such as crossover or bit-mutation (shown in images above). In the crossover operator, "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"r"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"r"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.43056em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.43056em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.02778em;"},"children":[{"type":"text","value":"r"}]}]}]}]},{"type":"text","value":" is randomly selected from "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"{"}]},{"type":"element","tagName":"mn","properties":{},"children":[{"type":"text","value":"1"}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"mi","properties":{"mathvariant":"normal"},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"l"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"−"}]},{"type":"element","tagName":"mn","properties":{},"children":[{"type":"text","value":"1"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"}"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"\\{1...l-1\\}"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.75em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:1em;vertical-align:-0.25em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"{"}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"1"}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"."}]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.01968em;"},"children":[{"type":"text","value":"l"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2222222222222222em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mbin"]},"children":[{"type":"text","value":"−"}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2222222222222222em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"text","value":"1"}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":"}"}]}]}]}]},{"type":"text","value":", where "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"l"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"l"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.69444em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.69444em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.01968em;"},"children":[{"type":"text","value":"l"}]}]}]}]},{"type":"text","value":" is the length of the chromosome. These operators are also presented in the previously shown standard EA algorithm, as reproduce, and variate. Although there is still a chance of the fittest chromosomes been eliminated, i.e. not making it to the genetic operation, they still have a much higher chance of selection, because they occupy the largest proportion of the “roulette wheel”."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Applications of genetic algorithms include pattern recognition and numeric function optimization."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"h3","properties":{"id":"genetics-programming"},"children":[{"type":"element","tagName":"a","properties":{"href":"#genetics-programming","ariaHidden":true,"className":["anchor"]},"children":[{"type":"element","tagName":"svg","properties":{"ariaHidden":"true","height":16,"version":"1.1","viewBox":"0 0 16 16","width":16},"children":[{"type":"element","tagName":"path","properties":{"fillRule":"evenodd","d":"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z"},"children":[]}]}]},{"type":"text","value":"Genetics Programming"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"Genetic programming (GP)"}]},{"type":"text","value":" is a type of evolutionary algorithm that was developed as an extension of genetic algorithms. The data structure used in GP are representations of computer programs, and the fitness function involves executing the programs. In essence, GP is a search based on the evolution of the possible spaces of a computer program, such that when run, it will produce a suitable output that is related to solving a specified problem."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Similar to other EA, in GP, a problem is defined by its representation, and the specification of an objective function. The representation involves choosing an appropriate "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"function set, F"}]},{"type":"text","value":", and an appropriate "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"terminal set, T"}]},{"type":"text","value":". The functions set are those that are believed to have been previously useful and sufficient, while the terminal set is usually represented as variables or constants."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"The primary motivation of "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"GP"}]},{"type":"text","value":" was getting computers to solve problems without explicitly programmed to. In the original sense, a computer program follows the "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"functional paradigm"}]},{"type":"text","value":", i.e. it is the application of a sequence of functions to arguments. The computer programs in the specified language become the individuals in the population that can be represented as a parse tree such as "},{"type":"element","tagName":"a","properties":{"href":"https://en.wikipedia.org/wiki/S-expression","target":"_blank","rel":["nofollow","noopener","noreferrer"]},"children":[{"type":"text","value":"S-expressions"}]},{"type":"text","value":" as used in Lisp programming. The individuals are executed to obtain their phenotype. Two things have to be kept in mind during the execution:"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"ul","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"Syntactic closure: we have to examine all the values returned by the functions and terminals, such that they can all accept as arguments the values and data typed by a function from F, or a terminal from T."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"Sufficiency: Define a search space that corresponds to finding F and T. The search space has to be large enough, and the F and T should be sufficient from the problem domain."}]},{"type":"text","value":"\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Types of functions that could be used are arithmetic functions (e.g. +, *, -, /), logic functions (e.g. AND, OR, NAND) and programming functions. The terminals can be variables constants or functions that do not receive any parameter."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"element","tagName":"img","properties":{"src":"/gp_crossover-3f0c2a60e4fe279de1d2890183111669.svg","alt":"GP Crossover"},"children":[]}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"S-expressions - parent 1: "},{"type":"element","tagName":"strong","properties":{},"children":[{"type":"text","value":"(+ (* 2 y)(/ x 4))"}]},{"type":"text","value":" ; parent 2: "},{"type":"element","tagName":"strong","properties":{},"children":[{"type":"text","value":"(-(* 2 4) 6)"}]},{"type":"text","value":" offspring 1: "},{"type":"element","tagName":"strong","properties":{},"children":[{"type":"text","value":"(+ 6 (/ x 4))"}]},{"type":"text","value":" offspring 2: "},{"type":"element","tagName":"strong","properties":{},"children":[{"type":"text","value":"(- (* 2 4) (* 2 y))"}]}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"An example of a GP crossover is shown above (arrow at crossover points). The offspring programs are made up of sup trees from the parents and may have shapes that are quite different from the parents. Similar to GA, two S-expressions are required as input for the crossover operation. However, recombination cannot be random, as it needs to be a valid syntax of the language in use. This means that different crossover points can be chosen for each of the parents, as shown in the above example. In this example F = {+, -, *, /}, and T = {1, 2, 3, 4, 5, 6, x, y}."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Although mutation is also possible, it is seldom used. It could be quite useful for the purpose of diversity and dynamic variability of the programs. The image below shows a mutation operation in GP."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"element","tagName":"img","properties":{"src":"/gp_mutation-b927d8246e22cc49ce1a75ff8e4331c6.svg","alt":"GP Mutation"},"children":[]}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"S-expressions - original: "},{"type":"element","tagName":"strong","properties":{},"children":[{"type":"text","value":"(+ 6 (/ x 4))"}]},{"type":"text","value":" mutated: "},{"type":"element","tagName":"strong","properties":{},"children":[{"type":"text","value":"(+ 6 (+ x 4))"}]}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"A possible application of GP is in the design of classifiers."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"h3","properties":{"id":"other-eas-evolution-strategies-and-evolutionary-programming"},"children":[{"type":"element","tagName":"a","properties":{"href":"#other-eas-evolution-strategies-and-evolutionary-programming","ariaHidden":true,"className":["anchor"]},"children":[{"type":"element","tagName":"svg","properties":{"ariaHidden":"true","height":16,"version":"1.1","viewBox":"0 0 16 16","width":16},"children":[{"type":"element","tagName":"path","properties":{"fillRule":"evenodd","d":"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z"},"children":[]}]}]},{"type":"text","value":"Other EAs: Evolution Strategies and Evolutionary Programming"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"Evolution strategies (ES)"}]},{"type":"text","value":" were designed to solve problems in fluid mechanics, and later generalized for parameter optimization problems. The data structure employed in ES corresponds to a real-valued vector. In the general case, an individual is represented as "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{"mathvariant":"bold"},"children":[{"type":"text","value":"v"}]}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{"mathvariant":"bold"},"children":[{"type":"text","value":"x"}]}]},{"type":"element","tagName":"mo","properties":{"separator":"true"},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"σ"}]},{"type":"element","tagName":"mo","properties":{"separator":"true"},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"θ"}]},{"type":"element","tagName":"mo","properties":{},"children":[{"type":"text","value":")"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"\\mathbf{v} = (\\mathbf{x}, \\sigma, \\theta)"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.75em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:1em;vertical-align:-0.25em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathbf"],"style":"margin-right:0.01597em;"},"children":[{"type":"text","value":"v"}]}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mrel"]},"children":[{"type":"text","value":"="}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.2777777777777778em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mopen"]},"children":[{"type":"text","value":"("}]},{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathbf"]},"children":[{"type":"text","value":"x"}]}]},{"type":"element","tagName":"span","properties":{"className":["mpunct"]},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.16666666666666666em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.03588em;"},"children":[{"type":"text","value":"σ"}]},{"type":"element","tagName":"span","properties":{"className":["mpunct"]},"children":[{"type":"text","value":","}]},{"type":"element","tagName":"span","properties":{"className":["mord","rule"],"style":"margin-right:0.16666666666666666em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.02778em;"},"children":[{"type":"text","value":"θ"}]},{"type":"element","tagName":"span","properties":{"className":["mclose"]},"children":[{"type":"text","value":")"}]}]}]}]},{"type":"text","value":", where "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{"mathvariant":"bold"},"children":[{"type":"text","value":"x"}]}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"\\mathbf{x}"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.44444em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.44444em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathbf"]},"children":[{"type":"text","value":"x"}]}]}]}]}]},{"type":"text","value":" represents the attribute symbol, and "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"σ"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"\\sigma"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.43056em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.43056em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.03588em;"},"children":[{"type":"text","value":"σ"}]}]}]}]},{"type":"text","value":" and "},{"type":"element","tagName":"span","properties":{"className":["katex"]},"children":[{"type":"element","tagName":"span","properties":{"className":["katex-mathml"]},"children":[{"type":"element","tagName":"math","properties":{},"children":[{"type":"element","tagName":"semantics","properties":{},"children":[{"type":"element","tagName":"mrow","properties":{},"children":[{"type":"element","tagName":"mi","properties":{},"children":[{"type":"text","value":"θ"}]}]},{"type":"element","tagName":"annotation","properties":{"encoding":"application/x-tex"},"children":[{"type":"text","value":"\\theta"}]}]}]}]},{"type":"element","tagName":"span","properties":{"className":["katex-html"],"ariaHidden":"true"},"children":[{"type":"element","tagName":"span","properties":{"className":["strut"],"style":"height:0.69444em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["strut","bottom"],"style":"height:0.69444em;vertical-align:0em;"},"children":[]},{"type":"element","tagName":"span","properties":{"className":["base"]},"children":[{"type":"element","tagName":"span","properties":{"className":["mord","mathit"],"style":"margin-right:0.02778em;"},"children":[{"type":"text","value":"θ"}]}]}]}]},{"type":"text","value":" are the set strategy parameters."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"Evolutionary programming"}]},{"type":"text","value":" was introduced as an alternative form of "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"artificial intelligence"}]},{"type":"text","value":". In an environment that’s considered to be a finite sequence of symbols from a finite set of alphabets, an intelligent behaviour was believed to:"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"ol","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"prediction a certain environment;"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"have an appropriate response to the prediction."}]},{"type":"text","value":"\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Given a well-defined cost function, the evolutionary task therefore is that of evolving an algorithm that is capable of operating the sequence of symbols in the environment, in order to produce an output that maximizes the algorithm performance in relation to the next input."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"We will not not be exploring the selection, crossover and mutation of these algorithms in this post."}]},{"type":"text","value":"\n"},{"type":"element","tagName":"h3","properties":{"id":"when-should-we-consider-using-evolutionary-algorithms"},"children":[{"type":"element","tagName":"a","properties":{"href":"#when-should-we-consider-using-evolutionary-algorithms","ariaHidden":true,"className":["anchor"]},"children":[{"type":"element","tagName":"svg","properties":{"ariaHidden":"true","height":16,"version":"1.1","viewBox":"0 0 16 16","width":16},"children":[{"type":"element","tagName":"path","properties":{"fillRule":"evenodd","d":"M4 9h1v1H4c-1.5 0-3-1.69-3-3.5S2.55 3 4 3h4c1.45 0 3 1.69 3 3.5 0 1.41-.91 2.72-2 3.25V8.59c.58-.45 1-1.27 1-2.09C10 5.22 8.98 4 8 4H4c-.98 0-2 1.22-2 2.5S3 9 4 9zm9-3h-1v1h1c1 0 2 1.22 2 2.5S13.98 12 13 12H9c-.98 0-2-1.22-2-2.5 0-.83.42-1.64 1-2.09V6.25c-1.09.53-2 1.84-2 3.25C6 11.31 7.55 13 9 13h4c1.45 0 3-1.69 3-3.5S14.5 6 13 6z"},"children":[]}]}]},{"type":"text","value":"When should we consider using evolutionary algorithms?"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"Given a problem, some key points have to be considered before we consider using EAs:"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"ul","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"If the search space is large, not smooth nor unimodal, or the fitness function is noisy;"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"For smooth or unimodal search space, "},{"type":"element","tagName":"em","properties":{},"children":[{"type":"text","value":"gradient"}]},{"type":"text","value":" or hill-climbing algorithms performs much better than EAs;"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"If the search space is well known (i.e. TSP), heuristics can be introduced to augment any of the EAs to enable it to perform better."}]},{"type":"text","value":"\n"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"p","properties":{},"children":[{"type":"text","value":"The applications of EA are divided into 5 broad categories:"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"ol","properties":{},"children":[{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"Planning (i.e. routing, scheduling, packing)"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"Design (i.e. signal processing)"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"Simulation, identification and control (i.e. general plant control)"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"Classification (i.e. machine learning, pattern recognition)"}]},{"type":"text","value":"\n"},{"type":"element","tagName":"li","properties":{},"children":[{"type":"text","value":"Other applied fields such as arts, engineering and language."}]},{"type":"text","value":"\n"}]}],"data":{"quirksMode":false}},"frontmatter":{"title":"Evolutionary Computing","date":"Friday, Aug 10, 2018","quote":"... one general law, leading to the advancement of all organic beings, namely, multiply, vary, let the strongest live and the weakest die.","quoteRef":"C. Darwin, The Origin of Species, 1859; Wordswortth 1998 Edition, p. 186","imageAuthorLink":"genetic-programming.com","image":{"childImageSharp":{"resize":{"src":"/static/evolve-10e2db536c4cff4e008988cb0ec0f8b1-2c40b.png"},"fluid":{"base64":"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAABQAAAAJCAYAAAAywQxIAAAACXBIWXMAAC4jAAAuIwF4pT92AAAB3ElEQVQoz4WO3WoTURSF53m8EN+goD6AFyKIl9544QP0MhYF66VIsbS2QtGQIoYotiYx2kYbM2miaWkSJAkmaTPJNDPNmZ/MyY/ZyzMzTgkIOvDN2nudxWJLg8Fg+i9s2z5X27J8dT1XhW/92YOcJH74HyLs6Xgy8dSyLDiOA13vo1SpwZ7JuYU0izA9/p4tqh4dkriMRDFxzqmjaiRnC8SYeZ6XgubgimD2d8fzHIGmaUgntiBnc3i2vIKB2ceJ0oWcL+JB6D6+fExgMhlDMk0Ls9i2ez73Ck3DgNKoobATR7PRQDK1g7z8FS9WlqC2qviU2kX8XRTRV1FkkzEYZxok4BeAic90jNHQhGGoGI2GqJcOsLQwj0xqG+73Op7Bw8XHSG/H0D/T0Wo2sLq2jmyhjHarCcYYpHAsR+G3eWy+L1J8r4yNzTCFX65Srd6i8v4eJSLPqbL/mVj3mH6Uj+h7TqZiOknacZ1+Vg5J3v1A1dIBdZt10pUmSZeuhnDvSYRu3n2KC3MLdP32MjYiGSidHpimgvU6Hn21DUOo3e8JNLBTxcPURea0DaaeiHwX0sXLIbpy4xHmri3SrTtreLP1barrjA+HnA8czh0+5E6g3PUcD3f29+DNz/0GsDmHwwh+7FQAAAAASUVORK5CYII=","aspectRatio":2.21875,"src":"/static/evolve-10e2db536c4cff4e008988cb0ec0f8b1-31e36.png","srcSet":"/static/evolve-10e2db536c4cff4e008988cb0ec0f8b1-bcece.png 197w,\n/static/evolve-10e2db536c4cff4e008988cb0ec0f8b1-60483.png 393w,\n/static/evolve-10e2db536c4cff4e008988cb0ec0f8b1-31e36.png 786w,\n/static/evolve-10e2db536c4cff4e008988cb0ec0f8b1-4d6f5.png 1179w,\n/static/evolve-10e2db536c4cff4e008988cb0ec0f8b1-1e265.png 1572w,\n/static/evolve-10e2db536c4cff4e008988cb0ec0f8b1-2259e.png 2201w","sizes":"(max-width: 786px) 100vw, 786px"}}}}}},"pageContext":{"slug":"/blog/2018-08-10-evolutionary-computing/"}}