Symbolic Regression

Youtube search... ...Google search

• Case Studies
• Regression
• Physics
• Symbolic Regression: The Forgotten Machine Learning Method | Rafael Ruggiero - Towards Data Science ...Turning data into formulas can result in simple but powerful models

Scientific progress, especially in the physical sciences, is a story of hypothesis producing testable predictions that are then either confirmed or rejected by observations (i.e. data). Even in predictive modeling, we generally fit a given model to observed data. What if we could go the other way? What if we could take the data, and find the equation that would most closely have produced the data that we observe? Symbolic regression offers us an opportunity to do just that. It searches the solution spaces of possible equations, by combining mathematical operators with functional forms in a somewhat random manner guided by evolutionary success (e.g. piecing together the most promising mathematical forms using genetic algorithms). In this way, the resulting equation is free from assumptions (e.g. assuming the model is linear, a-la linear regression), or biases about how the dependent variable is related to the independent variables, etc. Python: Symbolic Regression | Syed Mehmud

Symbolic regression (SR) is a type of regression analysis that searches the space of mathematical expressions to find the model that best fits a given dataset, both in terms of accuracy and simplicity. No particular model is provided as a starting point for symbolic regression. Instead, initial expressions are formed by randomly combining mathematical building blocks such as mathematical operators, analytic functions, constants, and state variables. Usually, a subset of these primitives will be specified by the person operating it, but that's not a requirement of the technique. The symbolic regression problem for mathematical functions has been tackled with a variety of methods, including recombining equations most commonly using genetic programming,[1] as well as more recently methods utilizing Bayesian methods[2] and neural networks.[3] Another non-classical alternative method to SR is called Universal Functions Originator (UFO), which has a different mechanism, search-space, and building strategy.[4] Further methods such as Exact Learning attempt to transform the fitting problem into a moments problem in a natural function space, usually built around generalizations of the Meijer-G function.[5] By not requiring a priori specification of a model, symbolic regression isn't affected by human bias, or unknown gaps in domain knowledge. It attempts to uncover the intrinsic relationships of the dataset, by letting the patterns in the data itself reveal the appropriate models, rather than imposing a model structure that is deemed mathematically tractable from a human perspective. The fitness function that drives the evolution of the models takes into account not only error metrics (to ensure the models accurately predict the data), but also special complexity measures,[6] thus ensuring that the resulting models reveal the data's underlying structure in a way that's understandable from a human perspective. This facilitates reasoning and favors the odds of getting insights about the data-generating system. It has been proven that symbolic regression is an NP-hard problem, in the sense that one cannot always find the best possible mathematical expression to fit to a given dataset in polynomial time.[7] | Wikipedia