**Contents (Click to skip to that section):**

## What is a Holomorphic Function?

**Holomorphic functions **(also called analytic functions*) usually refer to functions that are infinitely differentiable; They are a big part of complex analysis (the study of functions of complex numbers).

## Important Note About Ambiguity and Holomorphic Functions

if you’re working with holomorphic/analytic functions, make sure you know the author’s intent, and which definitions they are working with. “Holomorphic” is one of those terms that has many grey areas.

- Some authors call these types of functions
*holomorphic*if they are differentiable, and*analytic*if they have a**power series expansion**for each point of their domain. Other authors use both terms interchangeably, perhaps because a few theorems exist that prove all analytic functions are holomorphic and all holomorphic functions are analytic. - Which term you use may also
**depend on your field:**According to Eric Weisstein, “Holomorphic function” (or “holomorphic map”) is usually preferred by mathematicians; “Analytic function” seems to be the term of choice in physics, engineering and in a few older texts (e.g. Morse and Feshbach 1953, pp. 356-374; Knopp 1996, pp. 83-111; Whittaker and Watson 1990, p. 83). - To make things a little more complicated,
**other conditions are added to the definitions by some authors**. For example, Ji Shanyu notes that “…in some books, the, C^{1-}smoothness condition is added to the definition of holomorphic function.”

## Definition of Holomorphic Function

As noted above, several definitions exist. The following comes from W. Rudin, Real and complex analysis (chapter 10) and H. Priestley, Introduction to complex analysis, as summarized by T. Perutz. It’s one of the most succinct definitions you’ll find:

Let G be an open set in . A function f : G → C is called holomorphic if, at every

point z ∈ G, the complex derivative

exists as a complex number.

Where:

- = complex realm

Essentially, the definition relies on just the existence of complex derivatives at every point. This isn’t much different from a regular differentiable function (the difference being that the derivatives are “regular” instead of complex). “Complex differentiable” is almost the same as differentiable, but with some constraints. Specifically, it needs to satisfy Cauchy-Riemann equations.

In comparison, Wikipedia has this definition:

…a complex-valued function of one or more complex variables that is, at every point of its domain, complex differentiable in a neighbourhood of the point.

If you know what a neighborhood is, and what it means to be complex differentiable, then that definition is fairly straightforward, albeit a little wordy.

## Dedekind Eta Function

The

**Dedekind eta function**(also called the

*η function*) is defined in the upper half-plane of complex numbers, with a positive imaginary part.

The function was first described by Dedekind in 1877, and can be mathematically defined in a few different ways. For example, where *z *is a complex-number it can be represented by infinite products, as follows (Rademacher & Grosswald, 1972):

Another popular way to quantify the η function is as (2π)^{-½)} times the 24th root of Ramanujan’s Delta Function (Unterberger, 2008).

The function is holomorphic and non-vanishing on the upper-half complex plane (ℍ). To check, all that’s needed is to show Σq^{n} has both absolute convergence and uniform convergence on compact subsets of ℍ (Masdeau, 2014). The function can’t be continued analytically past ℍ.

## A Bizarre Function and Its Uses

The Dedekind eta function is a primary example of a modulo form, which essentially means it falls into the category of “**bizarre**” functions. The η function appears in esoteric fields like bosonic string theory and supergravity theory.

One of the major uses of the Dedekind eta function is in elliptic function theory and modulo forms, where one important use is to describe the pattern of an elliptic function’s periods (Rademacher & Grosswald, 1972). In addition, many functions can be expressed as Dedekind eta functions, including class invariants, theta-functions and the Rogers-Ramanujan continued fraction (Bustoz et al., 2001).

The *generalized Dedekind eta function* can be used to construct modular functions of different weights (Vestal, 2001).

## What is a Universal Function?

Loosely speaking, **a universal function is a function that imitates any other function.** The definition differs depending on what field you’re working in; sometimes, the term is used by some authors to mean a “very useful function.”

Complicating the definition is that, in addition to the multiple field-specific definitions (some are listed below), not everyone agrees on the same definition for holomorphic functions (which are an integral part of the mathematical definition below). **The takeaway:** it can be difficult to be specific about an exact definition unless you delve into a particular author’s writings.

## Universal Functions in Neural Networks

In artificial neural networks (NNs), a **universal function** (also called a *universal function approximator*) is a two-layer neural network that can approximate any other function with a very small error.

The definition *sounds* simple, but NNs are notoriously difficult to implement, work with, and comprehend. Shubham Panchal on Medium.com notes

“They contain crazy math and require expertise to be fine-tuned.”

Delving into the “crazy math” of deep learning is beyond the scope of this site. However, for an introduction to neural networks, I recommend you start here: A Basic Introduction to Neural Networks.

## Mathematical Definition of a Universal Function

In mathematics, the definition specifically relates to the approximation of holomorphic functions.

Various definitions exist, which may be due to the differing definitions of holomorphic functions.

This first, fairly straightforward definition is from Larson et al.:

A function of two variables *F*(*x*, *y*) is a universal function if two functions* h(x) *and *k(y)* exist for every function *G(x, y)* (and for all x, y) as follows:

*G*(*x*, *y*) = *F*(*h*(*x*), *k*(*y*))

Chee (1978) defines it more completely in terms of regions (Ω) in complex variable spaces (ℂ):

A function g ∈ 𝓕 is a universal function of 𝓕, relative to {φ} if for any f ∈ 𝓕, there exists a sequence {φ

_{k}}^{∞}_{1}from {φ} such that:

Where:

- Φ = a family of holomorphic automorphisms of Ω
- 𝓕 = a family of holomorphic functions in Ω

## References

Bustoz, J. et al. (Eds.) Special Functions 2000: Current Perspective and Future Directions. NATO Science Series II: Mathematics, Physics and Chemistry (Book 30) 2001.

Chee, P. (1978). Universal Functions in Several Complex Variables. J. Austral. Math. Soc. (Series A) 28, 189-196.Retrieved December 9, 2019 from: https://www.cambridge.org/core/services/aop-cambridge-core/content/view/381E870BD1348C100ADEB7530854FF6B/S1446788700015676a.pdf/div-class-title-universal-functions-in-several-complex-variables-div.pdf

Hundley, D. Neural Nets. Retrieved December 9, 2019 from: http://people.whitman.edu/~hundledr/courses/M339/FFNeural.pdf

Larson, P. et al. Universal Functions. Retrieved December 9, 2019 from: https://www.math.wisc.edu/~miller/res/univ.pdf

Masdeau, M. Modular Forms. 2010. Retrieved May 21, 2020 from: http://mat.uab.cat/~masdeu/files/main.pdf

Perutz, T. A rapid review of complex function theory. Retrieved October 11, 2019 from: https://web.ma.utexas.edu/users/perutz/CxAn.pdf

Shanyu, Ji. Chapter 3: Holomorphic Functions. Retrieved October 11, 2013 from: https://www.math.uh.edu/~shanyuji/Complex/complex-1/cx-17-online.pdf

Conway, J. Functions of One Complex Variable I.

Knopp, K. “Analytic Continuation and Complete Definition of Analytic Functions.” Ch. 8 in Theory of Functions Parts I and II, Two Volumes Bound as One, Part I. New York: Dover, pp. 83-111, 1996.

Morse, P. M. and Feshbach, H. “Analytic Functions.” §4.2 in Methods of Theoretical Physics, Part I. New York: McGraw-Hill, pp. 356-374, 1953.

Rademacher, H. & Grosswald, E. Dedekind Sums (The Carus Mathematical Monographs, No. 16). 1972. Mathematical Association of America.

Unterberger, A. Quantization and Arithmetic. 2008. Springer Science and Business Media.

Vestal, D. Construction of weight two eigenforms via the generalized dedekind eta function. Rocky Mountain Journal of Mathematics. Vol 31. Number 2. 2001.

Whittaker, E. T. and Watson, G. N. A Course in Modern Analysis, 4th ed. Cambridge, England: Cambridge University Press, 1990.

Weisstein, Eric W. “Holomorphic Function.” From MathWorld–A Wolfram Web Resource. http://mathworld.wolfram.com/HolomorphicFunction.html