TOPICS
Search

Graph Entropy


Graph entropy is a collective name for several entropy-like quantities attached to a graph. Two important but distinct constructions are Körner graph entropy, which arose in information theory, and structural graph entropies obtained from partitions of graph elements (Dehmer and Mowshowitz 2011).

For a finite graph G with vertex set V and a probability distribution P=(p_v)_(v in V), let VP(G) be the vertex-packing polytope: the convex hull of the 0-1 vectors of the independent vertex sets of G. An equivalent finite-dimensional definition of Körner graph entropy is

 H(G,P)=min_(x in VP(G))sum_(v in V)p_vlog_21/(x_v).

A term with p_v=0 is taken to be 0, while a vector with x_v=0 and p_v>0 makes the objective function infinite (Csiszár et al. 1990, Simonyi 1995). Operationally, graph edges specify pairs of source symbols that must be distinguished, and H(G,P) is the optimal asymptotic coding rate in bits per symbol (Körner 1973, Simonyi 1995).

For the empty graph K_n^_, H(K_n^_,P)=0, while for the complete graph K_n, H(K_n,P) is the Shannon entropy -sum_(v)p_vlog_2p_v. Maximizing over P gives max_(P)H(G,P)=log_2chi^*(G), where chi^*(G) is the fractional chromatic number (Simonyi 1995). Körner graph entropy is distinct from the Shannon capacity of a graph, although both arose in zero-error information theory.

A common structural construction starts with a finite set X associated with a graph and an equivalence rule alpha that partitions it into equivalence classes X_1,...,X_k. Its partition entropy is

 I(G,alpha)=-sum_(i=1)^k(|X_i|)/(|X|)log_2(|X_i|)/(|X|).

For example, X may be the vertex set and the equivalence classes may be the orbits of the automorphism group; this gives a classical measure of structural information content (Mowshowitz 1968, Dehmer and Mowshowitz 2011). If the graph represents a molecule, X may instead consist of graph vertices, graph edges, or selected fragments, with equivalence classes determined by chemistry. The resulting quantities describe how a molecule's atoms and bonds are arranged (Sabirov and Shepelevich 2021).

Many other definitions apply Shannon entropy to distributions derived from vertex degrees, graph distances, graph spectra, or other graph data. In particular, applying von Neumann entropy to a suitably normalized Laplacian matrix gives a spectral graph entropy. Consequently, the phrase "graph entropy" should be accompanied by the definition in use (Dehmer and Mowshowitz 2011).

In the Season 4 episode "Black Swan" of the television crime drama NUMB3RS, the character Amita Ramanujan refers to graph entropies while studying a map of Los Angeles.


See also

Entropy, Fractional Chromatic Number, Independent Vertex Set, Shannon Capacity, Shannon Entropy, Topological Index, von Neumann Entropy

Explore with Wolfram|Alpha

References

Csiszár, I.; Körner, J.; Lovász, L.; Marton, K.; and Simonyi, G. "Entropy Splitting for Antiblocking Corners and Perfect Graphs." Combinatorica 10, 27-40, 1990. https://doi.org/10.1007/BF02122693.Dehmer, M. and Mowshowitz, A. "A History of Graph Entropy Measures." Inform. Sci. 181, 57-78, 2011. https://doi.org/10.1016/j.ins.2010.08.041.Körner, J. "Coding of an Information Source Having Ambiguous Alphabet and the Entropy of Graphs." In Transactions of the Sixth Prague Conference on Information Theory, Statistical Decision Functions, Random Processes (Prague, 1971). Prague, Czechoslovakia: Academia, pp. 411-425, 1973.Mowshowitz, A. "Entropy and the Complexity of Graphs. I. An Index of the Relative Complexity of a Graph." Bull. Math. Biophys. 30, 175-204, 1968. https://doi.org/10.1007/BF02476948.Sabirov, D. Sh. and Shepelevich, I. S. "Information Entropy in Chemistry: An Overview." Entropy 23, 1240, 2021. https://doi.org/10.3390/e23101240.Simonyi, G. "Graph Entropy: A Survey." In Combinatorial Optimization (Ed. W. Cook, L. Lovász, and P. Seymour). DIMACS Series in Discrete Mathematics and Theoretical Computer Science, Vol. 20. Providence, RI: Amer. Math. Soc., pp. 399-441, 1995. https://doi.org/10.1090/dimacs/020/08.

Cite this as:

Weisstein, Eric W. "Graph Entropy." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/GraphEntropy.html

Subject classifications