Maximum Entropy Method

A deconvolution algorithm (sometimes abbreviated MEM) which functions by minimizing a smoothness function ("entropy") in an image. Maximum entropy is also called the all-poles model or autoregressive model. For images with more than a million pixels, maximum entropy is faster than the CLEAN algorithm.

MEM is commonly employed in astronomical synthesis imaging. In this application, the resolution depends on the signal-to-noise ratio, which must be specified. Therefore, resolution is image dependent and varies across the map. MEM is also biased, since the ensemble average of the estimated noise is nonzero. However, this bias is much smaller than the noise for pixels with a SNR>>1. It can yield super-resolution, which can usually be trusted to an order of magnitude in solid angle.

Two definitions of "entropy" normalized to the flux in the image are

H_1=sum_(k)ln((I_k)/(M_k))
(1)
H_2=-sum_(k)I_kln((I_k)/(M_ke)),
(2)

where M_k is a "default image" and I_k is the smoothed image. Several unnormalized entropy measures (Cornwell 1982, p. 3) are given by

H_3=-sumf_iln(f_i)
(3)
H_4=sumln(f_i)
(4)
H_5=-sum1/(ln(f_i))
(5)
H_6=-sum1/([ln(f_i)]^2)
(6)
H_7=sumsqrt(ln(f_i)).
(7)

Wolfram Web Resources

Mathematica »

The #1 tool for creating Demonstrations and anything technical.

Wolfram|Alpha »

Explore anything with the first computational knowledge engine.

Wolfram Demonstrations Project »

Explore thousands of free applications across science, mathematics, engineering, technology, business, art, finance, social sciences, and more.

Computerbasedmath.org »

Join the initiative for modernizing math education.

Online Integral Calculator »

Solve integrals with Wolfram|Alpha.

Step-by-step Solutions »

Walk through homework problems step-by-step from beginning to end. Hints help you try the next step on your own.

Wolfram Problem Generator »

Unlimited random practice problems and answers with built-in Step-by-step solutions. Practice online or make a printable study sheet.

Wolfram Education Portal »

Collection of teaching and learning tools built by Wolfram education experts: dynamic textbook, lesson plans, widgets, interactive Demonstrations, and more.

Wolfram Language »

Knowledge-based programming for everyone.