## August 20, 2009

###
(Aug 20 3-5PM) Meeting Summary : Wainwright – Estimating the “Wrong” Graphical Model

Things we covered today:

- In the regularized surrogate likelihood (Eq 16) , we use , from the Bethe surrogate formulation covered in the survey paper. We then went through the steps in the joint estimation and prediction in section 4.2. We noted that the noise model is localized for each element of : . Erik wondered whether this was done for simplicity or by necessity and we thought it was for simplicity.
- The parameter estimate based on the surrogate likelihood is asymptotically normal.
- We had a long discussion about the relationship between globally stable, Lipschitz, and strongly convex. Any variational method that has a strongly convex entropy approximation is globally stable. Also, any variational method based on a convex optimization is Lipschitz stable. I’m not sure if there’s a difference between Lipschitz stable and globally stable…
- None of us knew how to derive eq 22, but we got some intuition by observing that if , then this is when the SNR is pure noise and the observation is useless. This is reflected in eq 22 by removing the term involving . Similarly, if , then , which is intuitive.
- When the SNR , in section 6.2 they show that which means will be different.
- In Figure 4, the curve marked with the red diamonds (approximate model) is upper bounded, as stated in Theorem 7. Figure 4 also illustrates that performing approximate inference (TRW method) using the approximate model (parameters) can be superior to performing approximate inference using the true model (black circles).

### Like this:

Like Loading...

*Related*

RSS feed for comments on this post. TrackBack URI

Added a clarification to point 6.

Comment by Gary — August 27, 2009 @ 10:22 am |