- A nice tutorial on the derivation of a Gibbs Sampler for LDA and NB. From Bob Carpenter at the popular LingPipe Blog: Integrating Out Multinomial Parameters in Latent Dirichlet Allocation and Naive Bayes for Collapsed Gibbs Sampling
- And a more recent article, also by Bob Carpenter on why Gibbs Samplers are not useful for LDA Bayesian Inference for LDA is Intractable
- Another nice tutorial on Bayesian Inference for Natural Language Processing Tasks. This one is from Kevin Knight: Bayesian Inference with Tears
- An interesting paper on EM breaking down in NLP tasks by Mark Johnson: Why doesn't EM find good HMM POS-taggers?"