To shake things up a bit, I have started an information theory reading group in my department at Duke. We will meet every Monday to read and discuss papers on information theory, both recent and the classics, particularly those pertaining to estimation and inference, learning, decision-making, and control.
We’ve had our first meeting yesterday, where it was decided that the theme for the fall semester of 2010 will be Control. We have also settled on the following papers (all available for download from the reading group website):
- J. Massey, “Causality, feedback and directed information”
- H. Touchette and S. Lloyd, “Information-theoretic approach to the study of control systems”
- J. Walrand and P. Varaiya, “Optimal causal coding-decoding problems”
- N. Elia, “When Bode meets Shannon: control-oriented feedback communication schemes”
- N. Martins and M. Dahleh, “Feedback control in the presence of noisy channels: ‘Bode-like’ fundamental limitations of performance”
- V. Anantharam and V. Borkar, “An information-theoretic view of stochastic resonance”
Most likely, as the meetings continue, I will be posting various blurbs, notes and musings on these papers and any related matters. We may also shuffle things around a bit — for example, spend some time discussing the basics of stochastic control for the benefit of those not familiar with it.