Information Theory, Pattern Recognition, and Neural Networks

David MacKay, University of Cambridge

A series of sixteen lectures covering the core of the book "Information Theory, Inference, and Learning Algorithms (Cambridge University Press, 2003)" which can be bought at Amazon, and is available free online. A subset of these lectures used to constitute a Part III Physics course at the University of Cambridge.

Introduction to information theory
* The possibility of reliable communication over unreliable channels. The (7,4) Hamming code and repetition codes.

Entropy and data compression
* Entropy, conditional entropy, mutual information, Shannon information content. The idea of typicality and the use of typical sets for source coding. Shannon's source coding theorem. Codes for data compression. Uniquely decodeable codes and the Kraft-MacMillan inequality. Completeness of a symbol code. Prefix codes. Huffman codes. Arithmetic coding.

Communication over noisy channels
* Definition of channel capacity. Capacity of binary symmetric channel; of binary erasure channel; of Z channel. Joint typicality, random codes, and Shannon's noisy channel coding theorem. Real channels and practical error-correcting codes. Hash codes.

Statistical inference, data modelling and pattern recognition
* The likelihood function and Bayes' theorem. Clustering as an example

Approximation of probability distributions
* Laplace's method. (Approximation of probability distributions by Gaussian distributions.)
* Monte Carlo methods: Importance sampling, rejection sampling, Gibbs sampling, Metropolis method. (Slice sampling, Hybrid Monte Carlo, Overrelaxation, exact sampling)
* Variational methods and mean field theory. Ising models.

Neural networks and content-addressable memories
* The Hopfield network.

会期:
  • 自由时间安排
介绍:
  • 免费:
  • 收费:
  • 证书:
  • MOOC:
  • 视频讲座:
  • 音频讲座:
  • Email-课程:
  • 语言: 英语 Gb

反馈

目前这个课程还没有反馈。您想要留第一个反馈吗?

请注册, 为了写反馈

Show?id=n3eliycplgk&bids=695438
已经在列表:
Small-icon.hover Machine Learning
Machine learning: from the basics to advanced topics. Includes statistics...
NVIDIA
还有这个题目的:
Mas-160f07 Signals, Systems and Information for Media Technology
This class teaches the fundamentals of signals and information theory with emphasis...
6-895f04 Essential Coding Theory
This course introduces the theory of error-correcting codes to computer scientists...
6-441s10 Information Theory
6.441 offers an introduction to the quantitative theory of information and its...
Medium_79461800 Monte Carlo Methods in Finance
Non-bankers can learn to understand the mathematical models that have made the...
Mooc_statistical_mechanics_2609 Statistical Mechanics: Algorithms and Computations
In this course you will learn a whole lot of modern physics (classical and quantum...
还有标题«计算机科学»:
72c27b2f-3419-430f-a28f-10dbc7120457-a14087e5df76.small DNA Sequences: Alignments and Analysis
Learn how to align and analyze DNA sequences using web and software based tools...
Cbc86bfc-8b76-4cb9-88d8-faa8a8abd820-50fa32daa1bc.small Software Testing Fundamentals
Learn how to locate software bugs and defects using the latest testing techniques...
7ca98c09-a207-40c7-8a84-b9c48ecdf920-f25c990d1f5f.small Cloud Computing Management
Learn methods for managing cloud computing projects and build an understanding...
91f52ef3-fa3f-4934-9d19-8d5a32635cd4-d99e27f09d19.small Data Science: R Basics
Build a foundation in R and learn how to wrangle, analyze, and visualize data...
B4072f23-f746-43a1-9819-8e3d8b066f38-76465b3bdbcc.small Data Science: Visualization
Learn basic data visualization principles and how to apply them using ggplot2...

© 2013-2019