Skip to content

Commit c7962d8

Browse files
committed
add images to noisy channel post
1 parent 0830499 commit c7962d8

File tree

4 files changed

+9
-3
lines changed

4 files changed

+9
-3
lines changed

_config.yml

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,6 @@ markdown: kramdown
2121
scholar:
2222
# style: apa
2323
locale: en
24-
2524
sort_by: year
2625
order: descending
2726
# group_by: year
@@ -40,4 +39,4 @@ scholar:
4039
# \\[\LaTeX code\\] (also for display)
4140
# \\(\LaTeX code\\) (for inline)
4241

43-
theme: jekyll-theme-minimal
42+
# theme: jekyll-theme-minimal

_posts/2020-12-16-noisy-channel-coding.md

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,13 @@ title: Shannon’s noisy channel-coding theorem
44
published: true
55
tags: presentation
66
---
7-
[Here](/assets/pdfs/2020.12.16-noisy_channel_coding-handout.pdf) are slides I put together going through the proof of the noisy-channel coding theorem (based on the proofs given in [Cover and Thomas 2006, Ch.7](https://archive.org/details/ElementsOfInformationTheory2ndEd/page/n225) and [MacKay 2003, Ch.10](http://www.inference.org.uk/mackay/itprnn/ps/161.173.pdf)), a central result in information theory, which is a statement about _noisy channels_ (a set up where a message passed from sender to receiver is disturbed by some random process during transmission).
7+
I put together [a presentation](/assets/pdfs/2020.12.16-noisy_channel_coding-handout.pdf) going through the proof of the noisy-channel coding theorem (based on the proofs given in [Cover and Thomas 2006, Ch.7](https://archive.org/details/ElementsOfInformationTheory2ndEd/page/n225) and [MacKay 2003, Ch.10](http://www.inference.org.uk/mackay/itprnn/ps/161.173.pdf)), a central result in information theory, which is a statement about _noisy channels_ (a set up where a message passed from sender to receiver is disturbed by some random process during transmission).
8+
9+
10+
<div style="text-align: center;"><img width="600" src="/assets/2020-12-16-noisy-channel.png"></div><br/>
11+
812

913
The theorem says that it’s possible to communicate across such a channel with _arbitrarily low probability of error_, at any rate of transmission bounded by the mutual information between encoded sequences and received sequences, as long as the length of the code is allowed to be as long as necessary.
14+
<div style="text-align: center;"><img width="600" src="/assets/2020-12-16-noisy-channel-coding-theorem.png"></div><br/>
15+
16+
Slides [here](/assets/pdfs/2020.12.16-noisy_channel_coding-handout.pdf).
236 KB
Loading
120 KB
Loading

0 commit comments

Comments
 (0)