Contentary approach

Содержание и основные понятия

Back to the table of contents
Alterna · Chapter 27 · page 27.2
Contentary approach
Information is like reducing uncertainty about Hartley's formula.
Contentary approach
Links information to a decrease in uncertainty: the more events, the more information the message about the particular outcome.
GEF
PIF
OGE No. 1
EEG No. 4
01
Hartley's formula
For
equals
Events (p1 = p2 = ... = pn = 1/N):
I = log₂N
where N is the number of equally likely options.
The point is: I is the number of bits that you have to transfer to point unequivocally to one of the N options.
Examples
coin (2 outcomes): I = log2(2) =
1 bit
Cube (6 dimensions): I = log2(6) E
2.585 bits
Card mask (4 masks): I = log2(4) =
2 bits
Day of the week (7): I = log2(7) .
2.807 bits
Standard deck map (52): I = log2(52) E
5.7 bits
02
Relationship to the alphabetical approach
Both approaches are linked through the formula
i = log₂N
:
Alphabet:
N is the capacity of the alphabet, i is the weight of one symbol.
Content:
N is the number of equally likely options, I is the choice information.
If all the symbols of the alphabet are equal, both approaches produce the same result.
The key difference.
The Alphabetic approach takes into account only the length of the text. The content is meaning: One message, "Your team has lost", can carry one bit (two equal versions), although the text is longer.
03
Hartley calculator
🎲
Calculate the amount of information
Number of options N
Введите N и нажмите «Вычислить».
04
Model tasks
Task of the EEG (type 1)
Condition:
How many bits of information carry a message about the color of the pulled ball?
Decision:
N = 32, I = log₂(32) =
5 bits
Task of the EGE (type 4)
Condition:
The message carries four bits of information. How many equally likely choices were made?
Decision:
I = log2N = 4, meaning N = 24 =
16 options
05
Guess the number: information step by step
🔍
Bibliography — Visualizing Information
The computer set the number from 1 to N. Each "more/less" question gives
1 bit
For N = 1,024 x 1,024 = 1,048 576
20 questions
!
Range N
Received: 0 bits
0 / 0 bits
06
EEG Randomizer: Combinatoric of Words
🧮
Rule of Work — Tasks From the EGE
Generates random tasks to calculate word limitations (type of EGE on Informatics). Use the rule of work!
Нажми «Новая задача» для начала.
07
Akinator: Guess what?
🔮
Think of any object, the computer will guess by counting the bits!
Think of an object on the list, say yes or no.
each response
The magazine will show how many bits of information you've passed on and how the space of options narrows.
What's there to think about?
Transmitted information
0 bits
There are still options:
?
Question
1
QUESTIONNAIRE
Each answer = 1 bit
🎯
Mini-test: 5 questions
XP: 0
🧩
Check yourself out.
5 questions on the substantive approach · 20 XP for each correct answer