Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5

Information, decisions and bits

#1
C C Offline
A brief introduction to bits and why they're not the same as 0s and 1s...

https://plus.maths.org/content/informati...-questions

EXCERPT: A bit is the amount of information you need to choose between two equally probable alternatives. Imagine you are standing at the fork in the road...

[...] Navigating a series of forks in the road is, in some respects, similar to the game of 20 questions. In this game your opponent chooses a word (usually a noun), and you (the astute questioner) are allowed to ask twenty questions in order to discover the identity of this word. Crucially, each question must have a yes/no (i.e. binary) answer, and therefore the answer provides you with at most one bit of information.

Why at most? By analogy with the navigation example, where each decision at a road fork halved the number of remaining destinations, each question should halve the number of remaining possible words. A question to which you already know the answer is a poor choice of question. For example, if your question is, "Is the word in the dictionary?", then the answer is almost certainly, "Yes!", an answer which is predictable, and which therefore provides you with no information.

Conversely, a well-chosen question is one to which you have no idea whether the answer will be yes or no — there is a 50:50 chance of it being either. In this case, the answer provides exactly one bit of information. The cut-down version of 20 questions in the figure below shows...
Reply


Possibly Related Threads…
Thread Author Replies Views Last Post
  How artificial intelligence can explain its decisions C C 0 127 Sep 3, 2022 10:37 PM
Last Post: C C
  Breakthrough metamaterial makes its own decisions C C 0 99 Jan 15, 2022 02:51 AM
Last Post: C C
  People don’t make better decisions when given more data, so why assume A.I. would? C C 1 110 May 29, 2021 03:23 AM
Last Post: C C
  Peering in an AI's brain to help trust its decisions + Transistor behaves like neuron C C 0 540 Jul 3, 2017 06:17 PM
Last Post: C C
  Yes, Your Brain Does Process Information C C 1 529 Jul 16, 2016 07:52 PM
Last Post: Magical Realist
  Trudeau vs experts: Quantum computing in 35 seconds + Information & quantum systems C C 0 713 Apr 20, 2016 06:35 AM
Last Post: C C
  Multiple dimensions for QM entanglement: Vastly denser information processing C C 0 463 Jul 1, 2015 09:40 PM
Last Post: C C
  Does information have mass? Magical Realist 1 585 Feb 24, 2015 09:28 AM
Last Post: C C
  Substantive SEP revision on "Semantic Conceptions of Information" C C 0 494 Jan 9, 2015 05:03 AM
Last Post: C C



Users browsing this thread: 1 Guest(s)