Definition of a "bit", in information theory

A link to the full video is at the bottom of the screen.
Or, for reference: https://youtu.be/v68zYyaEmEA

That video describes using information theory to write a bot that plays Wordle

Editing from long-form to short by Dawid Kołodziej
...
https://www.youtube.com/watch?v=BTryyW7gqg4