• Skip to main content
  • Skip to primary sidebar
You are here: Home / B to L Cat / Belief in Belief / Belief in Belief – Eliezer Yudkowsky

Belief in Belief – Eliezer Yudkowsky

30th July 2017 by Red Johnson Leave a Comment

 

Carl Sagan once told a parable of a man who comes to us and claims: “There is a dragon in my garage.” Fascinating! We reply that we wish to see this dragon—let us set out at once for the garage! “But wait,” the claimant says to us, “it is an invisible dragon.”

Now as Sagan points out, this doesn’t make the hypothesis unfalsifiable. Perhaps we go to the claimant’s garage, and although we see no dragon, we hear heavy breathing from no visible source; footprints mysteriously appear on the ground; and instruments show that something in the garage is consuming oxygen and breathing out carbon dioxide.

But now suppose that we say to the claimant, “Okay, we’ll visit the garage and see if we can hear heavy breathing,” and the claimant quickly says no, it’s an inaudible dragon. We propose to measure carbon dioxide in the air, and the claimant says the dragon does not breathe. We propose to toss a bag of flour into the air to see if it outlines an invisible dragon, and the claimant immediately says, “The dragon is permeable to flour.”

Carl Sagan used this parable to illustrate the classic moral that poor hypotheses need to do fast footwork to avoid falsification. But I tell this parable to make a different point: The claimant must have an accurate model of the situation somewhere in his mind, because he can anticipate, in advance, exactly which experimental results he’ll need to excuse.

Some philosophers have been much confused by such scenarios, asking, “Does the claimant really believe there’s a dragon present, or not?” As if the human brain only had enough disk space to represent one belief at a time! Real minds are more tangled than that. As discussed in yesterday’s post, there are different types of belief; not all beliefs are direct anticipations. The claimant clearly does not anticipate seeing anything unusual upon opening the garage door; otherwise he wouldn’t make advance excuses. It may also be that the claimant’s pool of propositional beliefs contains There is a dragon in my garage. It may seem, to a rationalist, that these two beliefs should collide and conflict even though they are of different types. Yet it is a physical fact that you can write “The sky is green!” next to a picture of a blue sky without the paper bursting into flames.

The rationalist virtue of empiricism is supposed to prevent us from this class of mistake. We’re supposed to constantly ask our beliefs which experiences they predict, make them pay rent in anticipation. But the dragon-claimant’s problem runs deeper, and cannot be cured with such simple advice. It’s not exactly difficult to connect belief in a dragon to anticipated experience of the garage. If you believe there’s a dragon in your garage, then you can expect to open up the door and see a dragon. If you don’t see a dragon, then that means there’s no dragon in your garage. This is pretty straightforward. You can even try it with your own garage.

No, this invisibility business is a symptom of something much worse.

Depending on how your childhood went, you may remember a time period when you first began to doubt Santa Claus’s existence, but you still believed that you were supposed to believe in Santa Claus, so you tried to deny the doubts. As Daniel Dennett observes, where it is difficult to believe a thing, it is often much easier to believe that you ought to believe it. What does it mean to believe that the Ultimate Cosmic Sky is both perfectly blue and perfectly green? The statement is confusing; it’s not even clear what it would mean to believe it—what exactly would be believed, if you believed. You can much more easily believe that it is proper, that it is good and virtuous and beneficial, to believe that the Ultimate Cosmic Sky is both perfectly blue and perfectly green.  Dennett calls this “belief in belief”.

And here things become complicated, as human minds are wont to do—I think even Dennett oversimplifies how this psychology works in practice. For one thing, if you believe in belief, you cannot admit to yourself that you only believe in belief, because it is virtuous to believe, not to believe in belief, and so if you only believe in belief, instead of believing, you are not virtuous. Nobody will admit to themselves, “I don’t believe the Ultimate Cosmic Sky is blue and green, but I believe I ought to believe it”—not unless they are unusually capable of acknowledging their own lack of virtue. People don’t believe in belief in belief, they just believe in belief.

(Those who find this confusing may find it helpful to study mathematical logic, which trains one to make very sharp distinctions between the proposition P, a proof of P, and a proof that P is provable.  There are similarly sharp distinctions between P, wanting P, believing P, wanting to believe P, and believing that you believe P.)

There’s different kinds of belief in belief. You may believe in belief explicitly; you may recite in your deliberate stream of consciousness the verbal sentence “It is virtuous to believe that the Ultimate Cosmic Sky is perfectly blue and perfectly green.” (While also believing that you believe this, unless you are unusually capable of acknowledging your own lack of virtue.) But there’s also less explicit forms of belief in belief. Maybe the dragon-claimant fears the public ridicule that he imagines will result if he publicly confesses he was wrong (although, in fact, a rationalist would congratulate him, and others are more likely to ridicule him if he goes on claiming there’s a dragon in his garage). Maybe the dragon-claimant flinches away from the prospect of admitting to himself that there is no dragon, because it conflicts with his self-image as the glorious discoverer of the dragon, who saw in his garage what all others had failed to see.

If all our thoughts were deliberate verbal sentences like philosophers manipulate, the human mind would be a great deal easier for humans to understand. Fleeting mental images, unspoken flinches, desires acted upon without acknowledgement—these account for as much of ourselves as words.

While I disagree with Dennett on some details and complications, I still think that Dennett’s notion of belief in belief is the key insight necessary to understand the dragon-claimant. But we need a wider concept of belief, not limited to verbal sentences. “Belief” should include unspoken anticipation-controllers.  “Belief in belief” should include unspoken cognitive-behavior-guiders. It is not psychologically realistic to say “The dragon-claimant does not believe there is a dragon in his garage; he believes it is beneficial to believe there is a dragon in his garage.”  But it is realistic to say the dragon-claimant anticipates as if there is no dragon in his garage, and makes excuses as if he believed in the belief.

You can possess an ordinary mental picture of your garage, with no dragons in it, which correctly predicts your experiences on opening the door, and never once think the verbal phrase There is no dragon in my garage. I even bet it’s happened to you—that when you open your garage door or bedroom door or whatever, and expect to see no dragons, no such verbal phrase runs through your mind.

And to flinch away from giving up your belief in the dragon—or flinch away from giving up your self-image as a person who believes in the dragon—it is not necessary to explicitly think I want to believe there’s a dragon in my garage. It is only necessary to flinch away from the prospect of admitting you don’t believe.

To correctly anticipate, in advance, which experimental results shall need to be excused, the dragon-claimant must (a) possess an accurate anticipation-controlling model somewhere in his mind, and (b) act cognitively to protect either (b1) his free-floating propositional belief in the dragon or (b2) his self-image of believing in the dragon.

If someone believes in their belief in the dragon, and also believes in the dragon, the problem is much less severe.  They will be willing to stick their neck out on experimental predictions, and perhaps even agree to give up the belief if the experimental prediction is wrong—although belief in belief can still interfere with this, if the belief itself is not absolutely confident.  When someone makes up excuses in advance, it would seem to require that belief, and belief in belief, have become unsynchronized.

Filed Under: Belief in Belief

Reader Interactions

Leave a Reply

Your email address will not be published. Required fields are marked *

Primary Sidebar

Recent Posts

  • peanuts
  • zd
  • (no title)
  • ASSYRIOLOGY ITS USE AND ABUSE IN OLD TESTAMENT 5*
  • Zoroastrianism, Judaism, and Christianity are all connected 5*INFO

Archives

  • February 2023
  • January 2023
  • December 2021
  • October 2021
  • April 2021
  • March 2021
  • February 2021
  • January 2021
  • December 2020
  • November 2020
  • September 2020
  • August 2020
  • July 2020
  • June 2020
  • May 2020
  • April 2020
  • March 2020
  • February 2020
  • January 2020
  • November 2019
  • March 2019
  • January 2019
  • December 2018
  • November 2018
  • October 2018
  • August 2018
  • March 2018
  • December 2017
  • November 2017
  • October 2017
  • September 2017
  • August 2017
  • July 2017
  • June 2017
  • May 2017
  • April 2017
  • March 2017
  • February 2017
  • January 2017
  • December 2016

Categories

  • 10 Commandments
  • A Categories
    • A ICCEBERG – 5*
    • A ICCEBERG – IS THE WORLD A FRIENDLY PLACE?
    • A ICEBERG – 123 P R I V A T E
    • A ICEBERG – 6 DAY WAR
    • A ICEBERG – ABRAHAM
    • A ICEBERG – ADAM AND EVE
    • A ICEBERG – Adam's Penis Bone/Baculum
    • A ICEBERG – Against Our Better Judgment: l by Alison Weir
    • A ICEBERG – ALISON WEIR
    • A ICEBERG – AMAZON KINDLE BOOKS
    • A ICEBERG – ANCIENT EGYPTIAN GODS AND LAWS
    • A ICEBERG – ANCIENT GREEKS AND MYTH
    • A ICEBERG – ANCIENT LAWS AND THE 10 COMMANDMENT SIMILARITY
    • A ICEBERG – AZUSA STREET AND THE WELSH REVIVAL
    • A ICEBERG – BABYLON AND NINEVEH
    • A ICEBERG – BABYLONIANS AND HEBREWS
    • A ICEBERG – BIBLICAL CONTRADICTIONS
    • A ICEBERG – BILL ZEBUB
    • A ICEBERG – BOOKS TO READ
    • A ICEBERG – BRITISH EMPIRE
    • A ICEBERG – BULLSHIT – BELIEVING BULLSHIT ET AL
    • A ICEBERG – CANAAN/ISRAEL
    • A ICEBERG – CHRISTIAN ZIONISM/JEWISH ZIONISM
    • A ICEBERG – CHRISTIANITY REVEALED
    • A ICEBERG – CIRCUMCISION
    • a iceberg – Code of Hammurabi
    • A ICEBERG – CONSPIRACY THEORIES – TITANIC
    • A ICEBERG – CREATION OF ISRAEL AND THE REFORMATION
    • A ICEBERG – CROMWELL AND THE JEWS
    • A ICEBERG – DISPENSATION ISM
    • A ICEBERG – EDENS SERPENTS AND MYTHS
    • A ICEBERG – EDWARD IRVING
    • A ICEBERG – ELBA – ANCIENT CITY, SYRIA
    • A ICEBERG – EVANGELICALS TO BRING ABOUT THE NT APOCALYPSE
    • A ICEBERG – EVOLUTION
    • A ICEBERG – EXODUS
    • A ICEBERG – FALL OF MAN
    • A ICEBERG – FLOOD MYTHS
    • A ICEBERG – FRENCH REVOLUTION/ZIONISM
    • A ICEBERG – FROM THE EXODUS MYTH FACEBOOK
    • A ICEBERG – GENESIS
    • A ICEBERG – Genesis 1-11 and Its Mesopotamian Problem
    • A ICEBERG – GENESIS-LILITH
    • A ICEBERG – Genetic Roots of the Ashkenazi Jews
    • A ICEBERG – H.L. Mencken
    • A ICEBERG – HAMMURABI HIS LAWS AND HIS GODS
    • a iceberg – Heaven and Hell are not ancient Jewish and Christian ideas
    • A ICEBERG – Hebrew and Babylonian Traditions/Similarities
    • A ICEBERG – HECTOR AVALON
    • A ICEBERG – HOLOCAUST OF HUMANS NOT JUST JEWS
    • A ICEBERG – HOW AND WHY GOD EVOLVED
    • A ICEBERG – HOW THE BIBLE COPIED FROM OLDER STORIES
    • A ICEBERG – HOW USA CAME INTO WW1
    • a iceberg – human genocide
    • A ICEBERG – INVENTION OF THE HEBREW BIBLE
    • A ICEBERG – IS THE TORAH DIVINE
    • A ICEBERG – IS THE WORLD A FRIENDLY PLACE?
    • A ICEBERG – ISRAELI TERRORISM – CREATION OF ISRAEL AND 6 DAY WAR
    • A ICEBERG – JERICHO
    • A ICEBERG – JOHN NELSON DARBY
    • A ICEBERG – LAW
    • A ICEBERG – LIST OF BLOGS AND INFO
    • A ICEBERG – LLOYD GEORGE WW2
    • A ICEBERG – MAN MADE GODS
    • A ICEBERG – MEME
    • A ICEBERG – Michael David Magee
    • A ICEBERG – MISCELLANEOUS
    • A ICEBERG – MONTANISM
    • A ICEBERG – MOSES
    • A ICEBERG – MOSES VS SARGON
    • A ICEBERG – MOUNT SINAI AND THE LUNAR GOD SIN
    • A ICEBERG – MOUNT SINAI AND THE LUNAR GOD SIN
    • A ICEBERG – Nanna/Suen/Sin (god)
    • A ICEBERG – Napoleon and the Jews
    • A ICEBERG – NOAH AND THE FLOOD
    • A ICEBERG – ORIGINAL SIN
    • A ICEBERG – PALESTINE
    • A ICEBERG – PDF
    • A ICEBERG – Persistence of Myth
    • A ICEBERG – PIOUS FRAUD
    • A ICEBERG – Protocols of the Elders of Zion FACT OR FICTION
    • A ICEBERG – RABBINICAL JUDAISM
    • A ICEBERG – RED HEIFER
    • A ICEBERG – RED JOHNSON
    • A ICEBERG – REVIEW
    • A ICEBERG – SABBATH
    • A ICEBERG – SCOFIELD PRE MILL bs
    • A ICEBERG – SCRIBED
    • A ICEBERG – SIN
    • A ICEBERG – SIN DOES NOT EXIST
    • A ICEBERG – Stephen Sizer
    • A ICEBERG – Sumerian Influences on Western Religion
    • A ICEBERG – SUMERIAN LIFE AND BELIEFS
    • A ICEBERG – THE BIBLE IS NOT HISTORY
    • A ICEBERG – THE CHURCH OF TRUTH
    • A ICEBERG – THE CREATION OF GOD
    • A ICEBERG – THE GOD ENKI SUMERIAN
    • A ICEBERG – THE JEWISH PARASITE
    • A ICEBERG – THE MORAL ANIMAL BY ROBERT WRIGHT
    • A ICEBERG – THE PENTECOSTAL-CHARISMATIC MOVEMENT
    • A ICEBERG – UGANDA CHOSEN FOR THE JEWSS
    • A ICEBERG – Ugaritic story of Athtar
    • A ICEBERG – Walter Reinhold Warttig Mattfeld
    • A ICEBERG – Whitney Webb 5*+
    • A ICEBERG – WHY FARMING?
    • A ICEBERG – Why Humans Have No Penis Bone
    • A ICEBERG – WHY THE BIBLE CANNOT BE THE WORD OF GOD
    • A ICEBERG – WOODROW WILSON BRANDIS COL HOUSE SAMUEL UTTERMAYER
    • A ICEBERG – YAHWEH
    • A ICEBERG – ZIONISM AND CREATION OF ISRAEL
    • A ICEBERG -VICTORIAN HORROR STORIES
    • A ICEBERG 5*+
    • A iceberg Sapiens: A Brief History of Humankind – Yuval Noah Harari
    • A ICEBERG SUMERIAN DICTIONARY GODS AND DEMONS…..
    • A ICEBERG-SINAI
    • A ICEBERG-Walter Reinhold Warttig Mattfeld
    • A ICEBURG – RECEPTION HISTORY
    • A ICELAND – FROM THE EXODUS MYTH FACEBOOK
    • A ICELAND – VIDEOS
    • A ICELBERG – AGAINST THE GRAIN JAMES SCOTT
    • Abraham
    • Abrahamic Religions
    • Afterlife?
    • AI ICEBERG – BOOKS TO READ
    • Alexander Heidel
    • Allah
    • Animal Sacrifice
    • Animals
    • Anthropomorphic
    • Anunnaki
    • Apocalypticism
    • Ark of the Covenant
    • ASSYRIOLOGY ITS USE AND ABUSE IN OLD TESTAMENT
    • Astrology 
    • Atheistism
    • Author Unknown
    • HUMAN GENOCIDE
  • Ancient Civilizations
    • Animal Sacrifices
    • Human Sarcrifice
  • Authors
    • Baron Paul Henri D'Holbach
    • Bart D. Ehrman
    • Colin Wilson
    • Eustace Mullins
    • Frank Moore Cross
    • G. W. Foote
    • Jason Long
    • John Byrne MD
    • Joseph Campbell
    • Joseph Wheless
    • Joshua J. Mark
    • Karl Marx and Communism
    • M. D. Aletheia
    • Marlene Winell
    • Matt (Blogger)
    • Mike Magee
    • Peter Dudink
    • Prof. Ze'ev Herzog
    • Richard Carrier
    • Richard Dawkins
    • Robert Cooper
    • Robert Green Ingersoll
      • Freethought
    • Saladin
    • Sam Harris
    • Samuel Noah Kramer
    • Scott Atran
    • Valerie Tarico.
    • Vexen Crabtree  
    • Walter Reinhold Warttig Mattfeld y de la Torre
  • B to L Cat
    •  Conspiracy Theory
    • Ashkenazi
    • Babylon
    • Babylonian Legends of the Creation
    • Balfour Declaration
    • Belief in Belief
    • Belief Systems
    • Bible Archaeology
    • Bible Contradictions
    • Bible Inconsistencies
    • Biblical Myths
    • Biblical Nonsense
    • Birth of Civilisation
    • Black Race
    • Blood Sacrifice
    • Bolshevik Revolution
    • Bolshevism
    • Book Form
    • Books to Read
    • Bullshit
    • Canaanite Religion
    • Christianity
    • Christianity-Biggest Lie Ever Told
    • Circumcision
    • Code of Jewish Law is Called "HALACHA" (The Way)
    • Cognitive Dissonance
    • Collapse of Ancient Civilisation
    • Concept of Sin
    • Conspiracy
    • Constellation Legends
    • Contradictions in the Bible
    • Counsel of the Gods
    • Creation
    • Creation Myths
    • Creation of Israel
    • Cure from Religion – Judaism/Christianity/et al
    • David and Solomon – Kings of Israel
    • Did humans invent Gods?
    • Divine Number 12
    • Documentary Hypothesis
    • Does God Exist?
    • Doublethink
    • Egyptian Ancient
    • Elul
    • Empires
    • Epic of Gilgamesh
    • Evil God
    • evilbible.com
    • Evolution
    • Exodus
    • Exodus Did Not Happen
    • Fables
    • Free Will
    • Freemasonry
    • Genesis
    • God
    • God is Imaginary
    • God is Nonexistent
    • Gods of Ancient Egypt
    • Ham (Noah)
    • Hebrew Myths
    • Hermeticism
    • Hide and Seek God
    • Historical Deception
    • Historical Revisionism
    • History
    • History's Greatest Lies
    • Hitler
    • Hittite
    • Holocaust
    • Human Sacrifice
    • ICEBERG – Walter Reinhold Warttig Mattfeld
    • Iceberg – Zionism
    • ICEBERG – ZIONSIM
    • Illusion/Reality
    • In Gods We Trust
    • infidels.org
    • Israeli-Palestinian Conflict
    • Janus Parallelism
    • Jehovah
    • Jesus
    • Jewish Bullshit
    • Jewish law
    • Jews
    • Joshua
    • Judaism/Christianity/Islam
    • Judeo-Christian
    • Judeo/Christian god does not exist
    • Judiasm
    • Khazars
    • King David
    • King Saul
    • King Solomon
    • KJV
    • Kuzari Argument
    • Law
    • Laws of the Moral and Physical World
    • Leaving Religion
    • Link to Webpage
    • List of Books for Atheists/Agnostics/Free-Thinkers
    • Mass Revelation (Sinai, Fatima et al)
    • Pious Fraud and Lies
    • Racism
    • Sephardi
    • Solomon's Temple and its Cost
  • DESERT FABLE
  • M to Z
    • Bible Myths
    • Bible Parallels in Other Religions
    • Biblical Contradictions
    • Biblical Discrepancies
    • Books and Articles pdf
    • Breaking the Spell of Religion
    • Code of Law by Hammurabi
    • Colonel House
    • Creation Myths
    • Cyrus Scofield
    • El
    • Eustace Mullins
    • Evil
    • Exodus
    • Genesis
    • Gods/Goddesses
    • Hammurabi's Code and the Law of Moses
    • Israel
    • Israel
    • Man invented gods
    • Man invented religion
    • Memes
    • Mesopotamia
    • Mind Virus
    • Miscellaneous
    • Molech
    • Monotheism
    • Morality
    • Moses
    • Moses/Hitler
    • Myth of Sin
    • Myth of the Ten Lost Tribes
    • Myths
    • Nephilim
    • No Gods
    • No pork we're Jewish
    • Noah Flood
    • Noahide Laws
    • NWO
    • Old Testament
    • Old Testament/Torah/Tanach
    • Original Sin
    • Palestine
    • Parasites
    • Passover
    • Pdf
    • PDF articles
    • PDF Books
    • Persia
    • Personality Flaws Hide Behind Religion
    • Philosophy
    • Pictures (pic)
    • Plagiarise
    • Plato
    • Poetry and Verse
    • Psychology
    • Psychosis and Fanaticism
    • Pyramids
    • Quotations
    • Racism
    • Red Johnson
    • Red's anti-religious Rants
    • Red's Muse
    • Religion
    • Religion and Climate
    • Religion Exposed
    • Religion is a Man-made concept
    • Religion is used as an emotional hook to control
    • Religion Without God
    • Religious Lies
    • Religious Lies
    • Religious Trauma
    • Sabbath Origins
    • Samuel Untermyer
    • Satan/Devil/Old Nick Myth
    • Science and Morality
    • Science and Religion
    • Sea Peoples
    • Sicarii, or Dagger-men
    • Sin
    • Sinai
    • Sir Francis Bacon
    • Skepticism
    • Sky God(s)
    • Starred *
    • Storytelling and Fairy Tales
    • Sumerians
    • Summaries
    • Sun and Moon worship
    • Supernatural nonsense
    • Talmud
    • Terrorism
    • TGP
    • The "church" of Truth
    • The Bible Was Influenced By Other Religions
    • The Biggest Lie Ever Told
    • The Body of God
    • The Church of Truth
    • The First World War 1914-1918
    • The Foundations of Western Civilization
    • The Gilgamesh Epic
    • The God Hypothesis
    • The Impossible Voyage of Noah's Ark
    • The Jewish State/Israel
    • The Nonsense of Noah
    • The Philosophy of Horror
    • The Problem of Evil
    • The problem with Miracles
    • The Religion Virus
    • The Second World War – (1939-1945)
    • Theological Terrorism
    • There is no god
    • Timeline
    • Torah
      • The OT fabrication that the Israelite's were slaves in Egypt.
    • Torah – Biggest Lie Ever Told
    • Torah is Ahistorical
    • Ugarit
    • Videos
    • Violence/Bible
    • War
    • Western Civilisations
    • Western Philosophy
    • White Race
    • Why do Jews circumcise on the 8th day?
    • William Shakespeare
    • Winston Churchill
    • Wizard of Oz
    • Woodrow Wilson
    • Yahweh
    • Yahweh
    • YouTube
    • Zeitgeist
    • Zionism
    • Zootheism
    • Zoroaster
    • Zoroastrianism

© 2023 &middot From The Exodus To The Ridiculous