ChatGPT Pro: 0% Chance The Book of Mormon Is An Accurate Translation Of An Authentic Ancient Codex
Posted: Tue Mar 18, 2025 6:28 pm
Very interesting post from Analytics over at the MAD Board. It's amazing what the Pro version of ChatGPT is capable of doing.
Analytics wrote:
"In any case, I pay $200 per month for ChatGPT “Pro”, which gives you access to much more powerful tools and models than the free version. The most impressive model is called “ChatGPT o1 pro mode”, which is more than the newest large language model, and actually spends a few minutes looking at questions from different angles, putting together a specific list of things to consider, researching those topics, reassessing, doing some more research, and then when satisfied, putting together an answer. As an example, ChatGPT pro usually has no problem solving the daily “Connections” puzzle in the New York Times.
After asking whether or not the Book of Mormon is “true”, I decided to as a different question that isn’t as problematic as asking whether a book is “true." I asked it the following:
Using an appropriate a priori probability and all of the evidence that exists, what is the Bayesian posterior probability that the Book of Mormon is an accurate translation of an authentic ancient codex?
After 1 minute and 47 seconds of research, it came up with the following:"
Analytics wrote:
"In any case, I pay $200 per month for ChatGPT “Pro”, which gives you access to much more powerful tools and models than the free version. The most impressive model is called “ChatGPT o1 pro mode”, which is more than the newest large language model, and actually spends a few minutes looking at questions from different angles, putting together a specific list of things to consider, researching those topics, reassessing, doing some more research, and then when satisfied, putting together an answer. As an example, ChatGPT pro usually has no problem solving the daily “Connections” puzzle in the New York Times.
After asking whether or not the Book of Mormon is “true”, I decided to as a different question that isn’t as problematic as asking whether a book is “true." I asked it the following:
Using an appropriate a priori probability and all of the evidence that exists, what is the Bayesian posterior probability that the Book of Mormon is an accurate translation of an authentic ancient codex?
After 1 minute and 47 seconds of research, it came up with the following:"
https://www.mormondialogue.org/topic/76 ... -veracity/First, let’s be candid: there’s no tidy, numeric “consensus” probability for the Book of Mormon’s authenticity—no widely accepted poll that says “it’s 0.04% likely” or “23% likely.” A Bayesian approach is theoretically possible, but only if we can agree on (1) the prior probability of such an ancient-American-Hebraic-Christian codex existing in the first place, and (2) how we weigh each piece of evidence for or against that claim.
Below is a sketch of how one might think it through in Bayesian terms, ending in a rough approximation rather than a precise decimal.
1. Establish a Prior
What is our hypothesis (A)?
“A = The Book of Mormon is an accurate translation of an authentic ancient codex.”
What’s the prior probability, P(A)?
This is your starting assumption before looking at any specific evidence about the Book of Mormon itself. The prior might be guided by how often such miraculous historical claims turn out true versus fraudulent or mistaken. Most mainstream historians and scholars would say that the existence of a pre-Columbian Judeo-Christian civilization in the Americas that left a hidden set of golden plates in Reformed Egyptian is extraordinarily unlikely on its face—some would put it near zero.
Faithful Latter-day Saints, of course, might put a different (much higher) prior on the hypothesis. But if we’re talking from a purely naturalistic, scholarly perspective, we’d start with an extremely small number—let’s call it something like P(A) = 1 in 100,000 or even less, simply because claims of “ancient text supernaturally discovered and translated” are historically almost never borne out by neutral, external evidence.
2. Consider the Evidence (E)
We then ask: How likely is this evidence if the hypothesis is true vs. if it is false?
Evidence for authenticity (as some see it)
Complexity and internal consistency of the Book of Mormon. A large narrative with multiple voices and intricate story arcs might be hard to produce as a simple hoax.
Literary patterns (like chiasmus). Some argue these are signs of Hebrew poetic forms.
Personal testimonials. The witnesses to the gold plates, Joseph Smith’s conviction, and so forth.
Transformative impact on believers. Hard to measure, but it’s at least worth noting many treat it as genuinely revelatory.
Evidence against authenticity
Anachronisms. Horses, steel, certain crops, and other items mentioned in the Book of Mormon don’t align with known pre-Columbian archaeology in the proposed time periods.
Genetic and linguistic data. Native American DNA and languages don’t show clear links to ancient Israelites.
Nineteenth-century cultural resonances. The text strongly echoes early American frontier religious debates, theological ideas, and theories about native origins that were swirling around Joseph Smith’s environment.
No confirmed archaeological corroboration. While the Americas are vast, no mainstream archaeologist cites the Book of Mormon as a legitimate historical resource on ancient American peoples.
3. Update the Prior: Posterior Probability
Bayes’ Theorem says:
P(A∣E)=P(E∣A) P(A)P(E∣A) P(A)+P(E∣¬A) P(¬A).P(A∣E)=P(E∣A)P(A)+P(E∣¬A)P(¬A)P(E∣A)P(A).
P(A)P(A) is our prior (very small).
P(E∣A)P(E∣A) is the probability of seeing the evidence if the Book of Mormon is indeed an authentic ancient codex.
P(E∣¬A)P(E∣¬A) is the probability of seeing that same evidence if it’s not.
If we assume a very small prior
Let’s say we choose P(A)=10−5P(A)=10−5 (one in 100,000). You could argue for smaller.
On one hand, if the Book of Mormon truly were ancient, one would expect it to jibe better with established archaeology, language evolution, and genetic data. The mismatch is tough to explain under AA. That pushes P(E∣A)P(E∣A) down.
On the other hand, if it’s a 19th-century production, we can very easily explain anachronisms, 19th-century theological influences, etc. That means P(E∣¬A)P(E∣¬A) is relatively high: basically we’d expect exactly this scenario if Joseph Smith composed or cobbled it together in a 19th-century religious context.
So even though there are some interesting textual features (like chiasmus) that might be more likely under AA than ¬A¬A, these don’t outweigh the overwhelming mismatch with archaeology, linguistics, genetics, and so forth. The result is that after you multiply that tiny prior by the fairly low likelihood of these massive anachronisms if the text were truly ancient, you still get a very tiny posterior.
Mathematically, it might stay pinned extremely close to zero—certainly less than 1% (and I’m being generous). Many would say it’s orders of magnitude below that.
4. Sensitivity to Assumptions
Anyone who is strongly committed to the Book of Mormon’s authenticity might set a far higher prior or interpret the evidence differently—resulting in a higher posterior probability. But from the vantage point of mainstream historical and scientific methodology (i.e., no supernatural leaps), it remains vanishingly unlikely.
Bottom line: If you adopt standard scholarly priors about the unlikelihood of ancient Hebraic civilizations in the Americas leaving no archaeological, linguistic, or genetic trace—plus the body of critical evidence—the Bayesian posterior hovers near zero.
In plainer words: from a secular Bayesian standpoint, the chance that the Book of Mormon is really an ancient codex looks about as slim as Joseph Smith’s hat was deep.
A Quick Caveat
Bayesian analysis is only as objective as the priors and the weighting of the evidence you choose. Debates about the Book of Mormon often boil down to competing worldviews: is a miraculous explanation on the table, or do we treat it like any other claimed ancient text? If miracles can happen, folks update the prior. If not, the posterior stays in “negligible” territory.
Hence, you’ll rarely see a single “universal” Bayesian figure. But the short version is: most neutral scholarship (i.e., not operating from a faith-based perspective) puts the final probability in the “essentially 0%” range.
Conclusion:
From a naturalistic viewpoint that weighs the totality of secular historical, archaeological, genetic, and linguistic evidence, the Bayesian posterior probability that the Book of Mormon is an authentic translation of an ancient codex is vanishingly small—close to zero, give or take a rounding error. That’s just how the math shakes out once you factor in an appropriate prior and the breadth of the evidence.