Common logical errors students make when evaluating historical sources and how to fix them

This is probably the single most common mistake in student source analysis, and, from my own experience, it appears at every year level.

 

When students encounter a source that clearly favours one side of an issue, they dismiss it as "biased" and conclude that it, therefore, cannot be trusted.

 

The analysis usually stops there: the word "biased" is treated as a verdict rather than as a starting point for deeper thinking. 

 

The reason this is an ineffective evaluation is that every source has a bias, since every author writes from a particular perspective, which means that they have particular assumptions and particular goals when they create the source.

 

What they need to realise is if bias alone made a source unreliable, then no source in existence could ever be considered reliable enough for a historian.

 

So, the label "biased" tells us nothing specific about what the author got wrong or why their perspective is a problem for the particular question being investigated. 

 

Consider Julius Caesar's Commentarii de Bello Gallico (Commentaries on the Gallic War).

 

Caesar wrote this account of his own military campaigns in Gaul during the 50s BCE, and he clearly presented himself in the most favourable light possible.

 

He was writing, at least in part, to justify his actions to the Roman Senate and to build his political reputation back in Rome.

 

A student who simply writes "Caesar is biased, so the source is unreliable" has missed the point entirely.

 

Caesar's account is one of the most valuable sources historians have for understanding Roman military tactics, the geography of Gaul, and the political calculations of a late-Republican general.

 

Often, his bias is the most valuable part, as it tells us exactly how Caesar wanted to be perceived and what kind of political messaging he thought would appeal to a Roman audience. 

 

A more sophisticated approach is to identify the specific perspective of the author and then explain how that perspective affects the kind of information the source provides.

 

Instead of writing "Caesar is biased," a more effective response would be: "Caesar had a political incentive to exaggerate his victories and downplay his setbacks, which means the specific casualty figures and descriptions of battlefield heroics should be treated with caution. The source is still highly useful, however, for understanding the strategic reasoning behind Roman military campaigns, because Caesar had no reason to fabricate the logistical and geographic details of his operations." 

This error is the mirror image of the first one. Some students, when they encounter a source that appears neutral or objective in tone, conclude that it must therefore be reliable.

 

They treat the absence of obvious opinion as proof that the author is telling the truth. 

 

This reasoning fails because a neutral tone does not guarantee accuracy. This is becaue an author can be completely wrong about something and still present that incorrect information in calm, measured, objective-sounding prose.

 

Neutrality is a stylistic choice, not a guarantee of truthfulness. Government reports, for example, are often written in detached, bureaucratic language that gives the impression of objectivity, but the information they contain may be carefully selected to support a particular policy position. 

 

A good example is the Report of the Select Committee on Transportation (1838), a British Parliamentary report examining the convict transportation system to Australia.

 

The report is written in the formal, impersonal language typical of government documents, and a student might look at it and conclude that it has "no bias" because there are no emotional outbursts or obvious opinions.

 

In reality, the committee had already decided before the inquiry began that transportation was ineffective, and the witnesses they chose to call and the questions they asked were carefully selected to support that predetermined conclusion. The neutral tone disguises a very deliberate agenda. 

 

I have been surprised at how entrenched this mistake is in student thinking. Sometimes, I have had to resort to an obvious exaggeration to make my point.

 

On these occasions, I often ask a student: “Do you know what else has no bias: a rock. Does that mean a rock is a reliable source of information about the topic?”.

 

(Yes, I know that this is reductio ad absurdum, but it is surprisingly effective in breaking the student out of their erroneous thinking). 

 

The fix here is to stop equating tone with reliability. Instead, students should investigate the context of production: who commissioned the source, what was the purpose of creating it, and what decisions were made about what to include and what to leave out.

 

A more effective evaluation might read: "The Select Committee report uses formal parliamentary language that gives the appearance of objectivity, but the committee's selection of witnesses and lines of questioning indicate that the report was structured to build a case against transportation rather than to provide a balanced assessment of the system."

Students sometimes confuse the style of a source and the accuracy of that source.

 

When they encounter a source that uses academic vocabulary, statistical data, or technical terminology, they assume that the author must know what they are talking about.

 

The reasoning is essentially: "this sounds smart, so it must be correct." 

 

This is a deeply flawed approach because sophisticated language is a feature of how an author communicates, not a measure of whether the content is accurate.

 

Probably some of the best examples to show students how problematic this is are the many pseudoscientific texts that have been made throughout history that have used highly technical and academic-sounding language to present conclusions that are completely without foundation.

 

The ability to write in a formal register does not require the author to have conducted proper research or to have drawn valid conclusions from the evidence. 

 

One of the clearest examples of this is the work of Samuel Morton, a 19th-century American physician who published Crania Americana in 1839.

 

Morton used precise anatomical terminology, detailed cranial measurements, and detailed tables of data to argue that different racial groups had different skull capacities, which he claimed proved a hierarchy of intellectual ability.

 

His language was impeccably scientific for the period. His conclusions, however, were fundamentally wrong, as later re-analysis of his data by Stephen Jay Gould (and further reappraisals since) demonstrated that Morton's measurements were inconsistent and that his conclusions were driven by his pre-existing racial assumptions rather than by the evidence itself. 

 

Students should, therefore, learn to separate how a source is written from what it actually demonstrates.

 

A more effective evaluation would examine whether the source's conclusions follow logically from the evidence presented, whether the methodology is sound, and whether other sources corroborate the findings.

 

Writing style is never a substitute for this kind of substantive analysis.

This error appears frequently when students evaluate oral history collections or journalistic accounts, since they see that an author conducted dozens of interviews and conclude that the sheer volume of testimony makes the source trustworthy.

 

The logical error here is that more voices equal more accuracy. (In logic and philosophy, this is a version of the ad populum logical fallacy). 

 

The problem with this reasoning is that the number of people interviewed tells us nothing about who was selected, what questions were asked, or how the responses were used in the final product.

 

An author can interview a hundred people and still produce a misleading account if they only include the testimonies that support their argument, if they ask leading questions, or if they draw their interview subjects from only one side of a conflict. 

 

A useful example is Svetlana Alexievich's The Unwomanly Face of War (1985, revised 2015), which compiled the oral testimonies of hundreds of Soviet women who fought in World War II.

 

The book is a truly extraordinary source, but a student who simply writes "it is reliable because Alexievich interviewed hundreds of women" has not actually evaluated anything.

 

The original 1985 Soviet edition was subject to state censorship, which means certain testimonies were altered or omitted before publication.

 

It is worth mentioning that the revised 2015 edition restored much of this censored material, which means the two editions of the same book, based on the same interviews, present notably different pictures of the Soviet wartime experience.

 

The number of interviews did not change between editions; what changed was the political environment that determined which parts of those interviews could be published. 

 

A better approach is to evaluate the selection and use of interview material rather than its quantity.

 

Students should ask:

• Who was chosen to be interviewed and who was left out?
• Were the questions open-ended or leading?
• How much editorial control did the author exercise over the final presentation of the testimonies?
• Were any external pressures (censorship, publisher demands, political considerations) applied to the final product?

Senior students often treat academic credentials as a guarantee of accuracy. If the author has "Professor" or "Dr" in front of their name, or if the source comes from a university press, students assume the information can be taken at face value.

 

This reasoning places trust in the author's title rather than in the quality of the argument.

 

While this level of evaluation is commendable in the junior years (Grades 7-10), by the time they are at senior level, this is quite superficial. 

 

To help them understand why this approach is ineffective, they need to develop an appreciation of the fact that academics disagree with each other constantly: that is, in fact, how scholarship advances.

 

As a result, even a peer-reviewed article published by a professor at a prestigious university can still contain errors of interpretation, outdated conclusions, or ideological blind spots.

 

The existence of a credential tells us that the author has formal training in the discipline, but it does not tell us whether this particular argument is well-supported by the evidence. 

 

One of the most instructive examples is the case of David Irving, who published extensively on World War II and the Third Reich during the 1970s and 1980s. Irving's early works, such as Hitler's War (1977), were praised by some historians for their use of primary sources from German archives.

 

What students are surprised to learn is that he held no formal academic position, but his work was initially treated with great respect within parts of the academic community themselves.

 

Over time, however, later historians demonstrated that Irving had systematically misrepresented and manipulated his source material to minimise the crimes of the Nazi regime.

 

The Irving v Penguin Books trial in 2000 resulted in a detailed judicial finding that Irving had deliberately distorted the historical record.

 

This case illustrates the principle from the opposite direction: the absence of a formal academic title did not prevent Irving from initially being taken seriously by scholars themselves, and the credentials of those who initially endorsed aspects of his work did not prevent them from being wrong. 

 

The corrective here is to evaluate the argument, not the author's title. Students should ask:

• Does the author support their claims with verifiable evidence?
• Do other historians in the field agree with the conclusions, or is this a contested interpretation?
• Has the work been challenged or revised since publication?
• When was it published, and has new evidence come to light since then?

This is one of the most persistent misconceptions in student source evaluation.

 

Many students have been taught that primary sources are inherently more trustworthy than secondary sources because they were "there at the time."

 

This leads them to treat any primary source as automatically accurate, as if proximity to an event guarantees a correct account of it. 

 

This reasoning collapses the moment you think about it carefully. A primary source is simply a source produced during the period under study, which means that it tells us what someone at the time said, wrote, believed, or wanted others to believe.

 

That is not the same thing as telling us what actually happened. Eyewitnesses misremember events, officials write reports designed to cover up their own failures, and propaganda is, by definition, a primary source. 

 

A striking example is the Res Gestae Divi Augusti (The Deeds of the Deified Augustus), a text inscribed on bronze tablets and displayed publicly across the Roman Empire after the death of Augustus in 14 CE.

 

It is one of the most important primary sources for the reign of Rome's first emperor. It is also a piece of carefully constructed political propaganda.

 

Augustus wrote it himself, and it presents his entire career as a series of selfless acts undertaken to restore the Roman Republic: a version of events that virtually no modern historian accepts at face value.

 

Augustus omitted his role in the proscriptions, downplayed the civil wars, and framed his accumulation of unprecedented personal power as a gift from a grateful Senate and people.

 

A student who writes "the Res Gestae is reliable because it is a primary source written by someone who was there" has confused chronological proximity with honesty. 

 

The improvement they could make here is to understand that the value of a primary source lies not in its automatic accuracy but in what it can tell us about the period in which it was created.

 

The Res Gestae is unreliable as a factual account of Augustus's career, but it is extraordinarily useful as evidence of how Augustus wanted to be remembered and what kind of political messaging was considered effective in the early Roman Empire.

 

Students should always ask: what does this source tell us about the assumptions and intentions of its creator? That question will always produce a more sophisticated evaluation than simply noting that the source is "primary."

Each of these six errors shares the same underlying problem: students are using shortcuts to avoid doing the actual work of evaluation.

 

They latch onto a single surface-level feature of the source (its bias, its tone, its style, its author's credentials, its type) and treat that feature as if it settles the question of reliability.

 

In their senior years of study, genuine source evaluation requires students to go much further than this and to analyse the specific content and purpose of the source in relation to the specific question they are trying to answer.

 

Over time, they will learn there are no universal rules that make a source automatically reliable or unreliable, and that every evaluation they make must be tailored to the particular source and the particular historical inquiry at hand.

 

What do you think? Is there a frequent error you've encountered like this that I didn't mention?