We assumed he was right
Read the full entry
Earlier this month we audited a study that had gone viral: a reading of a small stone offering table from Crete, posted by its author himself, which turns the text carved around it into a prayer to a father-god and two deities. The author is Michael Schümann. What we found then was that every claim our data could check came out exact, and that everything giving the text its meaning sits where no check can reach. This entry is the other half of that job, and it starts from the opposite move. We granted him everything.
The prayer does not stand alone. It belongs to a set of seven papers, all posted by him on Zenodo, a public repository, without the independent expert review a journal would arrange. Together they give four old signs new sound values, build a word-by-word vocabulary, and set out about twenty pieces of grammar: endings that mark a plural, a possessive, a place, and so on. That is a large thing to claim, and it has a consequence that can be measured. An ending that really is an ending has to behave like one everywhere, not only in the nine inscriptions his papers discuss. So we assumed the whole set is true and asked what the rest of Linear A, the undeciphered writing of Bronze Age Crete, ought to look like. We worked from the locked copy of 1,721 surviving inscriptions this project always uses, fixed to one exact version so anyone can redo the counts.
Assuming someone is right is easy to do badly, so the rules came first. We tested only the rules he states for Linear A in general, twelve of them, each backed by a quotation from his own text; everything he says about one single inscription was left out. We wrote the decision rule down before running anything: how many matches would count as a real trace and how few would not. Then two fresh reviewers, brought in to attack our test rather than his theory, filed 34 objections, and we accepted all 34. Several went in his favour. One rule of his that covers all the inscriptions, and that we had missed, was added to the list of things to look for. And where two of his papers read the same sign in two incompatible ways, once as a plural ending, once as a possessive, both readings were carried through the whole calculation instead of one.
One admission belongs here too. To check that the test was feasible at all, the reviewers had to compute the random comparisons before we froze the design, so what we locked was the decision rule, not our ignorance of the numbers. We said so inside the frozen document, and at the review every result of ours has to pass before anyone interprets it, each rule we had rejected along the way was recomputed afterwards, to show in public what it would have given. The run itself was carried out by someone forbidden to interpret anything. He stopped twice on genuine ambiguities in our own frozen wording, both settled in a way that gave the same answer under every reading available; twelve counts pinned in advance all came out exactly as declared; the whole thing was executed three times and came out identical down to the byte, with 10,000 random reshuffles behind every comparison.
The first of the two results uses his own logic. On the offering stone he restores a missing ending on one word because that word without the ending turns up on its own elsewhere. Turn the argument around and it becomes a test: if his endings are real, the surviving words should come in pairs: the same word once with the ending and once without it. We took the six endings he commits to for Linear A as a whole and hunted those pairs among the 647 surviving words of more than one sign that are complete, meaning no damaged sign anywhere in them. We found 7 pairs, among them i-da-mi beside i-da, and ka-pa-qe beside ka-pa. Shuffling at random which sign ends each word produces about 3 such pairs on its own. To call the trace real we had asked for 9. Seven is what chance alone turns up about one time in sixteen, which is nowhere near enough. The weight of the test lay outside his own material, and it fell there: of the twelve pairs the run turned up in total, counting those formed by the prefix he posits and one spelling variant, exactly one comes from his nine inscriptions.
Fact The dashed line is the count we had required before running, 9 pairs. If those endings really are endings, the surviving inscriptions should show the same word twice, once with the ending and once bare. We found 7 such pairs, against the 9 we had committed to in advance. Then our own review caught a flaw in the way we were shuffling, one that had made chance look lower than it really is. The mistake had been in his favour, and correcting it took away the one branch where his grammar cleared the bar: chance alone gives about 6, almost exactly what we found, and under that corrected comparison a 7 turns up by chance about one time in three. The bottleneck is the surviving material as much as the theory, because most Linear A words turn up exactly once, so the bare word without the ending is usually not there to be found. That is why this is an undetermined result and not a refutation.
The reason for that thin harvest is not necessarily his theory. It is the state of what survives. Most Linear A words appear exactly once, so the plain form without the ending, the one his grammar needs, is usually not there to be found. Even a common word-final sign like -na, which turns up 47 times at the end of a word, yields only two usable pairs. The same thinness shows through his own wording. The ending he describes as appearing frequently throughout Linear A closes 13 words out of the 3,957 that survive. The standalone element he says occurs multiple times throughout is found 31 times, of which 25 are one contiguous batch of clay sealings from a single archive room, leaving six independent occurrences. We report that as a fact about how little material there is, not as a verdict on him, and it is why our answer is “we cannot tell” rather than “he is wrong”.
Our own mistake belongs in the middle of this, because it went his way. One of the two contested readings of that sign is the more charitable to him, and under it the count rises to 10 and just touches the bar. We would have reported that had it stood. It did not stand: the review found that our own reshuffling scheme made the comparison too easy, and with the scheme corrected, chance alone produces about 6 pairs rather than 3. Under the corrected comparison neither reading clears the bar. The error was ours, it was in his favour, and fixing it removed the one branch where his grammar left a visible mark.
The second result points the other way, and it carries the same weight as the first. The claim he repeats most across his papers, and states as a possibility rather than a certainty, is that Linear A had no sign for a sound like the sh in ship, and that scribes may have written that sound by doubling a sign: sa-sa, as in the shrine word ja-sa-sa-ra, and ti-ti, as in ti-ti-ku. Counted on those same complete words, 13 of them contain one of the two doublings, where reshuffling the signs at random gives about 3. A gap that size comes up by chance about once in ten thousand times. The control is what makes it worth reporting: every other sign in the script, taken together, doubles 15 times where chance would expect about 28. Doubling is rarer than chance everywhere except on exactly the two signs he names.
The two doubled spellings the theory names, sa-sa and ti-ti
Every other sign, doubled
Fact Doubling a sign is rare in these inscriptions, and where it happens it happens on the two spellings the theory picked out in advance: 13 different words carry sa-sa or ti-ti, where shuffling the signs into random order gives about 3, a gap that would turn up by luck about one time in ten thousand. Every other sign runs the other way, doubling less often than chance would predict. The fragile part, stated plainly: many of those 13 words are repeats of the same set formula, and if each repeated family is counted once, 13 drops to 7 and the odds fall to about one in 64, short of the one in a hundred we had required before running. And the pattern is a fact about the script doubling signs, not a confirmation of what sound the doubling stood for.
That pattern needs the same caution as the first result. Much of it rides on words that repeat: collapse every family of repeated words to a single instance and the 13 fall to 7, which chance would produce about once in 64 times, under the strict bar we had set. The single step that pushes it under is treating the place name ti-ti-ku and its longer relative i-ti-ti-ku-ni as one item rather than two. And what is real here is a fact about the script, that two particular signs get doubled far more than all the rest. It fits his explanation. It does not show that the doubling stood for the sound he says it stood for, and it says nothing about which language is being written.
The closest thing to a surprise came from three words. The reading of the offering stone turns on its long final word, ta-na-ra-te-u-ti-nu, which he cuts into pieces meaning “in the sanctuary of the god Tinu”. The same mountain shrine on Juktas left two more words built the same way, on two other stones, and his papers mention neither. So we asked whether his own grammar can take those two apart. We built an inventory of 46 entries out of everything his published papers state, and inside it no complete cut of those words exists: the best we reach covers 6 of their 7 signs, and the one left over is a single u. Then we noticed what we had left out. His paper on the offering stone floats, as a possibility, an old final -u meaning origin or belonging, and we had not put it in the inventory. Add that one entry of his and a complete cut appears. The limit we hit was our list, not his grammar, and for that reason this probe is recorded as undetermined, not as a failure of his reading.
Once again, on things that can simply be looked up, he is exact. Every word his papers say can be found outside their nine inscriptions is there, confirmed sign by sign: ti-ti-ku and i-ti-ti-ku-ni on two account tablets from Haghia Triada, wi-sa-sa-ne on a tablet from Khania, sa-sa-me and i-ku-ri-na on two more Haghia Triada tablets, di-di-ka-seon a stone jar from Zakros. Three of his editions differ from our copy over damaged signs, and one object of his set, a gold hairpin, is not in our locked copy at all. We leave those open instead of scoring them, because settling them needs the original scholarly edition in hand, and last time a difference of that kind turned out to be our own data source flattening the editors’ work, not his error.
So what does the rule we wrote in advance say? Undetermined. Not supported, not contradicted: undetermined. We should be candid that the harshest verdict on the menu, the trace is absent, was out of reach from the start, because with material this thin any negative would have been too weak to trust; the real choice was always between his grammar showing up and our being unable to tell. Every check the reviewers ran to try to move the verdict left it where it was. It says nothing about his four sign values, nothing about his proposal that an early Indo-European language lies over an older one in Linear A, nothing about what he argues for any single inscription, and it refutes none of it.
What it does say concerns the size of what he committed to. Grant the whole theory and the surviving inscriptions are still too thin to carry the print of its grammar, while the one thing it names that we could measure, the doubling, is real but fragile, and silent about sound. A reading that explains the nine texts it was built from, and commits to almost nothing measurable outside them, cannot be told apart, on this material, from a reading built on those nine. We do not mean that as an accusation. It is what the audit found on one stone in the previous entry, counted this time across everything else that survives.