Methodology & source ledger
73 source records → 64 readable unique documents.
1 collection index + 4 unavailable references + 4 captured placeholders + 64 readable documents + 0 merged aliases = 73 inventoried records.
No exact full-document duplicates were established in this pilot snapshot. Identical titles or shared passages did not authorize merging.
- identity
- HTML: NFC/whitespace normalized complete ordered content, independent of title and formatting, with media/quotes/list/table relationships; ambiguous extraction retained. PDF: original bytes SHA256 only.
- citations
- Document-level source citations. Source-node locations are retained in structured blocks; no invented paragraph attribution.
- versions
- Substantive versions, translations, excerpts and shared passages remain distinct. Candidate similarity never merges.
- normalization
- NFC and whitespace only; case, punctuation and Ethiopic text retained.
- categories
- Editorial discovery tags based on title and source collection link labels, with evidence recorded. Not assertions about testimony authorship.
- presentation
- Pure empty unlabelled spacer fields are omitted visually; source-labelled missing values and all cell coordinates remain in the structured models and per-source projection evidence. Source-proven page-layout groups flow in source order.
- metadata
- Visible bylines, credited roles and dates use exact source-body excerpts pinned to original SHA256; catalog CMS creator/date declarations remain separate and do not imply authorship. Dates keep original spelling and precision.
- pdf text
- Existing pypdf catalog text for candidates only, never PDF identity or replacement rendering.
Extraction reuses the repository’s semantic parser, source-node curation and title evidence. Additional exact footer/menu removals retain before/after text and source locations. Original HTML/PDF files, catalog and stable source IDs remain preserved.
Download structured records and complete source-to-document ledger (JSON)
Comparison candidates (3)
All remain distinct. These may be versions, excerpts or renderings with additional text; the source evidence does not justify automatic deletion.
- Crime committed
and collaborated by the ELF Leaders ↔ Crime committed
and collaborated by the ELF Leaders
retained separately; shared passages, excerpt, translation or version require source comparison. Shared five-word phrases: Jaccard 0.068; containment 0.876.
- Eritrean Christians Describe Anti-Faith Torture Methods ↔ Eritrean Christians Describe Anti-Faith Torture Methods
retained separately; shared passages, excerpt, translation or version require source comparison. Shared five-word phrases: Jaccard 0.524; containment 0.75.
- Places of detention in Eritrea ↔ Eritrea: The Prisons Network
retained separately; shared passages, excerpt, translation or version require source comparison. Shared five-word phrases: Jaccard 0.555; containment 0.905.
All 73 input records
| Source record / original title | Decision and canonical document |
|---|---|
Melketa01ac9765f8a9aca4aaa24422html · captured | retained: distinct complete document Eritrea under brutal dictator 4 removals · 0 flags HashesOriginal: Normalized: |
Original title not recorded0301c18ae68b026eb5bce3c1html · captured | retained: distinct complete document Torture and Cruel, Inhuman, and Degrading Treatment 0 removals · 0 flags HashesOriginal: Normalized: |
ቤተ ስቅያት ኢሳያስ - ማእሰርቲ ጥቓ ንያላ..nyla.pdf03470dd91bdadd87a68b6f18other · not_in_supplied_mirror | unavailable: no replacement content invented 0 removals · 0 flags |
Crimes
Against the Eritrean People04c3e611aae66bd1a1e2e55bhtml · captured | retained: distinct complete document Crimes Against the Eritrean People 17 removals · 0 flags HashesOriginal: Normalized: |
place.htm06a1d49b76839af63fbe82fchtml · captured | retained: distinct complete document Places of detention in Eritrea 1 removals · 0 flags HashesOriginal: Normalized: |
>???? ??? ??? ???? ????074925bc0ee393fe2da46c18html · captured | retained: distinct complete document መቓልሕ ድምጺ ኣልቦ ነብሳት ካርሸሊ (ከም ኣካል ዛንታ ስርሒት ፎርቶ 3ይ ክፋል) 3 removals · 0 flags HashesOriginal: Normalized: |
Testomony07de1f0aaa0a5499c0b87e07html · captured Local original | collection directory: retained as provenance, not a narrative document 0 removals · 0 flags HashesOriginal: Normalized: |
Eritrea: Reliable news, analysis & information by awate - Testimony of Gelalo Prisoners0ac98cf7a16dc8009c9f51d9html · captured | retained: distinct complete document Eritrea: Reliable news, analysis & information by awate - Testimony of Gelalo Prisoners 9 removals · 0 flags HashesOriginal: Normalized: |
Eritrea: Reliable news, analysis & information by awate - Testimony: The Torment At Gedem Prison135b87eb31bd3f56d6b3b33bhtml · captured | retained: distinct complete document Eritrea: Reliable news, analysis & information by awate - Testimony: The Torment At Gedem Prison 9 removals · 0 flags HashesOriginal: Normalized: |
Crime committed
against civilians by the ELF and EPLF during the armed struggle158a6cb3d9f34e205f045fa8html · captured | retained: ambiguous extraction; automatic merging disabled Crime committed against civilians by the ELF and EPLF during the armed struggle 17 removals · 5 flags HashesOriginal: Normalized: |
Remarkable courage: the flight from Eritrea1c681a42c64f4246dc6c3519html · captured | retained: distinct complete document Remarkable courage: the flight from Eritrea 0 removals · 0 flags HashesOriginal: Normalized: |
Eritrea: Reliable news, analysis & information by awate - "Crime" & Punishment In Eritrea1d4013df7ba8ca7bfe459aa5html · captured | retained: distinct complete document Eritrea: Reliable news, analysis & information by awate - "Crime" & Punishment In Eritrea 9 removals · 0 flags HashesOriginal: Normalized: |
The ELF and EPLF leaders' crime1f39c3407985bec97650e4b1html · captured | retained: ambiguous extraction; automatic merging disabled The ELF and EPLF leaders' crime 17 removals · 1 flags HashesOriginal: Normalized: |
tourture methods20218667ac1def8b9be179e5html · captured | retained: ambiguous extraction; automatic merging disabled tourture methods 1 removals · 2 flags HashesOriginal: Normalized: |
[Part 1] HRCE's Elsa Chyrum Interviews Eyob Bahta ( Ex Eiraeiro Prison-Guard)21634ebeb58d84acbd93bf8fhtml · captured | retained: distinct complete document [Part 1] HRCE's Elsa Chyrum Interviews Eyob Bahta ( Ex Eiraeiro Prison-Guard) 0 removals · 0 flags HashesOriginal: Normalized: |
News Asmarino Com2647ce4c43154cab74080819html · captured Local original | captured placeholder: no substantive article body; retained source reference, not a unique testimony Only captured text: “News Asmarino Com” 0 removals · 0 flags HashesOriginal: Normalized: |
Eritrea: Reliable news, analysis & information by awate - Testimony of Eritreans Deported From Malta Jailed In Dahlak275a63d8ecc44bb099d3aae4html · captured | retained: distinct complete document Eritrea: Reliable news, analysis & information by awate - Testimony of Eritreans Deported From Malta Jailed In Dahlak 9 removals · 0 flags HashesOriginal: Normalized: |
Markato_1.pdf27bdfb5a791513e110d2f72fpdf · captured | retained: distinct complete document ዙንታ ምውጻእና ካብ ቤት ማእሰርቲ ማርካቶ — ቀዲማይ ክፋል 0 removals · 0 flags HashesOriginal: Normalized: |
ዝርዝር አስማት አብያተ ማእሰርቲ ኤርትራ2a0be565bac32d818c628ee9html · captured | retained: distinct complete document ዝርዝር አስማት አብያተ ማእሰርቲ ኤርትራ 0 removals · 0 flags HashesOriginal: Normalized: |
Purge EPLF2b88950ec3a803bbacc181b7html · captured | retained: ambiguous extraction; automatic merging disabled Purge EPLF 18 removals · 2 flags HashesOriginal: Normalized: |
Shocking News of Christian Prisoners at Assab, Eritrea.2cb8e92db412d2f297775a73html · captured | retained: distinct complete document Shocking News of Christian Prisoners at Assab, Eritrea. 0 removals · 0 flags HashesOriginal: Normalized: |
Crime committed
and collaborated by the ELF Leaders2db17df472600301e1858351html · captured | retained: ambiguous extraction; automatic merging disabled Crime committed and collaborated by the ELF Leaders 18 removals · 7 flags HashesOriginal: Normalized: |
The role of the Former revolutionary and opposition leaders2fbb295596576d984279b162html · captured | retained: distinct complete document The role of the Former revolutionary and opposition leaders 17 removals · 0 flags HashesOriginal: Normalized: |
alert.php2fce03a5646ff7f47d60e839html · captured | retained: distinct complete document In Eritrea, stories of arrests, crackdowns abound-groups 1 removals · 0 flags HashesOriginal: Normalized: |
1509AH4-ASP3.pdf31767b4e8653cfc3b39df89fpdf · captured | retained: distinct complete document ቤት ማእሰርቲ ማርካቶ — Part.3 0 removals · 0 flags HashesOriginal: Normalized: |
Situation in prisons and types of torture342401d933999e266f649785html · captured | retained: distinct complete document Situation in prisons and types of torture 0 removals · 0 flags HashesOriginal: Normalized: |
WiA:Testimony of University of Asmara Students39d6bdb4cf0f1bfef58678d8html · captured | retained: ambiguous extraction; automatic merging disabled WiA:Testimony of University of Asmara Students 13 removals · 1 flags HashesOriginal: Normalized: |
The mysterious death of Tuku’e Yehadego in 19713ecf2c305ae0e4e98322d9f9html · captured | retained: ambiguous extraction; automatic merging disabled The mysterious death of Tuku’e Yehadego in 1971 19 removals · 2 flags HashesOriginal: Normalized: |
Eritrea: slender land, giant prison4138351642668d2dbffc1b5ehtml · captured | retained: ambiguous extraction; automatic merging disabled Eritrea: slender land, giant prison 19 removals · 1 flags HashesOriginal: Normalized: |
chtor.htm4f68142bf92f1388c71c2a9ahtml · captured | retained: distinct complete document Eritrean Christians Describe Anti-Faith Torture Methods 1 removals · 0 flags HashesOriginal: Normalized: |
Eritrea: Reliable news, analysis & information by awate - Testimony: Ex-prisoner of Brigade Six Sawa56a97ce1e07b56e5f89689bdhtml · captured | retained: distinct complete document Eritrea: Reliable news, analysis & information by awate - Testimony: Ex-prisoner of Brigade Six Sawa 9 removals · 0 flags HashesOriginal: Normalized: |
Report on Crimes committed against the Eritrean people by the Ethiopian rulers62b20c7883870ded255ce512html · captured | retained: distinct complete document Report on Crimes committed against the Eritrean people by the Ethiopian rulers 18 removals · 0 flags HashesOriginal: Normalized: |
erao.php6556a7b4efff4160874223behtml · captured | retained: distinct complete document EraEro Guards: Files Awaiting Extermination 6 removals · 0 flags HashesOriginal: Normalized: |
Somebody's Martyrs6af622fac9112a80f10f1f2chtml · captured | retained: distinct complete document Somebody's Martyrs 0 removals · 0 flags HashesOriginal: Normalized: |
mussse.php710ed45b0c40669e91d885a2other · not_in_supplied_mirror | unavailable: no replacement content invented 0 removals · 0 flags |
prilist.php7155fcb5388d4864e4f06635html · captured | retained: distinct complete document Eritrea: The Prisons Network 3 removals · 0 flags HashesOriginal: Normalized: |
Crime committed
and collaborated by the ELF Leaders73be8761188caccfcbb0a372html · captured | retained: ambiguous extraction; automatic merging disabled Crime committed and collaborated by the ELF Leaders 18 removals · 3 flags HashesOriginal: Normalized: |
Markato_2.pdf759e6f4888308d5d603acd8dpdf · captured | retained: distinct complete document ብጸሊኢ ምትሓይ — (ካሌኣይ ክፋሌ) 0 removals · 0 flags HashesOriginal: Normalized: |
Assenna7a1b360988743ff67627d8f3html · captured Local original | captured placeholder: no substantive article body; retained source reference, not a unique testimony Only captured text: “Assenna” 0 removals · 0 flags HashesOriginal: Normalized: |
11/10: AN OPEN LETTER TO MINISTER FOZIA HASHIM7a4fbdc648ec47710b53fd3fhtml · captured | retained: distinct complete document 11/10: AN OPEN LETTER TO MINISTER FOZIA HASHIM 0 removals · 0 flags HashesOriginal: Normalized: |
gurd1.html8593466fc20a33f8cc31b792html · captured | retained: distinct complete document Indifference to suffering - unless it's the Palestinians 0 removals · 0 flags HashesOriginal: Normalized: |
Weldekel Haile897aeee4b720470051d1b6f6html · captured | retained: distinct complete document Weldekel Haile 4 removals · 0 flags HashesOriginal: Normalized: |
maltin.htm8b0d05b9b58794647e566887html · captured | retained: distinct complete document From Malta to torture and death: Chilling documentary interviews ‘ex-Malta’ deportees 0 removals · 0 flags HashesOriginal: Normalized: |
TESTIMONY: Tewelde W. Tekhlegherghis8e62a82bf67adebc25c58f3bhtml · captured | retained: ambiguous extraction; automatic merging disabled TESTIMONY: Tewelde W. Tekhlegherghis 13 removals · 1 flags HashesOriginal: Normalized: |
News Asmarino Com8f8417ddfab8cb5c7fe56af4html · captured Local original | captured placeholder: no substantive article body; retained source reference, not a unique testimony Only captured text: “News Asmarino Com” 0 removals · 0 flags HashesOriginal: Normalized: |
The mysterious death
of Abraham Tewelde92100ace55f708bd209479f1html · captured | retained: ambiguous extraction; automatic merging disabled The mysterious death of Abraham Tewelde 17 removals · 1 flags HashesOriginal: Normalized: |
17-aug-05 news E. by GIC97d61a6c4be7f4af6ab1463ehtml · captured | retained: distinct complete document A Sudanese National Narrates His story behind the Bars of the PFDJ 0 removals · 0 flags HashesOriginal: Normalized: |
Torture, Suffering and Imprisonment (Life under PFDJ)a6e46a6f99188c1e4951c637html · captured | retained: distinct complete document Torture, Suffering and Imprisonment (Life under PFDJ) 0 removals · 0 flags HashesOriginal: Normalized: |
ኣብ ዝተፈላለዩ ኣብያተ ማእሰርቲ ኤርትራ ንዘለዉ እሱራት ንምዝካር ዝዓለመ’ዩ ብ ይርጋኣለም ፍስሃ ዝቀረበ ጽሑፍa796a63d19326d7e3b423e24html · captured | retained: distinct complete document ኣብ ዝተፈላለዩ ኣብያተ ማእሰርቲ ኤርትራ ንዘለዉ እሱራት ንምዝካር ዝዓለመ’ዩ ብ ይርጋኣለም ፍስሃ ዝቀረበ ጽሑፍ 2 removals · 0 flags HashesOriginal: Normalized: |
4a8c50cd65a4d121b6d96fd63html · captured | retained: distinct complete document 4. Torture and ill-treatment of prisoners 0 removals · 0 flags HashesOriginal: Normalized: |
Issayas Afeworki Has the Worst, and One-of-its-kind Prison Systemb166cc14786a83b61e1f4f23html · captured | retained: ambiguous extraction; automatic merging disabled Issayas Afeworki Has the Worst, and One-of-its-kind Prison System 3 removals · 1 flags HashesOriginal: Normalized: |
ካብ አብ ሱዳን ዝነብር ስደተኛ ኤርትራዊ ዝተላእኸት ናይ ሕድሪ መልእኽቲb416247198d9e2253c78fb7chtml · captured | retained: distinct complete document ካብ አብ ሱዳን ዝነብር ስደተኛ ኤርትራዊ ዝተላእኸት ናይ ሕድሪ መልእኽቲ 2 removals · 0 flags HashesOriginal: Normalized: |
testo.htmb9cef1810345ea80d7a7ae94html · captured | retained: distinct complete document TESTIMONY: [from Crimes Committed in Zemene Isaias 2003] 0 removals · 0 flags HashesOriginal: Normalized: |
Open Doors (Deutschland) : Eritrea - Hadas und ihre Töchterbcd60edaa1a432e09dcd3f9chtml · captured | retained: distinct complete document Open Doors (Deutschland) : Eritrea - Hadas und ihre Töchter 2 removals · 0 flags HashesOriginal: Normalized: |
Microsoft Word - Dokument1be7ab3986f1b3aa89986c9afpdf · captured | retained: distinct complete document The prisoners of Nakura 0 removals · 0 flags HashesOriginal: Normalized: |
ከደዓት እንክቃልዑ - ኣብ ብሄረ ሳሆ ግፍዒ ዝሰርሑbe8e4906dbf5bdb63372d94bhtml · captured | retained: distinct complete document ከደዓት እንክቃልዑ - ኣብ ብሄረ ሳሆ ግፍዒ ዝሰርሑ 4 removals · 0 flags HashesOriginal: Normalized: |
What is behind the scenes for the denial of Naizgi's body burial in Eritrea?c0a10d4075e71d0e53b7a057html · captured | retained: ambiguous extraction; automatic merging disabled What is behind the scenes for the denial of Naizgi's body burial in Eritrea? 3 removals · 5 flags HashesOriginal: Normalized: |
[Ai] Asmarino
Independentc8c56f4618fef8d08aa95c22html · captured | retained: distinct complete document Testimonies of untold atrocities and suffering 10 removals · 0 flags HashesOriginal: Normalized: |
Microsoft Word - WIA.doccafb9171177163c71db0d4e7pdf · captured | retained: distinct complete document ቤት ማEሰርቲ ዊዓ (ካብ Eሱራት ነበር ዝተላEክት) 0 removals · 0 flags HashesOriginal: Normalized: |
Eritrea: Reliable news, analysis & information by awate - Testimony of Mr. Mohammed Musa Ibrahimcbe78b9cc702f3d3e3e60926html · captured | retained: ambiguous extraction; automatic merging disabled Eritrea: Reliable news, analysis & information by awate - Testimony of Mr. Mohammed Musa Ibrahim 9 removals · 1 flags HashesOriginal: Normalized: |
Eritrean Christians Describ...cc6eab34bc9db337fa338b1epdf · captured | retained: distinct complete document Eritrean Christians Describe Anti-Faith Torture Methods 0 removals · 0 flags HashesOriginal: Normalized: |
Carshelli: A Place of Abuse and Sufferingcdafcc08b821b1a18bb7a4f4html · captured | retained: ambiguous extraction; automatic merging disabled Carshelli: A Place of Abuse and Suffering 13 removals · 1 flags HashesOriginal: Normalized: |
To some Eritreans, freedom means prison and torture -
Africa, World - The Independentd169709760c13fd778905e8fhtml · captured | retained: distinct complete document To some Eritreans, freedom means prison and torture - Africa, World - The Independent 0 removals · 0 flags HashesOriginal: Normalized: |
News Asmarino Comd18f7e3d584c4050f153d91ahtml · captured Local original | captured placeholder: no substantive article body; retained source reference, not a unique testimony Only captured text: “News Asmarino Com” 0 removals · 0 flags HashesOriginal: Normalized: |
Viewing cable 08ASMARA546, ARREST, INTERROGATION, AND TORTURE OFdec672557bdad1af037a7194html · captured | retained: distinct complete document Viewing cable 08ASMARA546, ARREST, INTERROGATION, AND TORTURE OF 2 removals · 0 flags HashesOriginal: Normalized: |
The mysterious death of Mahmoud Ibrahim Muhammad Saeed (Chekini)e77ba7df32924257f92432e7html · captured | retained: ambiguous extraction; automatic merging disabled The mysterious death of Mahmoud Ibrahim Muhammad Saeed (Chekini) 3 removals · 1 flags HashesOriginal: Normalized: |
Stories from Underground Prison in Eritrea: Torture, Madness, Slave Labour, Death and a Father Searching for his Son (Life under PFDJ)ebd2f3bbbd74cd29eaf4e9f6html · captured | retained: ambiguous extraction; automatic merging disabled Stories from Underground Prison in Eritrea: Torture, Madness, Slave Labour, Death and a Father Searching for his Son (Life under PFDJ) 2 removals · 1 flags HashesOriginal: Normalized: |
Prisoners Death Records since 2001f0f8fac60c0886b72787fb49html · captured | retained: ambiguous extraction; automatic merging disabled Prisoners Death Records since 2001 18 removals · 23 flags HashesOriginal: Normalized: |
Service for Life | Human Rights Watchf1a1064b52cd6ed0d95eabb6html · meta_excluded | unavailable: no replacement content invented 0 removals · 0 flags HashesOriginal: Normalized: |
Eritrea: Reliable news, analysis & information by awate - Testimony of what I saw: Gebreendrias Berhane?s Storyf3c0c9fec348d89e88a014achtml · captured | retained: distinct complete document Eritrea: Reliable news, analysis & information by awate - Testimony of what I saw: Gebreendrias Berhane?s Story 9 removals · 0 flags HashesOriginal: Normalized: |
voiceoferitreanprisoners.phpf72e6c718c49ecf0e0baff72other · not_in_supplied_mirror | unavailable: no replacement content invented 0 removals · 0 flags |
Eritrea: Reliable news, analysis & information by awate - PFDJ?s Reign Of Terror (II) - Subjugation of the Eritrean Policeff0e71b5b17213c759c1c85fhtml · captured | retained: distinct complete document Eritrea: Reliable news, analysis & information by awate - PFDJ?s Reign Of Terror (II) - Subjugation of the Eritrean Police 9 removals · 0 flags HashesOriginal: Normalized: |
The mysterious death of Ibrahim Afafff4116475e0e66ad78d00bfhtml · captured | retained: distinct complete document The mysterious death of Ibrahim Afa 19 removals · 0 flags HashesOriginal: Normalized: |