Fixup test failure reporting
After we implemented dotted-circle, we were still ignoring any tests that had dottedcircle in it for any of the shapers. That meant that if we wrongly outputted dottedcircle, the test was being ignored. Ouch! Fixing that shows regressions across the board. Most are Uniscribe bugs: NOT inserting dotted-circle when it should. Some are arou machine bugs. This is in fact a nice way to catch Indic-machine deficiencies and when I fix the regressions, our clusters should be much closer to Uniscribe. For now, we regressed from: BENGALI: 353997 out of 354285 tests passed. 288 failed (0.0812905%) DEVANAGARI: 707339 out of 707394 tests passed. 55 failed (0.00777502%) GUJARATI: 366489 out of 366506 tests passed. 17 failed (0.0046384%) GURMUKHI: 60769 out of 60809 tests passed. 40 failed (0.0657797%) KANNADA: 951086 out of 951913 tests passed. 827 failed (0.0868777%) KHMER: 299106 out of 299124 tests passed. 18 failed (0.00601757%) LAO: 53611 out of 53644 tests passed. 33 failed (0.0615167%) MALAYALAM: 1048104 out of 1048416 tests passed. 312 failed (0.0297592%) ORIYA: 42320 out of 42329 tests passed. 9 failed (0.021262%) SINHALA: 271747 out of 271847 tests passed. 100 failed (0.0367854%) TAMIL: 1091837 out of 1091837 tests passed. 0 failed (0%) TELUGU: 970558 out of 970573 tests passed. 15 failed (0.00154548%) TIBETAN: 208469 out of 208469 tests passed. 0 failed (0%) To: BENGALI: 353990 out of 354285 tests passed. 295 failed (0.0832663%) DEVANAGARI: 707315 out of 707394 tests passed. 79 failed (0.0111678%) GUJARATI: 366447 out of 366506 tests passed. 59 failed (0.016098%) GURMUKHI: 60707 out of 60809 tests passed. 102 failed (0.167738%) KANNADA: 951042 out of 951913 tests passed. 871 failed (0.0915%) KHMER: 298962 out of 299124 tests passed. 162 failed (0.0541581%) LAO: 53611 out of 53644 tests passed. 33 failed (0.0615167%) MALAYALAM: 1048074 out of 1048416 tests passed. 342 failed (0.0326206%) ORIYA: 42320 out of 42329 tests passed. 9 failed (0.021262%) SINHALA: 271666 out of 271847 tests passed. 181 failed (0.0665816%) TAMIL: 1091835 out of 1091837 tests passed. 2 failed (0.000183178%) TELUGU: 970553 out of 970573 tests passed. 20 failed (0.00206064%) TIBETAN: 208469 out of 208469 tests passed. 0 failed (0%) Investigating.
This commit is contained in:
parent
27bd55bd2c
commit
efb8d3eb71
|
@ -295,9 +295,11 @@ class DiffHelpers:
|
||||||
def test_passed (lines):
|
def test_passed (lines):
|
||||||
lines = list (lines)
|
lines = list (lines)
|
||||||
# XXX This is a hack, but does the job for now.
|
# XXX This is a hack, but does the job for now.
|
||||||
if any (l.find("space|space") >= 0 for l in lines): return True
|
if any (l.find("space|space") >= 0 for l in lines if l[0] == '+'): return True
|
||||||
if any (l.find("uni25CC") >= 0 for l in lines): return True
|
if any (l.find("uni25CC") >= 0 for l in lines if l[0] == '+'): return True
|
||||||
if any (l.find("dottedcircle") >= 0 for l in lines): return True
|
if any (l.find("dottedcircle") >= 0 for l in lines if l[0] == '+'): return True
|
||||||
|
if any (l.find("glyph0") >= 0 for l in lines if l[0] == '+'): return True
|
||||||
|
if any (l.find("notdef") >= 0 for l in lines if l[0] == '+'): return True
|
||||||
return all (l[0] == ' ' for l in lines)
|
return all (l[0] == ' ' for l in lines)
|
||||||
|
|
||||||
|
|
||||||
|
|
Loading…
Reference in New Issue