Author: | Vesa Kaihlavirta |
---|---|
Last-Modified: | 2003-02-05 |
Revision: | 1.5 |
Status: | Incomplete |
Scope: | Minor |
Type: | Policy? |
Our tests' output is seriously cluttered. This PEG will propose standards that, when implemented, will result in clean test output.
Clean test output includes the test docstring -- which should take only one line -- and the result ("ok", or "fail" and traceback, or a reason why the test wasn't run).
Listing individual problems from current (2003/01/09) test output.
When test cost is considered, output is bizarre:
TEST COST <function testStarts at 2220309> 10 TOO COSTLY TEST <function testStarts at 2220309> Solution: new format for test output, test shouldn't print anything extra:: [test method docstring] ... skipping (cost too high: 10).
Garbage when initalizing test.gfx:
Init test.gfx ['__doc__', '__file__', '__name__', '__path__', 'client', 'fuzzy', 'gfx', 'impl', 'media', 'util', 'vob'] ['GraphicsAPI', '__doc__', '__file__', '__name__', '__path__'] Jan 9, 2003 2:09:05 AM java.util.prefs.FileSystemPreferences$3 run WARNING: Could not create system preferences directory. System preferences are unusable. GW: gzz.client.awt.FrameScreen@85097d Solution: - Fix init.gfx, it presumably outputs excess debug
gzz/media/impl/PageImageScroll.java has pa():
Checked document of 0 pages Solution: fix method, debug information
Bizarre error again, not unlike 1.:
TEST FAILS IN <function testStripBlock at 4952321> * NOT RUNNING DUE TO WRONG F: <function testStripBlock at 4952321> Solution: clarify or remove "NOT RUNNING DUE TO WRONG F:".
test/tools/gfx.py outputs "CBCF init".
Solution: as in 3.
Some of the tests output debug information, eg:
Test space saving and re-loading ... [] [[[01F3F91514A6E80BCDFD6D978DACD0C40B4999DAF1]], [[019FA251833B0791D550BE3D03EC67234BAACDADC1]], [[01709BC0FC0687E569572437F562456C6D24FEC7FB]]] [[[01F3F91514A6E80BCDFD6D978DACD0C40B4999DAF1]], [[019FA251833B0791D550BE3D03EC67234BAACDADC1]], [[01709BC0FC0687E569572437F562456C6D24FEC7FB]]] [[[01F3F91514A6E80BCDFD6D978DACD0C40B4999DAF1]], [[019FA251833B0791D550BE3D03EC67234BAACDADC1]], [[01709BC0FC0687E569572437F562456C6D24FEC7FB]]] [[[01F3F91514A6E80BCDFD6D978DACD0C40B4999DAF1]], [[019FA251833B0791D550BE3D03EC67234BAACDADC1]], [[01709BC0FC0687E569572437F562456C6D24FEC7FB]]] SliceVersion([SliceVersion.Conn('urn:urn-5:7ZnIxDowCCU4ozTsf6oE45zIRTId:2', 'urn:urn-5:7ZnIxDowCCU4ozTsf6oE45zIRTId:1', 'urn:urn-5:7ZnIxDowCCU4ozTsf6oE45zIRTId:3')], {urn:urn-5:7ZnIxDowCCU4ozTsf6oE45zIRTId:1=Enf1DImpl[null,SPAN1D(gzz.media.impl.TransientTextScroll@1e12e2c 0 3),null]}) ... (goes on and on) Solution: Fix test, debug information.
gzz/impl/mirror/MasterImpl.java outputs "Sending change:".
Solution: As in 5.
Enfilades' test spurts weird things:
Test enfilades consisting of no spans and a single span. ... Jan 9, 2003 2:09:36 AM java.util.prefs.FileSystemPreferences checkLockFile0ErrorCode WARNING: Could not lock System prefs.Unix error code 134984164. Jan 9, 2003 2:09:36 AM java.util.prefs.FileSystemPreferences syncWorld Jan 9, 2003 2:09:36 AM java.util.prefs.FileSystemPreferences syncWorld WARNING: Couldn't flush system prefs: java.util.prefs.BackingStoreException: Couldn't get file lock. Solution: No idea currently. Something is outputting debug info again excessivly.
SolidBGVob test outputs debug information, and the same problem as in 8.:
testSingle_solidbgvob (__main__.Boxcellview) ... Jan 9, 2003 2:10:06 AM java.util.prefs.Fi leSystemPreferences checkLockFile0ErrorCode WARNING: Could not lock System prefs.Unix error code 134984164. Jan 9, 2003 2:10:06 AM java.util.prefs.FileSystemPreferences syncWorld WARNING: Couldn't flush system prefs: java.util.prefs.BackingStoreException: Couldn't get file lock. ok testSingleNote (__main__.Coordinateplane) ... CBCF init New note PLace CPV: 'urn:urn-5:nbYfgs3K6YzPEUPJJ7vfLutFDZta:1' (Uusi paperi) null CPV STEP: 'urn:urn-5:nbYfgs3K6YzPEUPJJ7vfLutFDZta:2' (FOO) 'urn:urn-5:nbYfgs3K6YzPEUPJJ7vf LutFDZta:1' (Uusi paperi) CPV: 'urn:urn-5:nbYfgs3K6YzPEUPJJ7vfLutFDZta:2' (FOO) 'urn:urn-5:nbYfgs3K6YzPEUPJJ7vfLutFD Zta:3' (100) CBCF getsize ('urn:urn-5:nbYfgs3K6YzPEUPJJ7vfLutFDZta:2' (FOO), gzz.view.AbstractViewConte xt@1349665, array([50.0, 50.0], float)) CPV PLACE: 100 200 50.0 50.0 Place: 1 CPV STEP: null 'urn:urn-5:nbYfgs3K6YzPEUPJJ7vfLutFDZta:1' (Uusi paperi) Placed ok Solution: As in 7. and 8.
Find a way to disable output during the tests.