Commit Graph

95 Commits (cd0fe21464e938c7eee6ccb282a1e7834972bba3)

Author SHA1 Message Date
Alexander Gessler 3ded2d9123 Add script to determine if regression suite failures are considered acceptable as per the whitelist or not. 2015-05-01 23:24:25 +02:00
Alexander Gessler edd4953a55 Merge branch 'master' of https://github.com/assimp/assimp 2015-04-16 12:38:05 +02:00
abma 8c45a4dc3b Merge remote-tracking branch 'origin'
Conflicts:
	code/C4DImporter.cpp
	code/OgreImporter.h
2015-04-16 01:03:00 +02:00
abma 83777da98b fix run.py permissions 2015-04-15 21:22:39 +02:00
Alexander Gessler acef8198e0 Add whitelist of expected regression suite failures. 2015-04-15 01:22:29 +02:00
Alexander Gessler 03ea065271 Ignore Example.ogex for regression tests. OpenGEX importer is flaky and outputs nodes in different order each time. 2015-04-15 01:20:58 +02:00
Alexander Gessler 52a5ff2db2 Update IFC entries in regression database. 2015-04-15 01:18:20 +02:00
Alexander Gessler fb45e4d512 Make command line parameters in gen_db script more predictable. 2015-04-14 10:22:33 +02:00
Alexander Gessler 5a8d5605a5 Update README for regression test suite. 2015-04-13 22:24:43 +02:00
Alexander Gessler 0c9bbadf5f Update regression database (again). 2015-03-28 13:47:52 +01:00
Alexander Gessler c07cddff9e Make regression test runner include "expected failure, ok" cases in its statistics. This previously caused discrepancy between the runner and the test generator. 2015-03-28 13:43:52 +01:00
Alexander Gessler d717c4b2dd Fix to have gen_db.py also include files that accidentally have uppercase file extensions, affecting ~200 files previously skipped. 2015-03-28 13:36:47 +01:00
Alexander Gessler 0943936b31 Fix an issue in the regression DB generator that caused the very last file extension in the list returned by `assimp listext` to be ignored because of a trailing CRLF. 2015-03-28 13:18:54 +01:00
Alexander Gessler fcdefc7b16 Re-enable LWS for regression testing (original reason no longer applies), blacklist some material file format otherwise causing noise. 2015-03-28 13:18:06 +01:00
Alexander Gessler 98039ee76e Update regression db. 2015-03-28 12:53:24 +01:00
Alexander Gessler fafe5584b6 gen_db.py no longer generating dumps for files blacklisted (settings.files_to_ignore). 2015-03-28 12:12:53 +01:00
Alexander Gessler 3554301afe Better regression test logging. 2015-03-15 15:07:17 +01:00
Alexander Gessler e976cc2117 Reduce garbage errors during regression checks. 2015-03-15 01:02:18 +01:00
Alexander Gessler 99e2803474 Regression suite: 2.7 compatibility, drop old logic to find assimp binary and require it to be explicitly specified. Process files in a stable order to make results diffable. 2015-02-05 12:33:19 +01:00
Jared Duke 5e114c04d2 Use Linux/GCC build for DB generation 2014-09-17 08:49:28 -07:00
Jared Duke 083d5630ef Use VC11 build for DB generation 2014-09-17 07:30:55 -07:00
Jared Duke c8661ab055 Rebase BLEND regression db entries
Now that .blend import works properly for non-BMesh-containing meshes,
all .blend regression test cases should now succeed. Rebase accordingly.
2014-09-16 17:47:55 -07:00
Jared Duke 046b7e5f47 Rebase FBX regression db entries
The FBX importer now properly parses field-of-view tokens. Rebase
only the failing FBX entries to accomodate the fix, also removing
the comment noting the (now incorrect) comment about improper import
of the FOV property.
2014-09-15 18:14:38 -07:00
acgessler 72eb2e0c4e Merge branch 'travis' of github.com:assimp/assimp into travis 2014-09-05 21:20:35 -07:00
acgessler 5a0c7058b5 regression tests: ignore pond.0.ply file due to overly long runtime. 2014-09-05 21:20:07 -07:00
Alexander Gessler fd84970596 Regression tests: run.py should not block on user input if used for CI. 2014-09-04 23:18:20 -07:00
acgessler 1c27d3c565 Regression test suite: look for assimp_cmd binary in current folder first. 2014-09-04 21:04:39 -07:00
Jonne Nauha 4f82b02958 Regression tests: Fix finding aassimp.exe on VC9 default build. Look for x86 executable if x64 is not found. Create dump output dir if does not exist (broke the script). Report where assimp.exe was looked in. Add todos for ignoring multi dot extensions from test like .skeleton.xml. Rebuild ds.zip via gen_db.py, success rate went from 40% to 99%. Seems these were not updated in a while (2-3 years :). 2014-05-21 05:41:26 +03:00
aramis_acg 2ffac898d6 [3393728] [PATCH 1/2] ommit->omit and splitted->split
git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@1064 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2011-08-20 22:00:33 +00:00
aramis_acg 14c6467aac # re-generate regression dump database from scratch since it seems that ~200 of the files were totally deprecated. This gives me 99.4% reproducible results with Blender.bob still failing.
git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@969 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2011-04-22 21:23:22 +00:00
aramis_acg 3ac2f700dd - update minidump database
- improve output formatting for run.py

git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@965 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2011-04-22 17:15:33 +00:00
aramis_acg 5a2d2d08e2 # regression test suite: fix critical bug that would cause all postprocessing flag except th first to be ignored.
git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@961 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2011-04-22 15:57:00 +00:00
aramis_acg 9e9f8dfb27 - update minidump database
git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@957 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2011-04-22 12:39:49 +00:00
aramis_acg 724b562e6f # add another two postprocessing presets to the regression suite's database of model minidumps. Totally we have ~1200 test cases now.
git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@954 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2011-04-21 22:43:39 +00:00
aramis_acg 692cf1f84a - update regression db.
git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@901 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2011-02-03 14:35:39 +00:00
aramis_acg 3aa4386d81 - update regression database. All detected regressions except for the Ogre bugcheck, which I fixed with the last commit, were intentional bugfixes. Important: seemingly, the Blender loaders does *not* yield reproducible output as of now. This is fine since it is experimental, but we should definitely fix it.
git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@852 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2010-11-21 18:33:52 +00:00
aramis_acg fdda697af7 Move test models with problematic license restrictions to test/models-nonbsd and update the test suites accordingly.
Update note in LICENSE accordingly.

git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@827 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2010-10-13 17:57:06 +00:00
aramis_acg 107e070506 Rebuild regression suite (with vc8 and fp:fast). 2 regressions currently reported, these will remain unsolved for this release.
git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@690 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2010-04-17 16:25:04 +00:00
aramis_acg c78f40171d gen_db.py is now able to do a partial database update. Dumps for specified file formats are re-generated, rest is kept.
Improve doc in regression suite.


git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@680 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2010-04-14 20:58:32 +00:00
aramis_acg 24edb60955 Add a tiny test script to load all files in a test directory using one importer instance repeatedly.
Fix importer unit test, wasn't yet migrated to DeadlyImportError's.

git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@626 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2010-03-23 18:26:48 +00:00
aramis_acg 8bb198e794 regression-suite: run.py now calls assimp with the -l switch
git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@608 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2010-03-13 17:16:19 +00:00
aramis_acg b56f35c2b8 Rebuild regression database (vc8, fp:precise).
git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@602 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2010-03-13 12:40:49 +00:00
aramis_acg f98e0925a7 Fix typo in utils.py
git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@601 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2010-03-13 12:16:26 +00:00
aramis_acg 2d19e7cbbe Make regression suite scripts work on posix as well.
git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@600 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2010-03-13 12:13:53 +00:00
aramis_acg 30ca88e782 Add first version of regression suite (python parts only). Work in progress.
git-svn-id: https://assimp.svn.sourceforge.net/svnroot/assimp/trunk@597 67173fc5-114c-0410-ac8e-9d2fd5bffc1f
2010-03-12 23:56:10 +00:00