aboutsummaryrefslogtreecommitdiff
path: root/utils/test
AgeCommit message (Collapse)Author
2009-09-22Remove old test runner, this has moved to LLVM/utils/lit and all known clientsDaniel Dunbar
have been updated. - Please let me know of any problems. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@82524 91177308-0d34-0410-b5e6-96231b3b80d8
2009-09-04Add --vg-arg option to clang test runner.Daniel Dunbar
- Passes additional argument through to valgrind. Also, don't run valgrind with --leak-check=no by default. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@80981 91177308-0d34-0410-b5e6-96231b3b80d8
2009-08-14lit: flush stdout in no-fancy-progress-bar mode as well.Benjamin Kramer
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@79056 91177308-0d34-0410-b5e6-96231b3b80d8
2009-08-06Fix locating the 'lit.cfg' file when running on only a single file in theDaniel Dunbar
current directory. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@78271 91177308-0d34-0410-b5e6-96231b3b80d8
2009-08-04lit: Some sample tests, for testing the testerDaniel Dunbar
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@78050 91177308-0d34-0410-b5e6-96231b3b80d8
2009-08-03lit: Don't treat '\' as an escape in unquoted strings, on Win32. This turns outDaniel Dunbar
to not be a very good idea. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77957 91177308-0d34-0410-b5e6-96231b3b80d8
2009-08-01lit: Catch (internal) exceptions when using --no-sh.Daniel Dunbar
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77830 91177308-0d34-0410-b5e6-96231b3b80d8
2009-08-01lit: Fix thinko in finding config file.Daniel Dunbar
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77828 91177308-0d34-0410-b5e6-96231b3b80d8
2009-08-01lit: Add internal script execution.Daniel Dunbar
- Off by default, you can test it with the --no-sh argument. - For me it works for all but 3 tests, but there a number of FIXMEs and QOI issues: o Redirection isn't completely accurate -- in practice it can't portably be, but I would like to error out if someone writes something which isn't going to work. This is the source of the 3 test failures. o Some pipe configurations have the potential to deadlock. o It is significantly slower when multithreaded. I believe this is due to locking happening under the hood, there is probably some kind of solution but I haven't investigated yet. o Log output is ugly. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77784 91177308-0d34-0410-b5e6-96231b3b80d8
2009-08-01lit: Two more sh lex/parse bugs (but its so simple!)Daniel Dunbar
- Empty arguments weren't handled correctly. - Escapes outside quoted strings weren't handled. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77783 91177308-0d34-0410-b5e6-96231b3b80d8
2009-08-01lit: Fix two sh lexing bugs.Daniel Dunbar
- '\\\\' inside a "..." string becomes '\\'. - The '<' token wasn't being recognized. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77777 91177308-0d34-0410-b5e6-96231b3b80d8
2009-08-01lit: Fix a name lookup problem, which only occurred on a race condition. This isDaniel Dunbar
why dynamic binding sucks. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77773 91177308-0d34-0410-b5e6-96231b3b80d8
2009-08-01lit: Pull a few more variables into the TestingConfig object.Daniel Dunbar
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77772 91177308-0d34-0410-b5e6-96231b3b80d8
2009-08-01lit: Don't use threads when only running one test, or with -j 1.Daniel Dunbar
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77766 91177308-0d34-0410-b5e6-96231b3b80d8
2009-08-01MultiTestRunner: Add 'sh' parsing to ShUtil.Daniel Dunbar
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77765 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-31MultiTestRunner: Fix invalid warning when pointing 'lit' directly at a test.Daniel Dunbar
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77690 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-31MultiTestRunner: Add module for lexing 'sh' commands.Daniel Dunbar
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77668 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-31MultiTestRunner: Simplify, cleanup, and rename!Daniel Dunbar
- MultiTestRunner will eventually be renamed to 'lit', for LLVM integrated tester/testing. This has the pros of being pronouncable and short. - "Project" level configuration lives in 'lit.cfg', which is also what lit uses to find the root testing directory in some cases. This can be overridden for use in project files which want to precisely specify where things are. - TestRunner.py is not longer able to be invoked directly. - Moved some code to Util.py. - Introduced a configuration object. - Cleaned up --help, removed a few not-very-useful options. - Tried not to break anything that works. :) git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77665 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-30MultiTestRunner: Stop printing XFAILs on every run, this doesn't really have anyDaniel Dunbar
value. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77566 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-29Make the Python TestRunner work for individual testsDouglas Gregor
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77456 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-29MultiTestRunner: Reenable --vg option.Daniel Dunbar
- Simplified from before and using --error-exitcode so failures show up as failures. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77424 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-27Tweak MultiTestRunner --path argument.Daniel Dunbar
- Accept multiple values instead of embedding separator. - Make sure this gets used when searching for 'clang' binary. - Switch makefiles to using --path to stay in sync with cmake. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77234 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-25MultiTestRunner: Make sure to point at src dir, for out of tree builds.Daniel Dunbar
Factor out routine for executing the script commands. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77075 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-25MultiTestRunner: Cleanup test execution & output.Daniel Dunbar
- Stop writing everything to files. - Make test output more standard. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77074 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-25MultiTestRunner: Drop external script and DejaGNU compatibility options for now.Daniel Dunbar
- We don't use the former, and the latter doesn't actually work. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77073 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-25MultiTestRunner: Disable valgrind support for now, I don't feel like maintainingDaniel Dunbar
it currently. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77072 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-25MultiTestRunner/Win32: Add SYSTEMROOT to environment, replace '&&' in .batDaniel Dunbar
files. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77071 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-25Make having no RUN line a failure.Daniel Dunbar
Doug, please look at decltype-crash and instantiate-function-1.mm, I'm not sure if they are actually testing the right thing / anything. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77070 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-25Remove this Makefile, it is unused.Daniel Dunbar
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77067 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-25MultiTestRunner: Oops, clang wasn't being substituted properly. This is why theDaniel Dunbar
cxx-using-declaration test case started exhibiting different behavior. It still needs to be fixed, however... git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77066 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-25MultiTestRunner: Always use absolute path names for tests.Daniel Dunbar
Also, fix a function name I forgot to update. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77064 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-25MultiTestRunner: Validate '&&' at the end of RUN lines.Daniel Dunbar
- This is just to normalize, these will go away soon hopefully. Added all the missing '&&'s that have crept in. :) git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77062 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-25MultiTestRunner: Explicitly define child environment, the only variable we needDaniel Dunbar
to import is the PATH. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77061 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-25MultiTestRunner.py improvements.Daniel Dunbar
- Tweak output directories for temp files, derive the temporary base from the test's parent directory name, and the test name (instead of the whole path). git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77059 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-25MultiTestRunner.py improvements.Daniel Dunbar
- Not improved: the horribly lousy name. :) - Suppress stderr when capturing output. - Rewrite which() to do the right PATH search instead of being lazy and shelling out to 'which'. - On Windows, run scripts as batch files (via 'cmd /c ...'). git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@77058 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-16Add extra print for --time-tests output.Daniel Dunbar
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@76104 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-13Make stdin for test scripts empty, so that tests don't accidentally hang waitingDaniel Dunbar
for stdin. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@75506 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-11Add --time-tests option to test runner, for profiling 'make test'.Daniel Dunbar
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@75396 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-11restore proper valgrind support.Nuno Lopes
disclaim: I know nothing about Python, so apologies in advance if I break something git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@75368 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-10Use /usr/bin/env trick to find python. Patch by Krister Walfridsson.Eli Friedman
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@75271 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-06Having tests that depend on previously created files is bad idea. Fix them ↵Argyrios Kyrtzidis
to be self-sufficient. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@74810 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-05Make use of the Index library through the index-test tool.Argyrios Kyrtzidis
'index-test' is now able to provide additional info for a Decl, through multiple AST files: -Find declarations -Find definitions -Find references git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@74803 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-02Revert prev commit, we have much bigger problems because 2.3 is missingDaniel Dunbar
the subprocess module. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@74738 91177308-0d34-0410-b5e6-96231b3b80d8
2009-07-02Avoid @staticmethod to allow use with Python 2.3.Daniel Dunbar
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@74737 91177308-0d34-0410-b5e6-96231b3b80d8
2009-06-17Testing improvements:Daniel Dunbar
- Make python test runner force COLUMNS=0 to increase determinism. - Substitute clang-cc as we do for clang. - Improved detection of Ctrl-C. - Honor CLANG and CLANGCC environment variables. - Add proper command line arguments to TestRunner.py (see --help) git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@73640 91177308-0d34-0410-b5e6-96231b3b80d8
2009-06-16If any tests fail, the test runner returns a status code of 1Douglas Gregor
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@73584 91177308-0d34-0410-b5e6-96231b3b80d8
2009-06-16Update Clang to include the InitializeAllTargets andDouglas Gregor
InitializeAllAsmPrinters LLVM headers. Also includes some minor fixes for the CMake-based build with Xcode. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@73544 91177308-0d34-0410-b5e6-96231b3b80d8
2009-06-05Switch CMake testing over to use Daniels new(er) Python-based infrastructure.Douglas Gregor
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@72977 91177308-0d34-0410-b5e6-96231b3b80d8
2009-04-26Make this code a little more generic.Daniel Dunbar
git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@70103 91177308-0d34-0410-b5e6-96231b3b80d8
2009-04-23Don't build error/warning/assertion detection in the testing script.Daniel Dunbar
- This wasn't actually all that useful and isn't worth the extra (hard)code. git-svn-id: https://llvm.org/svn/llvm-project/cfe/trunk@69869 91177308-0d34-0410-b5e6-96231b3b80d8