mirror of
https://github.com/c64scene-ar/llvm-6502.git
synced 2024-09-30 19:55:11 +00:00
2111b5758f
Summary: I spend some time trying to get the LIT test suite passing. Here are the changes that I needed to make on my machine. I made the following changes for the following reasons. 1. google-test.py: The Google test format now checks for "[ PASSED ] 1 test." to check if a test passes. 2. discovery.py: The output appears in a different order on my machine than it did in the test. 3. unittest-adaptor.py: The output appears in a different order on my machine than it did in the test. 4. The classname is now formed differently in `getJUnitXML(...)`. I'm not sure what is causing the output order to differ in discovery.py and unittest-adaptor.py. Does anybody have any thoughts? Reviewers: ddunbar, danalbert, jroelofs Reviewed By: jroelofs Subscribers: llvm-commits Differential Revision: http://reviews.llvm.org/D9864 git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@239663 91177308-0d34-0410-b5e6-96231b3b80d8
98 lines
4.0 KiB
Python
98 lines
4.0 KiB
Python
# Check the basic discovery process, including a sub-suite.
|
|
#
|
|
# RUN: %{lit} %{inputs}/discovery \
|
|
# RUN: -j 1 --debug --show-tests --show-suites \
|
|
# RUN: -v > %t.out 2> %t.err
|
|
# RUN: FileCheck --check-prefix=CHECK-BASIC-OUT < %t.out %s
|
|
# RUN: FileCheck --check-prefix=CHECK-BASIC-ERR < %t.err %s
|
|
#
|
|
# CHECK-BASIC-ERR: loading suite config '{{.*}}/discovery/lit.cfg'
|
|
# CHECK-BASIC-ERR: loading suite config '{{.*}}/discovery/subsuite/lit.cfg'
|
|
# CHECK-BASIC-ERR: loading local config '{{.*}}/discovery/subdir/lit.local.cfg'
|
|
#
|
|
# CHECK-BASIC-OUT: -- Test Suites --
|
|
# CHECK-BASIC-OUT: sub-suite - 2 tests
|
|
# CHECK-BASIC-OUT: Source Root: {{.*/discovery/subsuite$}}
|
|
# CHECK-BASIC-OUT: Exec Root : {{.*/discovery/subsuite$}}
|
|
# CHECK-BASIC-OUT: top-level-suite - 3 tests
|
|
# CHECK-BASIC-OUT: Source Root: {{.*/discovery$}}
|
|
# CHECK-BASIC-OUT: Exec Root : {{.*/discovery$}}
|
|
#
|
|
# CHECK-BASIC-OUT: -- Available Tests --
|
|
# CHECK-BASIC-OUT: sub-suite :: test-one
|
|
# CHECK-BASIC-OUT: sub-suite :: test-two
|
|
# CHECK-BASIC-OUT: top-level-suite :: subdir/test-three
|
|
# CHECK-BASIC-OUT: top-level-suite :: test-one
|
|
# CHECK-BASIC-OUT: top-level-suite :: test-two
|
|
|
|
|
|
# Check discovery when exact test names are given.
|
|
#
|
|
# RUN: %{lit} \
|
|
# RUN: %{inputs}/discovery/subdir/test-three.py \
|
|
# RUN: %{inputs}/discovery/subsuite/test-one.txt \
|
|
# RUN: -j 1 --show-tests --show-suites -v > %t.out
|
|
# RUN: FileCheck --check-prefix=CHECK-EXACT-TEST < %t.out %s
|
|
#
|
|
# CHECK-EXACT-TEST: -- Available Tests --
|
|
# CHECK-EXACT-TEST: sub-suite :: test-one
|
|
# CHECK-EXACT-TEST: top-level-suite :: subdir/test-three
|
|
|
|
|
|
# Check discovery when using an exec path.
|
|
#
|
|
# RUN: %{lit} %{inputs}/exec-discovery \
|
|
# RUN: -j 1 --debug --show-tests --show-suites \
|
|
# RUN: -v > %t.out 2> %t.err
|
|
# RUN: FileCheck --check-prefix=CHECK-ASEXEC-OUT < %t.out %s
|
|
# RUN: FileCheck --check-prefix=CHECK-ASEXEC-ERR < %t.err %s
|
|
#
|
|
# CHECK-ASEXEC-ERR: loading suite config '{{.*}}/exec-discovery/lit.site.cfg'
|
|
# CHECK-ASEXEC-ERR: load_config from '{{.*}}/discovery/lit.cfg'
|
|
# CHECK-ASEXEC-ERR: loaded config '{{.*}}/discovery/lit.cfg'
|
|
# CHECK-ASEXEC-ERR: loaded config '{{.*}}/exec-discovery/lit.site.cfg'
|
|
# CHECK-ASEXEC-ERR: loading suite config '{{.*}}/discovery/subsuite/lit.cfg'
|
|
# CHECK-ASEXEC-ERR: loading local config '{{.*}}/discovery/subdir/lit.local.cfg'
|
|
#
|
|
# CHECK-ASEXEC-OUT: -- Test Suites --
|
|
# CHECK-ASEXEC-OUT: sub-suite - 2 tests
|
|
# CHECK-ASEXEC-OUT: Source Root: {{.*/discovery/subsuite$}}
|
|
# CHECK-ASEXEC-OUT: Exec Root : {{.*/discovery/subsuite$}}
|
|
# CHECK-ASEXEC-OUT: top-level-suite - 3 tests
|
|
# CHECK-ASEXEC-OUT: Source Root: {{.*/discovery$}}
|
|
# CHECK-ASEXEC-OUT: Exec Root : {{.*/exec-discovery$}}
|
|
#
|
|
# CHECK-ASEXEC-OUT: -- Available Tests --
|
|
# CHECK-ASEXEC-OUT: sub-suite :: test-one
|
|
# CHECK-ASEXEC-OUT: sub-suite :: test-two
|
|
# CHECK-ASEXEC-OUT: top-level-suite :: subdir/test-three
|
|
# CHECK-ASEXEC-OUT: top-level-suite :: test-one
|
|
# CHECK-ASEXEC-OUT: top-level-suite :: test-two
|
|
|
|
# Check discovery when exact test names are given.
|
|
#
|
|
# FIXME: Note that using a path into a subsuite doesn't work correctly here.
|
|
#
|
|
# RUN: %{lit} \
|
|
# RUN: %{inputs}/exec-discovery/subdir/test-three.py \
|
|
# RUN: -j 1 --show-tests --show-suites -v > %t.out
|
|
# RUN: FileCheck --check-prefix=CHECK-ASEXEC-EXACT-TEST < %t.out %s
|
|
#
|
|
# CHECK-ASEXEC-EXACT-TEST: -- Available Tests --
|
|
# CHECK-ASEXEC-EXACT-TEST: top-level-suite :: subdir/test-three
|
|
|
|
|
|
# Check that we don't recurse infinitely when loading an site specific test
|
|
# suite located inside the test source root.
|
|
#
|
|
# RUN: %{lit} \
|
|
# RUN: %{inputs}/exec-discovery-in-tree/obj/ \
|
|
# RUN: -j 1 --show-tests --show-suites -v > %t.out
|
|
# RUN: FileCheck --check-prefix=CHECK-ASEXEC-INTREE < %t.out %s
|
|
#
|
|
# CHECK-ASEXEC-INTREE: exec-discovery-in-tree-suite - 1 tests
|
|
# CHECK-ASEXEC-INTREE-NEXT: Source Root: {{.*/exec-discovery-in-tree$}}
|
|
# CHECK-ASEXEC-INTREE-NEXT: Exec Root : {{.*/exec-discovery-in-tree/obj$}}
|
|
# CHECK-ASEXEC-INTREE-NEXT: -- Available Tests --
|
|
# CHECK-ASEXEC-INTREE-NEXT: exec-discovery-in-tree-suite :: test-one
|