TudbuT/conduit
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

skip complement test TestClientSpacesSummary still

Browse source 
too flakey still

Signed-off-by: strawberry <strawberry@puppygock.gay>
This commit is contained in:
strawberry 2024-07-04 01:51:32 -04:00
parent d1b3faf4bd
commit 9a0ffd55da
2 changed files with 2 additions and 10 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
bin/complement
View file

@ -20,9 +20,8 @@ OCI_IMAGE="complement-conduit:main"
# Complement tests that are skipped due to flakiness/reliability issues (likely
# Complement itself induced based on various open issues)
#
#go test -tags="conduwuit_blacklist" "$SKIPPED_COMPLEMENT_TESTS" -v -timeout 1h -json ./tests | tee "$LOG_FILE"
# According to Go docs, these are separated by forward slashes and not pipes (why)
#SKIPPED_COMPLEMENT_TESTS='-skip=TestJumpToDateEndpoint.*|TestJoinFederatedRoomFromApplicationServiceBridgeUser.*'
SKIPPED_COMPLEMENT_TESTS='-skip=TestClientSpacesSummary.*'
toplevel="$(git rev-parse --show-toplevel)"
@ -38,7 +37,7 @@ set +o pipefail
env \
-C "$COMPLEMENT_SRC" \
COMPLEMENT_BASE_IMAGE="$OCI_IMAGE" \
go test -tags="conduwuit_blacklist" -v -timeout 1h -json ./tests | tee "$LOG_FILE"
go test -tags="conduwuit_blacklist" "$SKIPPED_COMPLEMENT_TESTS" -v -timeout 1h -json ./tests | tee "$LOG_FILE"
set -o pipefail
# Post-process the results into an easy-to-compare format, sorted by Test name for reproducible results

7
tests/test_results/complement/test_results.jsonl
View file

@ -42,13 +42,6 @@
{"Action":"pass","Test":"TestCannotSendNonLeaveViaSendLeaveV2/knock_event"}
{"Action":"pass","Test":"TestCannotSendNonLeaveViaSendLeaveV2/non-state_membership_event"}
{"Action":"pass","Test":"TestCannotSendNonLeaveViaSendLeaveV2/regular_event"}
{"Action":"fail","Test":"TestClientSpacesSummary"}
{"Action":"fail","Test":"TestClientSpacesSummary/max_depth"}
{"Action":"fail","Test":"TestClientSpacesSummary/pagination"}
{"Action":"fail","Test":"TestClientSpacesSummary/query_whole_graph"}
{"Action":"fail","Test":"TestClientSpacesSummary/redact_link"}
{"Action":"fail","Test":"TestClientSpacesSummary/suggested_only"}
{"Action":"fail","Test":"TestClientSpacesSummaryJoinRules"}
{"Action":"fail","Test":"TestContentMediaV1"}
{"Action":"fail","Test":"TestDeviceListsUpdateOverFederation"}
{"Action":"fail","Test":"TestDeviceListsUpdateOverFederation/good_connectivity"}