Skip to content

Instantly share code, notes, and snippets.

@adamfilipow92

adamfilipow92/ios_test_plan.yml Secret

Created January 20, 2021 21:18
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save adamfilipow92/24f24b82c7ea60d88b6cc309ac780ba0 to your computer and use it in GitHub Desktop.
Save adamfilipow92/24f24b82c7ea60d88b6cc309ac780ba0 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
ios_test_plan.yml
version: local_snapshot
revision: d903d4091b738ae9b42b3de68caeb2bda57431d6
session id: 63136591-c7a9-4d88-bfc2-d68f1a7606a5
IosArgs
gcloud:
results-bucket: test-lab-v9cn46bb990nx-kz69ymd4nm9aq
results-dir: 2021-01-20_21-05-56.452620_vEWI
record-video: false
timeout: 15m
async: false
client-details:
network-profile: null
results-history-name: null
# iOS gcloud
test: /Users/adamfilipowicz/Repos/flank/test_runner/src/test/kotlin/ftl/fixtures/tmp/ios/FlankTestPlansExample/FlankTestPlansExample.zip
xctestrun-file: /Users/adamfilipowicz/Repos/flank/test_runner/src/test/kotlin/ftl/fixtures/tmp/ios/FlankTestPlansExample/AllTests.xctestrun
xcode-version: null
device:
- model: iphone8
version: 13.6
locale: en
orientation: portrait
num-flaky-test-attempts: 0
directories-to-pull:
other-files:
additional-ipas:
scenario-numbers:
type: xctest
app:
test-special-entitlements: false
fail-fast: false
flank:
max-test-shards: 3
shard-time: -1
num-test-runs: 1
smart-flank-gcs-path:
smart-flank-disable-upload: false
default-test-time: 120.0
use-average-test-time-for-new-tests: false
test-targets-always-run:
files-to-download:
keep-file-path: false
full-junit-result: false
# iOS flank
test-targets:
disable-sharding: false
project: flank-open-source
local-result-dir: results
run-timeout: -1
ignore-failed-tests: false
output-style: multi
disable-results-upload: false
default-class-test-time: 240.0
only-test-configuration: pl
skip-test-configuration:
Found xctest: /Users/adamfilipowicz/Repos/flank/test_runner/src/test/kotlin/ftl/fixtures/tmp/ios/FlankTestPlansExample/Debug-iphoneos/SecondUITests-Runner.app/PlugIns/SecondUITests.xctest
isMacOS = true (mac os x)
nm -U "/Users/adamfilipowicz/Repos/flank/test_runner/src/test/kotlin/ftl/fixtures/tmp/ios/FlankTestPlansExample/Debug-iphoneos/SecondUITests-Runner.app/PlugIns/SecondUITests.xctest/SecondUITests"
nm -gU "/Users/adamfilipowicz/Repos/flank/test_runner/src/test/kotlin/ftl/fixtures/tmp/ios/FlankTestPlansExample/Debug-iphoneos/SecondUITests-Runner.app/PlugIns/SecondUITests.xctest/SecondUITests" | xargs -s 262144 xcrun swift-demangle
Found xctest: /Users/adamfilipowicz/Repos/flank/test_runner/src/test/kotlin/ftl/fixtures/tmp/ios/FlankTestPlansExample/Debug-iphoneos/UITests-Runner.app/PlugIns/UITests.xctest
nm -U "/Users/adamfilipowicz/Repos/flank/test_runner/src/test/kotlin/ftl/fixtures/tmp/ios/FlankTestPlansExample/Debug-iphoneos/UITests-Runner.app/PlugIns/UITests.xctest/UITests"
nm -gU "/Users/adamfilipowicz/Repos/flank/test_runner/src/test/kotlin/ftl/fixtures/tmp/ios/FlankTestPlansExample/Debug-iphoneos/UITests-Runner.app/PlugIns/UITests.xctest/UITests" | xargs -s 262144 xcrun swift-demangle
Found xctest: /Users/adamfilipowicz/Repos/flank/test_runner/src/test/kotlin/ftl/fixtures/tmp/ios/FlankTestPlansExample/Debug-iphoneos/SecondUITests-Runner.app/PlugIns/SecondUITests.xctest
nm -U "/Users/adamfilipowicz/Repos/flank/test_runner/src/test/kotlin/ftl/fixtures/tmp/ios/FlankTestPlansExample/Debug-iphoneos/SecondUITests-Runner.app/PlugIns/SecondUITests.xctest/SecondUITests"
nm -gU "/Users/adamfilipowicz/Repos/flank/test_runner/src/test/kotlin/ftl/fixtures/tmp/ios/FlankTestPlansExample/Debug-iphoneos/SecondUITests-Runner.app/PlugIns/SecondUITests.xctest/SecondUITests" | xargs -s 262144 xcrun swift-demangle
Found xctest: /Users/adamfilipowicz/Repos/flank/test_runner/src/test/kotlin/ftl/fixtures/tmp/ios/FlankTestPlansExample/Debug-iphoneos/UITests-Runner.app/PlugIns/UITests.xctest
nm -U "/Users/adamfilipowicz/Repos/flank/test_runner/src/test/kotlin/ftl/fixtures/tmp/ios/FlankTestPlansExample/Debug-iphoneos/UITests-Runner.app/PlugIns/UITests.xctest/UITests"
nm -gU "/Users/adamfilipowicz/Repos/flank/test_runner/src/test/kotlin/ftl/fixtures/tmp/ios/FlankTestPlansExample/Debug-iphoneos/UITests-Runner.app/PlugIns/UITests.xctest/UITests" | xargs -s 262144 xcrun swift-demangle
Smart Flank cache hit: 0% (0 / 10)
Shard times: 360s, 360s, 480s
RunTests
Saved 3 shards to ios_shards.json
Uploading [ios_shards.json] to https://console.developers.google.com/storage/browser/test-lab-v9cn46bb990nx-kz69ymd4nm9aq/2021-01-20_21-05-56.452620_vEWI/...
10 tests / 3 shards
Uploading [FlankTestPlansExample.zip] to https://console.developers.google.com/storage/browser/test-lab-v9cn46bb990nx-kz69ymd4nm9aq/2021-01-20_21-05-56.452620_vEWI/...
Uploading [AllTests_shard_0.xctestrun] to https://console.developers.google.com/storage/browser/test-lab-v9cn46bb990nx-kz69ymd4nm9aq/2021-01-20_21-05-56.452620_vEWI/shard_0/...
Uploading [AllTests_shard_1.xctestrun] to https://console.developers.google.com/storage/browser/test-lab-v9cn46bb990nx-kz69ymd4nm9aq/2021-01-20_21-05-56.452620_vEWI/shard_1/...
Uploading [AllTests_shard_2.xctestrun] to https://console.developers.google.com/storage/browser/test-lab-v9cn46bb990nx-kz69ymd4nm9aq/2021-01-20_21-05-56.452620_vEWI/shard_2/...
Uploading [session_id.txt] to https://console.developers.google.com/storage/browser/test-lab-v9cn46bb990nx-kz69ymd4nm9aq/2021-01-20_21-05-56.452620_vEWI/...
3 matrix ids created in 0m 7s
Raw results will be stored in your GCS bucket at [https://console.developers.google.com/storage/browser/test-lab-v9cn46bb990nx-kz69ymd4nm9aq/2021-01-20_21-05-56.452620_vEWI]
Matrices webLink
matrix-m618khb1mraga https://console.firebase.google.com/project/flank-open-source/testlab/histories/bh.11da37c41528f628/matrices/4662140850847939614/executions/bs.4ee65e8fa90fbb29
matrix-8o6pq1wxcklqa https://console.firebase.google.com/project/flank-open-source/testlab/histories/bh.11da37c41528f628/matrices/7484585936221500703/executions/bs.5e059d51ba417bf8
matrix-3chs1c1rc8zaq https://console.firebase.google.com/project/flank-open-source/testlab/histories/bh.11da37c41528f628/matrices/5025919896368327623/executions/bs.d2f9f48d8639e4b4
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
1m 44s matrix-8o6pq1wxcklqa iphone8-13.6 shard-0 Internet connection stable
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
1m 44s matrix-8o6pq1wxcklqa iphone8-13.6 shard-0 Internet connection stable
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
1m 44s matrix-8o6pq1wxcklqa iphone8-13.6 shard-0 Internet connection stable
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
0m 35s matrix-m618khb1mraga iphone8-13.6 shard-0 RUNNING
1m 59s matrix-m618khb1mraga iphone8-13.6 shard-0 Internet connection stable!
1m 59s matrix-m618khb1mraga iphone8-13.6 shard-0 Internet connection stable!
1m 59s matrix-m618khb1mraga iphone8-13.6 shard-0 Internet connection stable!
2m 5s matrix-m618khb1mraga iphone8-13.6 shard-0 Started device logs task
2m 5s matrix-m618khb1mraga iphone8-13.6 shard-0 Started device logs task
2m 36s matrix-m618khb1mraga iphone8-13.6 shard-0 Starting results processin
2m 36s matrix-m618khb1mraga iphone8-13.6 shard-0 Starting results processin
2m 41s matrix-m618khb1mraga iphone8-13.6 shard-0 FINISHED
2m 41s matrix-m618khb1mraga iphone8-13.6 shard-0 FINISHED
2m 26s matrix-8o6pq1wxcklqa iphone8-13.6 shard-0 FINISHED
2m 56s matrix-3chs1c1rc8zaq iphone8-13.6 shard-0 FINISHED
2m 56s matrix-8o6pq1wxcklqa FINISHED
2m 56s matrix-m618khb1mraga FINISHED
2m 56s matrix-3chs1c1rc8zaq FINISHED
Unable to find device type for iphone8. PHYSICAL used as fallback in cost calculations
Unable to find device type for iphone8. PHYSICAL used as fallback in cost calculations
Unable to find device type for iphone8. PHYSICAL used as fallback in cost calculations
CostReport
Physical devices
$0.25 for 3m
Uploading [CostReport.txt] to https://console.developers.google.com/storage/browser/test-lab-v9cn46bb990nx-kz69ymd4nm9aq/2021-01-20_21-05-56.452620_vEWI/...
MatrixResultsReport
2 / 3 (66.67%)
1 matrices failed
┌─────────┬──────────────────────┬──────────────────────────┬───────────────────────────────┐
│ OUTCOME │ MATRIX ID │ TEST AXIS VALUE │ TEST DETAILS │
├─────────┼──────────────────────┼──────────────────────────┼───────────────────────────────┤
│ success │ matrix-8o6pq1wxcklqa │ iphone8-13.6-en-portrait │ 3 test cases passed │
│ failure │ matrix-m618khb1mraga │ iphone8-13.6-en-portrait │ 2 test cases failed, 1 passed │
│ success │ matrix-3chs1c1rc8zaq │ iphone8-13.6-en-portrait │ 4 test cases passed │
└─────────┴──────────────────────┴──────────────────────────┴───────────────────────────────┘
More details are available at:
https://console.firebase.google.com/project/flank-open-source/testlab/histories/bh.11da37c41528f628/matrices/4662140850847939614
Uploading [MatrixResultsReport.txt] to https://console.developers.google.com/storage/browser/test-lab-v9cn46bb990nx-kz69ymd4nm9aq/2021-01-20_21-05-56.452620_vEWI/...
Uploading [matrix_ids.json] to https://console.developers.google.com/storage/browser/test-lab-v9cn46bb990nx-kz69ymd4nm9aq/2021-01-20_21-05-56.452620_vEWI/...
FetchArtifacts
Updating matrix file
Matrices webLink
matrix-m618khb1mraga https://console.firebase.google.com/project/flank-open-source/testlab/histories/bh.11da37c41528f628/matrices/4662140850847939614/executions/bs.4ee65e8fa90fbb29
matrix-8o6pq1wxcklqa https://console.firebase.google.com/project/flank-open-source/testlab/histories/bh.11da37c41528f628/matrices/7484585936221500703/executions/bs.5e059d51ba417bf8
matrix-3chs1c1rc8zaq https://console.firebase.google.com/project/flank-open-source/testlab/histories/bh.11da37c41528f628/matrices/5025919896368327623/executions/bs.d2f9f48d8639e4b4
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment