Skip to content

Cron testing#6

Closed
mkasenberg wants to merge 48 commits into
masterfrom
tc-estimation
Closed

Cron testing#6
mkasenberg wants to merge 48 commits into
masterfrom
tc-estimation

Conversation

@mkasenberg

Copy link
Copy Markdown
Owner

No description provided.

@mkasenberg

Copy link
Copy Markdown
Owner Author

#AutoPTS run zephyr BAP BASS CSIP -e BAP/BSRC/STR BAP/BSNK

@codecoup-tester

Copy link
Copy Markdown

Scheduled PR, #6 (comment), estimated start time: 09:38:32, test case count: 459, estimated duration: 7:19:51

@mkasenberg

Copy link
Copy Markdown
Owner Author

#AutoPTS run zephyr AICS -e AICS/SR/SGGIT AICS/SR/SPN

@codecoup-tester

Copy link
Copy Markdown

Scheduled PR, #6 (comment), estimated start time: 11:01:40, test case count: 6, estimated duration: 0:03:12

@codecoup-tester

Copy link
Copy Markdown

Scheduled PR, #6 (comment), estimated start time: 11:10:14, test case count: 6, estimated duration: 0:03:12

@codecoup-tester

Copy link
Copy Markdown

AutoPTS Bot results:
No failed test found.

Successful testsAICS AICS/SR/CP/BV-01-C PASS
AICS AICS/SR/CP/BV-02-C PASS
AICS AICS/SR/CP/BV-03-C PASS
AICS AICS/SR/CP/BV-04-C PASS
AICS AICS/SR/CP/BV-05-C PASS
AICS AICS/SR/SPE/BI-01-C PASS

mkasenberg and others added 15 commits April 10, 2024 13:42
If the build or flash step for an iut config has failed, set status
of its test cases to BUILD_OR_FLASH ERROR and proceed with the next
iut config.
This commit adds test environment for BAP implemented
in mynewt-nimble.
This commit adds support for testing PACS with mynewt-nimble.
jlink.exe randomly crashes the Windows OS. Let's try pylink reset instead.
…h Studio

Previous workspace was generated using only PTS, withouth consistency
check. Now, new project files were created using Launch Studio, on base
of nimble-master/nimble_project_TCRL_2023-1.bls. For now, only PACS and
BAP profiles are included (Broadcast Source feature).

Workspace generated using PTS 8.5.3
This commit adds a new workflow file. The purpose is to trigger
test run of specific layer if PR contains changes made in
autopts/wid/ directory.

Signed-off-by: Piotr Narajowski <piotr.narajowski@codecoup.pl>
Set the code owner name and current year in copyright notes.
"dummy" in the event name will emphasize that this is just an example
and not part of the mandatory boilerplate code.
If a WID handler is missing use the dedicated result name instead of
the generic FATAL ERROR.
For some reason if: github.run_number == 1 blocked this workflow job.
Now, the action will only run when a pull request is opened or
converted from draft to ready for review.
This commit implements missing wid.
This adds dedicated service for testing OTS and updates errata list.
@mkasenberg mkasenberg force-pushed the tc-estimation branch 3 times, most recently from b164a53 to 20b9027 Compare May 7, 2024 07:32
sjanc and others added 3 commits May 8, 2024 07:31
This allows to run those without MMDL.
This syncs workspace with Zephyr's Launchstudio project.
Commit fixes SAR client tests.
SAR client suppose to use device key of remote device.
Only provisioner knows such keys and keeps them in CDB.

Signed-off-by: Aleksandr Khromykh <aleksandr.khromykh@nordicsemi.no>
mkasenberg and others added 14 commits May 20, 2024 10:06
autoptsserver/PTS restarts slower on Windows VM so this parameter
should be configurable.
Cron generates a file with additional info about PR comment which
triggered a bot run.
A command like:
 #AutoPTS cancel https://github.com/auto-pts/auto-pts/pull/xxx#issuecomment-xxxxxxxx
will cancel job scheduled with the given command.
…nation

There is rare random dead lock in S-65000-PTS thread around PTS restart
procedure. Thanks to logging the thread stacks in the print_thread_stack_trace()
we found out that the thread locks in init_attributes() at intruction
self._pts = None

Let's hope that deleting those objects before forcing the PTS process
termination will free enough resources so the test run could continue
without interruption.
Under linux, replugging a board using YKUSH may cause a change
of the tty file name. Having an udev rule like:
SUBSYSTEM=="tty", ATTRS{serial}=="1234567890", SYMLINK+="ttymyNRF53"
allows to resolve the permanent alias name to the real tty address.
Add jobs for starting/closing VM.
Add jobs for merging splitted TestCase.db
Logs about a ykush replugging at startup were not printed anywhere.
Print exception message after build and flash error.
zephyrproject-rtos/zephyr#51831

Signed-off-by: Aytürk Düzen <ayturk.duzen@nordicsemi.no>
Result of the last test case before next rebuild was printed after
the rebuild, e.g.:
...
31/32   MBT     MBT/CL/BT/BV-07-C   PASS           38.097
32/32   MBT     MBT/CL/BT/BV-08-C   -- west build: generating a build system
Loading Zephyr default modules (Zephyr base).
...
Applying pin reset.
-- runners.nrfjprog: Board with serial number 683511993 flashed successfully.
PASS           31.924
If multiple devices were plugged in, a JLink popup window would
suspend the flashing process.
The option allows to set the waiting time for PTS initialization
or restart.
@mkasenberg

Copy link
Copy Markdown
Owner Author

#AutoPTS run zephyr AICS/SR/CP/BV-01-C DIS/SR/SGGIT/CHA/BV-01-C

If a magic tag command does not contain a name of a board that should
be used for AutoPTS testing, automatically assign tests to the correct
boards.
@codecoup-tester

Copy link
Copy Markdown

Scheduled PR #6 (comment), board: nrf52, estimated start time: 13:55:22

@codecoup-tester

Copy link
Copy Markdown

Scheduled PR #6 (comment), board: nrf53, estimated start time: 13:55:23

@codecoup-tester

Copy link
Copy Markdown

AutoPTS Bot results:
No failed test found.

Successful testsDIS DIS/SR/SGGIT/CHA/BV-01-C PASS

@codecoup-tester

Copy link
Copy Markdown

AutoPTS Bot results:
No failed test found.

Successful testsAICS AICS/SR/CP/BV-01-C PASS

@mkasenberg

mkasenberg commented Jul 31, 2024

Copy link
Copy Markdown
Owner Author

#AutoPTS run zephyr nrf52 GAP GAP/ADV GATT L2CAP --test_case_limit 3

@codecoup-tester

Copy link
Copy Markdown

Scheduled PR #6 (comment), board: nrf52, estimated start time: 10:56:37, test case count: 12, estimated duration: 0

Test cases to be runGAP/BROB/BCST/BV-01-C
GAP/BROB/BCST/BV-02-C
GAP/BROB/BCST/BV-03-C
GAP/ADV/BV-01-C
GAP/ADV/BV-02-C
GAP/ADV/BV-03-C
GATT/CL/GAC/BV-01-C
GATT/CL/GAD/BV-01-C
GATT/CL/GAD/BV-02-C
L2CAP/COS/CFC/BV-01-C
L2CAP/COS/CFC/BV-02-C
L2CAP/COS/CFC/BV-03-C

@codecoup-tester

Copy link
Copy Markdown

Scheduled PR #6 (comment), board: nrf52, estimated start time: 11:05:16, test case count: 12, estimated duration: 0

Test cases to be runGAP/BROB/BCST/BV-01-C
GAP/BROB/BCST/BV-02-C
GAP/BROB/BCST/BV-03-C
GAP/ADV/BV-01-C
GAP/ADV/BV-02-C
GAP/ADV/BV-03-C
GATT/CL/GAC/BV-01-C
GATT/CL/GAD/BV-01-C
GATT/CL/GAD/BV-02-C
L2CAP/COS/CFC/BV-01-C
L2CAP/COS/CFC/BV-02-C
L2CAP/COS/CFC/BV-03-C

@mkasenberg mkasenberg closed this Aug 14, 2024
@mkasenberg mkasenberg deleted the tc-estimation branch July 17, 2025 10:57
@mkasenberg mkasenberg restored the tc-estimation branch July 17, 2025 10:57
@mkasenberg mkasenberg deleted the tc-estimation branch July 17, 2025 11:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

10 participants