- 17 Sep, 2021 1 commit
-
-
Grant Likely authored
To avoid issues with the sequence file getting modified in the test report, recommend using the copy of EBBR.seq that is stored in this repo. Signed-off-by:
Grant Likely <grant.likely@arm.com>
-
- 03 Sep, 2021 1 commit
-
-
Grant Likely authored
A couple EBBR.yaml changes See merge request !3
-
- 02 Sep, 2021 1 commit
-
-
Vincent Stehlé authored
The QueryVariableInfo() implementation in U-Boot does not check properly for all the invalid inputs conditions, which causes conformance failures. Mark those failures as known U-Boot limitations. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
- 26 Aug, 2021 7 commits
-
-
Vincent Stehlé authored
The ACS emits warnings when it detects an identity mapping between virtual and physical memory, which is the case with U-Boot. Mark those warnings as known ACS limitations. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Grant Likely authored
Mucho changes See merge request !2
-
Vincent Stehlé authored
Add a rule to mark four ACS-IR BETA 0 CreateEvent failures as "known acs limitations". The SCT in this ACS version erroneously tests for Tpl level high. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
Handle more cases gracefully during printing, where not all the fields are present for some of the records. This makes the original commit 29d85950 ("parser.py: add an option for printing") more robust and fixes a bug in the first hardening attempt of commit f153e735 ("parser.py: more robust printing"). Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
Ignore four SetTime failures happening with U-Boot RTC emulation. EBBR has requirements on SetTime only when an RTC is present. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
Classify three UpdateCapsule conformance failures as known u-boot limitations. They are known bugs, which should be fixed in U-Boot ultimately. Those failures are waived and do not prevent certification. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
Let's classify the ACS-IR BETA 0 MemoryMap failure automatically. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
- 19 Aug, 2021 12 commits
-
-
Vincent Stehlé authored
Update the documentation accordingly. While at it, remove obsolete mention of default behaviour. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
Add a file to run `make check' on github. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
We can stress the markdown generation code a bit more now that we can re-read previously generated markdown result. Make markdown generation more robust to missing keys to avoid exceptions. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
Refine the documentation of the result.md and explain how to generate HTML with pandoc. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
This is useful to perform further processing. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
This simplifies the main path and prepares for future conditional .md generation. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
dict_2_md implicitly relies on the tests all having the same order for their dict keys during printing. This works well with all the tests read from the .ekl log file but does not work with the "artificial" SPURIOUS test entries, which end up having their keys in a different order. Fix the keys order to fix .md printing. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
Simplify the printing by group, to help debugging. As a bonus, this is more efficient. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
Add a checker for python scripts and a checker for shell scripts to the `make check' target. Fix all issues reported by the checker in parser.py. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
This makes the main path more concise and prepares for future re-reading of the .md summary. While at it, reformat a bit. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
This reduces the use of db1 in the code for clarity. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
It is convenient to have those sequence files at hand to analyse results obtained with the different ACS-IR published versions. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
- 18 Aug, 2021 4 commits
-
-
Jeff Booher-Kaeding authored
Usability updates See merge request !1
-
Grant Likely authored
The sample files are just for testing. Using them by default could hide from the user that they are calling the script wrong. Make it required to supply the .ekl and .seq files. Signed-off-by:
Grant Likely <grant.likely@arm.com>
-
Grant Likely authored
Use the typical __init__ == '__main__' pattern to determine if the code is being run as a script, and only execute the main code if true. This makes the code more portable to other projects. Signed-off-by:
Grant Likely <grant.likely@arm.com>
-
Grant Likely authored
Adds some simple instructions to the top of the README file so that a users doesn't need to go searching for the instructions. Signed-off-by:
Grant Likely <grant.likely@arm.com>
-
- 16 Aug, 2021 1 commit
-
-
Jeff Booher-Kaeding authored
Update EBBR config
-
- 11 Aug, 2021 2 commits
-
-
Vincent Stehlé authored
Start to document the EBBR.yaml configuration file specificities. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
We put the links definitions in the same section as the first use, to facilitate reading the README.md directly. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
- 09 Aug, 2021 11 commits
-
-
Vincent Stehlé authored
Ignore monotonic count failures as it is not required by EBBR. A change to EBBR to explicitly clarify those cases is pending. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
Ignore daylight and time zone failures as they are not required by EBBR. A change to EBBR to explicitly clarify those cases is pending. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
Those failures happen when the system does not have an EFI System Partition and is not capable of persisting EFI variables across reset. Add comments in that case, to help debugging. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
The boot services memory map test has a known issue with the ACS-IR v21.05_0.8_BETA-0. The real fix is to update the ACS-IR test code, but we add a rule already to add some comments for that case, to help triaging. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
We want to fix those failures in U-Boot. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
We know about this failure. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
This simple network protocol failure is not showing up anymore. Remove this rule, as we want to reduce the list of WAIVED to zero. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
Simple Text Input Ex Protocol tests can be skipped when the SCT is unable to locate the console device bound to the protocol. This is the case with U-Boot. EBBR has requirements on the console, but it does not specifically require that a device be always bound to the Simple Text Input Ex Protocol. Simply ignore this skipped test instead of waiving it. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
This is not mandated by EBBR and may be skipped safely. Ignore the skipped tests rather than waiving them. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
We were already ignoring those tests, when they resulted in failures. They result in warnings when running the ACS-IR; add rules to ignore those as well. As the parser matches only plain text (no regex) we have to duplicate the rules. Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-
Vincent Stehlé authored
This happens when running the ACS-IR. EBBR does not require authenticated EFI variables; we can therefore ignore those failures. Reported-by:
Masami Hiramatsu <masami.hiramatsu@linaro.org> Signed-off-by:
Vincent Stehlé <vincent.stehle@arm.com>
-