Smoke tests results of 4.23.0.0 RC

[weizhouapache]

This lists the results of smoke tests for ACS 4.23.0.0 RC

[weizhouapache]

4.23.0.0-RC3: Ubuntu 26.04 (mgmt and kvm)

Updated: ALL are good in the next run

[weizhouapache]

4.23.0.0-RC3: Rocky8 (mgmt and kvm)

[weizhouapache]

4.23.0.0-RC3: Open SUSE 15 (mgmt and kvm)

[weizhouapache]

4.23.0.0-RC3: Ubuntu 24.04 (mgmt and kvm)

[weizhouapache]

4.23.0.0-RC3: Open SUSE 15 (mgmt and kvm)

run the smoke tests in #13628, all are good

[root@ref-trl-n16-k-Ms15-wei-zhou-marvin ~]# cat /marvin/MarvinLogs/SZZ86J/results.txt 
Test to create Load balancing rule with SSL offloading ... === TestName: test_01_ssl_offloading_isolated_network | Status : SUCCESS ===
ok
Test to create Load balancing rule with SSL offloading in VPC in user project ... === TestName: test_02_ssl_offloading_project_vpc | Status : SUCCESS ===
ok
NSP state machine: Disabled → Enabled → Disabled → Deleted. ... === TestName: test_01_provider_state_transitions | Status : SUCCESS ===
ok
Verify network.services and network.service.capabilities details are stored and retrievable via API. ... === TestName: test_02_extension_capabilities_detail | Status : SUCCESS ===
ok
Extension enable/disable; deletion blocked while registered. ... === TestName: test_03_extension_enable_disable_and_delete_restriction | Status : SUCCESS ===
ok
DHCP / DNS / UserData: cloud-init VM on a shared network reaches Running state. ... SKIP: Skipping test — required tools not installed on KVM host(s): 10.0.34.164 missing haproxy; 10.0.32.172 missing haproxy
Full isolated-network lifecycle with SSH connectivity verification. ... SKIP: Skipping test — required tools not installed on KVM host(s): 10.0.34.164 missing haproxy; 10.0.32.172 missing haproxy
VPC multi-tier + VPC restart with SSH connectivity verification. ... SKIP: Skipping test — required tools not installed on KVM host(s): 10.0.34.164 missing haproxy; 10.0.32.172 missing haproxy
VPC Network ACL testing with multiple tiers and traffic rules. ... SKIP: Skipping test — required tools not installed on KVM host(s): 10.0.34.164 missing haproxy; 10.0.32.172 missing haproxy
Custom-action smoke test for PBR lifecycle helpers. ... SKIP: Skipping test — required tools not installed on KVM host(s): 10.0.34.164 missing haproxy; 10.0.32.172 missing haproxy
Update VPC source NAT IP and verify old/new source NAT flags flip correctly. ... SKIP: Skipping test — required tools not installed on KVM host(s): 10.0.34.164 missing haproxy; 10.0.32.172 missing haproxy
Custom-action smoke test for PBR lifecycle helpers on a VPC. ... SKIP: Skipping test — required tools not installed on KVM host(s): 10.0.34.164 missing haproxy; 10.0.32.172 missing haproxy
IPv6 dualstack isolated network: namespace address and radvd. ... SKIP: Skipping test — required tools not installed on KVM host(s): 10.0.34.164 missing radvd; 10.0.32.172 missing radvd

----------------------------------------------------------------------
Ran 13 tests in 631.220s

OK (SKIP=8)

[weizhouapache]

as suggested by Daan, I will move to discussion

[weizhouapache]

cc @andrijapanicsb @DaanHoogland @winterhazel

[DaanHoogland]

Are we aware of the Suse 15 and Ubuntu 26 failures, @weizhouapache ?

Also you are still addind others, right?

[weizhouapache]

Are we aware of the Suse 15 and Ubuntu 26 failures, @weizhouapache ?

Also you are still addind others, right?

@DaanHoogland
yes, there are still some running smoke tests with vmware 70u3/80u3 , xcpng83, xenserver84, and debian 12. I will post the test results when they are completed.

for OpenSUSE15 failures, I have investigated and re-run the tests manually: #13980 (comment)

For the Ubuntu 26 failures, some tests were skipped because the management server was down. I have kicked off another test environment to verify the results.

[weizhouapache]

4.23.0.0-RC3: Debian 12 (mgmt and kvm)

[weizhouapache]

4.23.0.0-RC3: OL9 (mgmt) + xcpng83

[weizhouapache]

4.23.0.0-RC3: OL9 (mgmt) + xenserver84

[weizhouapache]

4.23.0.0-RC3: OL9 (mgmt) + vmware 70u3

[weizhouapache]

4.23.0.0-RC3: OL9 (mgmt) + vmware 80u3

to be added

[andrijapanicsb]

@weizhouapache thank you for this amazing work - really appreciated !!!

One thing that I mentioned to Daan some time ago - we claim that we support Ubuntu 13 (I got hints that actually there are some packaging or dependency issues) - so it would be good to either have 100% on Debian 13 (but if not mistaken, we need to add Debian 13 templates/support on the testing Trillian infra - OR remove claims that "it should work" - because we don't know really.

Again, thx for such amazing work - it would be awesome if we could document these variosu matrix combinations - so that we run identical set of tests in each future release, proving no regressions across wide OS variants.

Again, awesome work.