Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tests: imx: address issues testing with fully featured and locked device #3594

Merged
merged 4 commits into from
Jan 14, 2025

Conversation

alexgg
Copy link
Contributor

@alexgg alexgg commented Jan 11, 2025


Contributor checklist

Reviewer Guidelines

  • When submitting a review, please pick:
    • 'Approve' if this change would be acceptable in the codebase (even if there are minor or cosmetic tweaks that could be improved).
    • 'Request Changes' if this change would not be acceptable in our codebase (e.g. bugs, changes that will make development harder in future, security/performance issues, etc).
    • 'Comment' if you don't feel you have enough information to decide either way (e.g. if you have major questions, or you don't understand the context of the change sufficiently to fully review yourself, but want to make a comment)

@alexgg alexgg marked this pull request as draft January 11, 2025 14:41
@alexgg alexgg had a problem deploying to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Failure
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg had a problem deploying to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Failure
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 11, 2025 14:41 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 13, 2025 10:36 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 13, 2025 10:36 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 13, 2025 10:37 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 13, 2025 10:37 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 13, 2025 10:37 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 13, 2025 10:38 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 13, 2025 10:38 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-staging.com January 13, 2025 10:39 — with GitHub Actions Inactive
@flowzone-app flowzone-app bot enabled auto-merge January 13, 2025 10:39
@alexgg alexgg temporarily deployed to balena-cloud.com January 13, 2025 11:32 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-cloud.com January 13, 2025 11:32 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-cloud.com January 13, 2025 11:32 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-cloud.com January 13, 2025 11:34 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-cloud.com January 13, 2025 11:34 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-cloud.com January 13, 2025 11:34 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-cloud.com January 13, 2025 11:46 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-cloud.com January 13, 2025 11:46 — with GitHub Actions Inactive
@alexgg alexgg temporarily deployed to balena-cloud.com January 13, 2025 11:47 — with GitHub Actions Inactive
@rcooke-warwick
Copy link
Contributor

LGTM, if this is verified to work locally on the target device (locked)

@alexgg
Copy link
Contributor Author

alexgg commented Jan 14, 2025

Local test run on locked device:

OS suite:

client_1  | *******  Final Test Result of Leviathan Run  *******                                                                                                                                                                            
client_1  | [                                                                                                                                                                                                                               
client_1  |   {                                                                                                                                                                                                                             
client_1  |     suite: 'Unmanaged BalenaOS release suite',                                                                                                                                                                                  
client_1  |     stats: { tests: 54, ran: 44, skipped: 10, passed: 43, failed: 1 },                                                                                                                                                          
client_1  |     tests: {                                                                                                                                                                                                                    
client_1  |       'check QEMU secure boot': 'passed',                                                                                                                                                                                       
client_1  |       'check UEFI secure boot': 'passed',                                                                                                                                                                                       
client_1  |       'check RPI secure boot': 'passed',                                                                                                                                                                                        
client_1  |       'check IMX secure boot': 'passed',                                                                                                                                                                                        
client_1  |       'BeagleBone Black u-boot overlay test: deactivate HDMI': 'skipped',  
client_1  |       '243390-rpi3 - CUS/EUS chipsets test': 'skipped',                                                                                                                                                    16:42:42
client_1  |       'Jetson Orin power mode and fan profile tests': 'skipped',                                                                                                                                                                
client_1  |       'Kernel and device-tree overlap test': 'passed',                                                                                                                                                                          
client_1  |       'fingerprint file test': 'passed',                                                                                                                                                                                        
client_1  |       'ext4 filesystems are checked on boot': 'passed',                                                                                                                                                                         
client_1  |       'OS-release file check': 'passed',                                                                                                                                                                                        
client_1  |       'Firewall sanity check': 'passed',                                                                                                                                                                                        
client_1  |       'BALENA-FIREWALL test': 'passed',                                                                                                                                                                                         
client_1  |       'Installer used migrator module': 'passed',                                                                                                                                                                               
client_1  |       'issue file check': 'passed',                                                                                                                                                                                             
client_1  |       'issue.net file check': 'passed',                                                                                                                                                                                         
client_1  |       'Chronyd service': 'passed',                                                                                                                                                                                              
client_1  |       'Sync test': 'passed',                                                                                                                                                                                                    
client_1  |       'Source test': 'passed',                                                                                                                                                                                                  
client_1  |       'Offline sources test': 'passed',                                                                                                                                                                                         
client_1  |       'System time skew test': 'passed',                                                                                                                                                                                        
client_1  |       'kernel-overlap test': 'passed',                                                                                                                                                                                          
client_1  |       'Bluetooth scanning test': 'passed',                                                                                                                                                                                      
client_1  |       'Container healthcheck test': 'passed',                                                                                                                                                                                   
client_1  |       'Container exposed variables test': 'passed',                                                                                                                                                                             
client_1  |       'Identification test': 'skipped',                                                                                                                                                                                         
client_1  |       'hostname configuration test': 'passed',                                                                                                                                                                                  
client_1  |       'ntpServer test': 'passed',                                                                                                                                                                                               
client_1  |       'dnsServers test': 'passed',                                                                                                                                                                                              
client_1  |       'os.network.connectivity test': 'passed',                                                                                                                                                                                 
client_1  |       'os.network.wifi.randomMacAddressScan test': 'passed',                                                                                                                                                                    
client_1  |       'udevRules test': 'passed',                                                                                                                                                                                               
client_1  |       'persistentLogging configuration test': 'passed',
client_1  |       'Reboot test': 'skipped',
client_1  |       'Wired test': 'passed',
client_1  |       'Socks5 test': 'passed',
client_1  |       'Http-connect test': 'passed',
client_1  |       'Engine socket is exposed in development images': 'passed',
client_1  |       'Engine socket is not exposed in production images': 'passed',
client_1  |       'Engine watchdog recovery': 'passed',
client_1  |       'Engine healthcheck performance': 'passed',
client_1  |       'Under-voltage test': 'passed',
client_1  |       'Ramdisks, zram and loop devices are not scanned for rootfs': 'passed',
client_1  |       'by-state links are created': 'passed',
client_1  |       'rootfs by-state links are unique': 'passed',
client_1  |       'DToverlay & DTparam tests': 'skipped',
client_1  |       'state partition reset': 'passed',
client_1  |       'data partition reset': 'passed',
client_1  |       'RevPi Core 3 DIO module test': 'skipped',
client_1  |       'zram is enabled and configured as swap': 'passed',
client_1  |       'Internet sharing iptables rules test': 'failed',
client_1  |       'Respect application locks': 'skipped',
client_1  |       'Reboot on application unlock': 'skipped',
client_1  |       'Override update locks': 'skipped'
client_1  |     },                                         
client_1  |     dateTime: 'Mon Jan 13 2025 15:42:41 GMT+0000 (Coordinated Universal Time)'
client_1  |   }                                            
client_1  | ]   

@alexgg
Copy link
Contributor Author

alexgg commented Jan 14, 2025

Cloud suite:

client_1  | *******  Final Test Result of Leviathan Run  *******
client_1  | [
client_1  |   {
client_1  |     suite: 'Managed BalenaOS release suite',
client_1  |     stats: { tests: 12, ran: 10, skipped: 2, passed: 10, failed: 0 },
client_1  |     tests: {
client_1  |       'Image preload test': 'passed',
client_1  |       'Move device to hostapd test App': 'skipped',
client_1  |       'Move device back to original app': 'skipped',
client_1  |       'Provisioning without deltas': 'passed',
client_1  |       'Override lock test': 'passed',
client_1  |       'Update supervisor randomized timer': 'passed',
client_1  |       'Set device environment variables': 'passed',
client_1  |       'Set service environment variables': 'passed',
client_1  |       'SSH authentication in production mode': 'passed',
client_1  |       'SSH authentication in development mode': 'passed',
client_1  |       'os-config service on boot': 'passed',
client_1  |       'os-config service randomized timer': 'passed'
client_1  |     },
client_1  |     dateTime: 'Tue Jan 14 2025 12:05:47 GMT+0000 (Coordinated Universal Time)'
client_1  |   }
client_1  | ]

@alexgg alexgg requested review from rcooke-warwick and a team and removed request for a team January 14, 2025 13:24
@alexgg alexgg temporarily deployed to balena-staging.com January 14, 2025 15:07 — with GitHub Actions Inactive
@flowzone-app flowzone-app bot merged commit a923047 into master Jan 14, 2025
160 of 162 checks passed
@flowzone-app flowzone-app bot deleted the alexgg/imx-test-locked branch January 14, 2025 15:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants