Timesys Test Automation Solution (TAS) with Continuous Testing

Timesys Test Automation Solution (TAS) with Continuous Testing

Built on open-source, and deployed behind your firewall

Develo ion

pment

Zombie 1

tion Reports

Continuous Integra

E

mbedded

Board Farm

Customer Network

Te st Automat

Dev Boards

Test Automation Service and Embedded Board Farm

CI Master

Build Slaves

Artifact Storage

Zombie 4

Dev Boards

Test

Package Test Reports

Repository Sources

& Logs

Designed to complement and extend your existing test infrastructure, TAS is composed of six major components that include:

? Remote Access Embedded Board Farm (EBF): Features APIs to integrate test automation frameworks and develop test cases for embedded devices

? Test Framework: Pre-integrated LAVA test automation framework, extensible and bundled with open-source test case templates, test job wizard for scheduling tests, and email notification of test job status

? CI System: Pre-Integrated with Jenkins, a Continuous Integration (CI) system, enables continual testing to reveal functional and performance regressions at Linux kernel, OS, and application levels

? Development Environment and Build Systems Integration: Pre-integrated with Yocto BSPs and Timesys Factory BSPs

? Test Case Management: Built-in with creation of test cases, test suites, and test plans, and importing of existing test case capabilities

? Report Management: Report generation in multiple formats, report comparison between test job runs, and import of test reports from other test frameworks

Embedded Linux Dev Environment

Build Environments

Yocto Project Timesys Factory

Source Code Repositories

Zombie Zombie

Master

Zombie

Zombie

Develop new test cases, test suites and integrate existing test cases using Remote Access EBF APIs.

Create test jobs for test automation and integrate them with Continuous Integration frameworks like Jenkins.

Generate reports for quality analysis and inspection, making the development process more efficient and enabling the delivery of higher quality products at lower cost.

CI Master

Enterprise Network

Timesys Remote Access Embedded Board Farm (EBF) and Test Automation

Build Slaves

Artifact Storage

Test

Test Reports

Repository

& Logs

Test Automation Solution (TAS) Workflow

Flexible and extensible, Timesys' TAS allows integration with other CI systems, build systems,

test frameworks and test case management software.

TAS comes with some pre-integrated components as well as APIs to enable easy integration of other components:

? Accessible via browser from anywhere ? Continuous integration system plugins:

Jenkins

- CI configuration policies - Artifact (build image) storage policies - Easy to integrate plugins for other CI

(Bamboo, Buildbot) ? Source code management integration: Git

- Easy to integrate other SCM (SVN, ...) ? Build system integration: Yocto, Factory

- Easy to integrate other build systems (Buildroot, Android, Soong, ...)

? Test automation framework for pipelining and executing the tests: (LAVA, Squish*) - LAVA Test Jobs - Job Definition wizard - Create, View, Delete, Refresh & SaveAs - Sample YAML - API to submit Saved Test Job use by CI (e.g. Jenkins) - Test execution over Serial and SSH - Job run across reboot (e.g. crashme) - Manual and automated scheduled execution - Test Job Run details and logs - Commandtine tests using shell on DUT for output verification

? Scheduling policy management (Jenkins, manual)

? Test repository (basic built-in) - User Defined Tests - Test Editor - Import existing test scripts and binaries

? Test case templates - Iperf (network performance) - Lmbench (performance analysis) - Bonnie (filesystem performance) - Crashme - LTP (Linux Test Project)

? Device layer: 24x7 availability of boards with APIs for executing the automated tests (Timesys EBF) - Multi-user Support (login controlled) ? Enables multiple users to connect into the cloud simultaneously, while allowing each logged in user to control can use different boards connects into the cloud simultaneously - APIs for automation ? GPIO (bit or byte) ? SD card switch ? USB memory switch ? USB hotplug ? Ethernet hotplug - Boot Medias ? SD card (multiple partitions), USB, Network Boot (tftp/nfs)

? Reporting - Generate mulitple formats (html, xml, xls, JUnit) - Report comparison - Report notification via email

Benefits of the Timesys Test Automation Solution include:

? Code quality -- Ability to track and show consistency and measurable improvement in code quality by comparing results over time

? Functional regression -- Ability to catch functional regression early in the development cycle

? Performance regression -- Enables timely discovery of performance degradation vs. waiting for the QA/ Validation cycle

? Continuous development -- Integration with Timesys Board Farm Cloud enables discovery of bugs and performance issues early in the development cycle

? Repeatability -- Variability in testing methodology implicit with manual testing is eliminated

? Release ready -- Reduces cycle time for release preparedness, important for bug fixes and vulnerability patches

? Summarized reports -- Enables easy comparison of reports

? Easy integration with your existing workflow

? Build and source code management (SCM) system independent

? CI integration service ? Track and trace -- Documentation

to assist certification or internal audit for development maturity models

To learn more about the Timesys Test Automation Solution, email us at sales@ or call us at 1.866.392.4897 (toll-free) or +1.412.232.3250 to schedule a complimentary, no-obligation consultation.

Headquarters / North America Office 1905 Boulevard of the Allies, Pittsburgh, PA 15219 UNITED STATES 1.866.392.4897 sales@

EMEA Office ul. Palmowa 1A, 62-081 Chyby POLAND +48.53.733.8080 emea@

APAC Office 3rd Floor, Jaag Homes, Achyutha Square, No. 3, MTH Road, Villivakkam, Chennai, Tamil Nadu ? 600 049 INDIA +91.0124.4299897 apac@

Copyright ? 2019 Timesys Corporation. All Rights Reserved.

Rev. 2-20200817-A

Timesys and the Timesys logo are registered trademarks of Timesys Corporation. Linux is a registered trademark of Linus Torvalds in the United States and other countries. All other company and product names mentioned and marks and logos used are trademarks and/or registered trademarks of their respective owners.

 ................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download