Goal:

I will look during this project for existing tools and test suites Upstream, used by others distros (like 1) Fedora, 2) Arch-Linux, 3) Debian), and try to learn how they test, use their tool, projects.

After the first analysis, i will pick-up some tools, and try to integrate this with our automation. After this, i will try to contribute on the opensource project of the other distros, and make a collaboration upstream for improve our testing automation, and make it more like a multi-ethnic place (in a distros point of view, or opensource). If in this a loot of projects/opportunity some will catch my attention, i will try to make a sort of collaboration for testing together.

In my experience i see that a lot of distros use a common Pattern for testing packages, or using some frameworks, tools, but we are more like a Leibniz "monade" then a city like Babylon.

Starting points:

https://fedoraproject.org/wiki/QA

https://qa.debian.org/

result of my analyze: ( i don't analyze openSUSE/SUSE since i know that ;) )

  • 1) Meta-Process information (testcases, workflow etc)
  • 2) Tool based analyze.

Meta-Process information (testcases, workflow etc)

Process of QA in upstreams-community:
FEDORA QA, CENTOS, Red-hat

1) Fedora as great testcases well definided.

1) Are tool-agnostic. 2) Are really well defined, not like " ensure the network of systems works"

https://fedoraproject.org/wiki/Category:TestCases https://fedoraproject.org/wiki/Template:QA/TestCase https://fedoraproject.org/wiki/TestResults:Fedora25Rawhide20160622.n.0Summary?rd=TestResults:Current_Summary

Points : 8/10 I really like the wikipage, how they described really techn. and comprehensive testcases. Good work is there.

2) Automation tools( that openSUSE/SUSE doesn't use)

Taskotron https://taskotron.fedoraproject.org/

I cannot imagine for moment an use-case of this tool for moment, since we have SLEnkins and OpenQA that make similar tasks

sig-core-t https://github.com/CentOS/sig-core-t_functional

This is a github repo containing some basic tests for packages.

Really nice, since are bash testing. Could be picked ud for increase some testing coverages on some base packages.

DEBIAN/Ubuntu QA

Debian Packages that Need Lovin'.

http://wnpp.debian.net/

Really cool project. Imho, @ openSUSE/SUSE we don't have something like that for package need love.

Arch-linux QA

nothing found.

Looking for mad skills in:

Nothing? Add some keywords!

This project is part of:

Hack Week 14

Activity

  • over 2 years ago: dmaiocchi started Babylon Testing
  • over 2 years ago: dmaiocchi originated Babylon Testing
  • Show History

    Comments

    • dmaiocchi
      over 2 years ago by dmaiocchi | Reply

      abrt

    • dmaiocchi
      over 2 years ago by dmaiocchi | Reply

      https://hackweek.suse.com/14/projects/1196

    • tbechtold
      over 2 years ago by tbechtold | Reply

      FYI: Debian has a tool called autopktest. It's testing per package and the CI is here: https://ci.debian.net/ . See https://lwn.net/Articles/605405/ and http://dep.debian.net/deps/dep8/

    • dmaiocchi
      over 2 years ago by dmaiocchi | Reply

      @thbechtold cool thank you, i will have a look ! great thx

    Similar Projects

    This project is one of its kind!