tests: set up nightly regression tests

From derek.br...@gmail.com on February 14, 2009 10:30:29

If we can procure cycles on machines somewhere we should set up nightly or bi-nightly regression tests.

Our tests at Determina used to take over 24 hours. After issue #8 (closed) prunes them to target just the API they should get shorter.

For a first pass we should have:

• 64-bit Linux of some sort: can run 32-bit tests here
• 32-bit Windows XP
• 64-bit Windows Vista

Due to missing WOW64 follow-children (issue to be file: xref issue #3 ) we can't do full 32-bit testing on a 64-bit Windows machine.

Ideally we should have at least one machine with some flavor of Windows NT, Windows 2000, Windows XP, Windows 2003, and Windows Vista, in each of 32-bit and for the later ones 64-bit, along with several flavors of Linux, and both AMD and Intel processors of several varieties. We can use virtual machines for nearly all our tests but it would be nice to have nightly performance tests on native machines.

We should also have at least one 64-bit Linux and one 64-bit Windows machine that can run a pre-commit regression test on demand for use by developers who do not have one of each flavor locally available.

Original issue: http://code.google.com/p/dynamorio/issues/detail?id=11