Open
Description
Observed behavior
All too often, we are seeing differences between our test environment and the real installed environment.
Two factors:
- Use
src/
source structure to avoidkolibri/
folder being in the immediate path when running for instance test commands. Move kolibri/ to src/ #1953 already addresses this - Tox should build a real
.whl
, then install it, and then run the tests. This issue addresses this specific need.
Underlying problem is that when we run tests, our development environment is different because it may have a different path access the host system, but also that kolibri/dist
may or may not be populated. And the development environment may also have a different set of requirements installed in its virtualenv.
Solution:
- Set
usedevelop=false
in tox.ini - Build a
.whl
output in the first stages of Travis and reuse across all test envs. See also Travis' new build stages & build matrix optimizations #2975 - Remove the need to test the build since it will always be built (aka. conditional tests)
Expected behavior
That we can reproduce the problem reported in #3308 in a Travis VM.. and then fix it!