remove model queries in alembic migration

[elfkuzco]

Changes

• remove model updates in alembic migrations to prevent issues like Zimfarm backend auto migrate in dev docker graph not working #1411 due to the model fields not being fully set as the migration runs incrementally.
• remove GET /offliners/{offliner_id} endpoint
• add route to create offliner via API
• make version optional while creating a schedule. attempt to select most recent version of the offliner definition
• drop "initial" defaults originally used for transition
• create shell script to pull offliner definitions from offliner repos and populate fresh database with offliner and definitions
• remove backend-tools from compose (don't think it really serves anymore)
• update container for running tests
• update dev/README to get any new dev started with new DB and updated instructions

This closes #1391

[elfkuzco]

@benoit74 , I am going to need your input on the permissions required for the offliner creation via API. I avoided using schedules, create=True because there are other roles with that permission that could not be prvileged to create an offliner. Left a todo comment on it. i don't know if this should be paused till #1419 is reviewed and possibly new permissions set.

WDYT?

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 82.57%. Comparing base (c9019ea) to head (bd14429).
⚠️ Report is 6 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1422      +/-   ##
==========================================
+ Coverage   82.37%   82.57%   +0.20%     
==========================================
  Files          78       78              
  Lines        3863     3873      +10     
  Branches      423      424       +1     
==========================================
+ Hits         3182     3198      +16     
+ Misses        565      560       -5     
+ Partials      116      115       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[benoit74]

Thank you!

• Regarding permissions, yes we need a new permission to create/update offliner definitions
• I don't like the idea of getting a default offliner definition if version is not passed; this is very convenient in dev but very risky in production ; I feel like the version should be a mandatory parameter once WP1 and zimit-frontend have been migrated to pass this parameter ; and in this PR we assume it is

[elfkuzco]

WP1 does not really have a UI to "select the version" they want to run and I figured they would also want to do similar thing. Because the API returns the versions as a list of strings in descending order of created_at. So, if they are going to select the version they would use by "choosing the first" because it should be the most recent, I figured it would be simpler to do it here and avoid one more API call. Same thing applies to Zimit frontend

Do you have an idea on how the selection should be done?

[benoit74]

You probably saw that after your comment, just for the reference: openzim/wp1#1024 (comment) (we will configure the version in WP1 config file)

[benoit74]

LGTM, please do not merge before openzim/zimit-frontend#176 and openzim/wp1#1024 are merged / solved

Moving to draft to avoid accident ^^