Release 3.0.0 RC1

[individual-it]

Tasks

Pre QA Phase

• QA Kickoff meeting
• Create branch release-3.0.0-rc.1 -> CODEFREEZE
  • bump ocis version in necessary files
  • changelog/CHANGELOG.tmpl
  • ocis-pkg/version/version.go
  • sonar-project.properties
  • prepare changelog folder in changelog/3.0.0_????_??_??
• Check successful CI run on release branch
• Create signed tag v3.0.0-rc.1
• Check successful CI run on v3.0.0-rc.1 tag / BLOCKING for all further activity
• Merge back release branch
• bump released deployments to v3.0.0-rc.1
• update ocis.released.owncloud.works
• https://ocis.team.owncloud.works/
  • needs snapshot and migration

QA Phase

• Upgrade test from 2.0.0 to v3.0.0-rc.1 (using messagepack-> OCIS_DECOMPOSEDFS_METADATA_BACKEND: messagepack)
• run K6 on the latest tag (info will be here: why is download_runtimes.sh so slow? client#6097)
• web documentation @KarunAtreya https://doc.owncloud.com/webui/next/owncloud_web/
• general info @KarunAtreya https://doc.owncloud.com/ocis/next/deployment/general/general-info.html

single binary

• documentation @nirajacharya2 https://doc.owncloud.com/ocis/next/deployment/binary/binary-setup.html
• setup
• storage
  • local - smoke test @nirajacharya2 https://github.com/owncloud/QA/blob/master/Server/Test_Plan_OCIS_Smoke_Test.md
  • local - e2e tests @saw-jan
  • nfs - smoke test @KarunAtreya https://github.com/owncloud/QA/blob/master/Server/Test_Plan_OCIS_Smoke_Test.md
  • nfs - e2e tests @KarunAtreya
  • s3 - smoke test @KarunAtreya https://github.com/owncloud/QA/blob/master/Server/Test_Plan_OCIS_Smoke_Test.md
  • s3 - e2e tests @saw-jan
• desktop client interaction (message pack) - smoke test for desktop. ?
• desktop client interaction (message pack) - UI tests with squish @saw-jan
  CI run: https://drone.owncloud.com/owncloud/client/15236
  Gui report: https://cache.owncloud.com/public/owncloud/client/15236/ocis/guiReportUpload/index.html

test new features https://confluence.owncloud.com/display/PROD/Infinite+Scale+3.0+Featureset

• administration setting
• WCAG 2.1 AA ask @tbsbdr How to test
• Disable Resharing FRONTEND_ENABLE_RESHARING=false
• Disable Version Sharing
• password for sharing OCIS_SHARING_PUBLIC_WRITEABLE_SHARE_MUST_HAVE_PASSWORD
• Native Support for Apple Silicon @jesmrec
• Deny Access
• tiles view
• Tags

docker

• documentation @grgprarup https://doc.owncloud.com/ocis/next/deployment/container/container-setup.html
• setup
• smoke test @grgprarup https://github.com/owncloud/QA/blob/master/Server/Test_Plan_OCIS_Smoke_Test.md
• e2e tests @grgprarup

docker-compose

• documentation @grgprarup https://doc.owncloud.com/ocis/next/deployment/container/orchestration/orchestration.html#docker-compose
• setup & smoke test https://github.com/owncloud/QA/blob/master/Server/Test_Plan_OCIS_Smoke_Test.md
• e2e tests with wopi
• LDAP - smoke test https://github.com/owncloud/QA/blob/master/Server/Test_Plan_OCIS_Smoke_Test.md @ScharfViktor
• LDAP - e2e tests @ScharfViktor
• Traefik - smoke test https://github.com/owncloud/QA/blob/master/Server/Test_Plan_OCIS_Smoke_Test.md @ScharfViktor
• Traefik - e2e tests @ScharfViktor
• Hello extension
• Smoke test on Web Office (Collabora, Onlyoffice, Microsoft office)
• EOS Storage Driver smoke tests

helm/k8s @saw-jan

• documentation https://doc.owncloud.com/ocis/next/deployment/container/orchestration/orchestration.html#kubernetes-and-helm
• setup
• smoke test https://github.com/owncloud/QA/blob/master/Server/Test_Plan_OCIS_Smoke_Test.md
• e2e tests

test instance owncloud.works

• mail notifications with translation use inbucket https://github.com/owncloud/ocis/blob/master/deployments/examples/ocis_traefik/docker-compose.yml @ScharfViktor
• event system
• technical service metrics
• logging
• audit
• desktop client interaction
• android app interaction
• ios app interaction

on test instance

(ping @micbar for accounts)

• Fulltext search
• Authenticated Webfinger
• Antivirus @ScharfViktor
• File Firewall
• Custom Roles

Collecting errors found

• macdeployqt.py picks the wrong version of the dependencies if they're present in the $PATH client#6154
• DetermineAuth: Remove concept of Unknown client#6151
• Discovery: Treat files starting with '.' as hidden again client#6150
• Provide space_ref to share requests when using spaces client#10845
• PropagateDownload: Skip identical files more client#6168
• Ocis vs ldap. 500 error when adding multiple users to a group #6170
• libsync: Fix compilation with TOKEN_AUTH_ONLY client#6184
• ocis vs Wopi. Cannot open file in the collabora #6196
• Ocis vs ldap. Cannot share a file that is open in collabora #6197
• [OCIS] Sharee can see a deleted shared folder web#8960
• Permissions of $HOME/.local/share/data client#6201
• space shares to groups have to be recreated. We started sending a filter for performance reasons, but after implementing the server side we noticed that a group index was missing: add by group index to decomposedfs cs3org/reva#3826

test instance bugs

• Antivirus: 5709, 5708, 5707, 5706
• 5701, 5702, 5704, 5705

After QA Phase

• Brief company-wide heads up via mail @tbsbdr

• Create branch release-3.0.0

  • bump ocis version in necessary files
  • changelog/CHANGELOG.tmpl
  • ocis-pkg/version/version.go
  • sonar-project.properties
  • released deployment versions
  • prepare changelog folder in changelog/3.0.0_???

• Release Notes @tbsbdr

• Create final signed tag v3.0.0 @micbar

• Check successful CI run on v3.0.0 tag / BLOCKING for all further activity

• Merge release notes

• post-release communication

  • Ping documentation in RC about the new release tag (for ocis version bump in docs)
  • Ping marketing to update all download links (download mirrors are updated at the full hour, wait with ping until download is actually available)
  • Ping @JRundfeldt in RC #oCIS-beta channel once the GA is available to make clear beta is over
  • Ping @hodyroff once the demo instances are running this release
  • notify @michaelstingl @hosy @fmoc @jesmrec to publish client finals

• Merge back release branch

[ScharfViktor]

Compatibility test

from 2.0.0 to 3.0.0-rc.1

Create these with the original oCIS version and see if still the same after upgrading:

• shares
  • public share
  • share with user as role editor
  • share with user as role viewer
  • share with group "Users"
• settings
  • language settings
• files
  • uploaded folder & files
  • trashed files
• project space
  • uploaded folder & files
  • trashed files
  • share space with user
  • public share space
• users
  • non demo user with role admin
  • non demo user with role user
  • created new user
  • created new group

remarks:

aftrer switching to ocis:3.0.0-rc.1 need to add GRAPH_APPLICATION_ID: random UUID to env see #6118

• search problem: ocis server crash and restarts again

{"level":"info","service":"search","error":"error parsing mapping JSON: unexpected end of JSON input\nmapping contents:\n","transport":"grpc","time":"2023-04-25T13:27:34.133647044Z","line":"github.com/owncloud/ocis/v2/services/search/pkg/command/server.go:62","message":"Failed to initialize server"}

{"level":"info","service":"ocis","event":"ocis: Failed service 'command.SutureService{cfg:(*config.Config)(0x40016174a0)}' (1.000000 failures of 5.000000), restarting: true, error: error parsing mapping JSON: unexpected end of JSON input\nmapping contents:\n","time":"2023-04-25T13:27:34.133686128Z","line":"github.com/owncloud/ocis/v2/ocis/pkg/runtime/service/service.go:184","message":"supervisor: ocis"}

• tag GET https://ocis.owncloud.test/graph/v1.0/extensions/org.libregraph/tags 500 code
  log:

{"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"61c47fbc-f9f8-4938-89e9-300dab7f9346","remote-addr":"192.168.16.1","method":"GET","status":500,"path":"/graph/v1.0/extensions/org.libregraph/tags","duration":21.181458,"bytes":0,"time":"2023-04-25T13:28:07.194669171Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:28","message":"access-log"}

[individual-it]

smoke test with local storage

Case 1: admin share folder(with file) to marie:

Admin:

• upload big file 10gb (Show details, pause upload, resume upload work correct)
• upload folder with 803 small images. [OCIS] Folder size diffrent on personal page. web#8966
• Check pagination, count items per page.
• upload folder(drag folder) "folder_to_share" with sample.pdf
• share folder "folder_to_share" to marie with editor role

Marie:

• accept "folder_to_share"
• upload new file "file.txt" to "folder_to_share" (admin sees file.txt)
• open sample.pdf
• rename sample.pdf to file.pdf (use rigth click) (admin now sees file.pdf)

Admin:

• add new file.jpeg to "folder_to_share"
• move file.pdf to root (ctrl x -> ctrl v) "personal" (marie can not see file.pdf)
• add new "file.txt" (select replace option) create new version. (use drag and drop)
• open "file.tx" in markdown-editor. Change and save. (admin sees "file.txt" updated)

Marie:

• can download both versions (version is not available for sharee)
• can restore old version (version is not available for sharee)

Admin:

• change share "folder_to_share" from role "editor" to "viewer" (marie cannot rename/move/delete files in folder and cannot create new document in the folder)

Marie:

• can decline "folder_to_share"
• can accept again

Admin:

• delete folder "folder_to_share" (removed from shared with me, removed from Marie) [OCIS] Sharee can see a deleted shared folder web#8960

Case 2: admin share file to marie:

Admin:

• upload file.jpeg
• share file.jpeg to marie with role viewer (use main menu. find marie by email marie@example.org)

Marie:

• accept file
• can open/download file
• can share/copy quicklink
• cannot delete/move/rename file

Admin:

• share share "file.txt" with editor role

Marie:

• change content of the file (cannot see new version- denied for the recipient)

Admin:

• remove share "file.jpeg" (marie cannot see "file.jpeg")

Case 3: admin create public links to folder

Admin:

• create folder "for upload"
• add link with name "to_upload" with role "Uploader" with password and expiration date
• open link and enter password (can only upload)
• upload file (admin can see new file)
• change share "for upload" from "Uploader" to "editor"
• admin add new file to folder "for upload"
• refresh link (file exist)
• admin changes password (refresh link has to type new password)

Case 4: admin create link to file

Admin:

• create file png
• add link with main menu
• open link(can open, download, see) in the incognito tab
• edit link by adding password
• refresh page (input password)
• delete link
• refresh page (resource not found)
• delete file
• restore
• delete
• Empty trash

Case 5: space story:

Katherine:

• create space
• add space image
• add subtitle "for test"
• edit description
• try to upload file (more 1 Gb)
• increase quota to 5Gb and try again
• delete file
• add member Marie with editor role
• add member Einstein with viewer role

Marie:

• can see space without accepting
• change image and description
• can upload file/folder and create file and folder
• can create resource but cannot share space or space resource
• can see deleted files and can restore files from trash
• cannot disable space

Einstein:

• can see space without accepting
• cannot change image and description
• cannot upload file/folder and create file and folder
• cannot create resource and share space
• can see deleted files and cannot restore files from trash
• cannot disable space

Case 6: create new user via accounts:

Admin:

• create new user account
• create new group
• add user to group
• share folder with group
• change language
• delete users

Case 7: Search

• personal space
• project space
• share jail

[grgprarup]

Smoke test with docker

Case 1: admin share folder(with file) to marie:

Admin:

• upload big file 10gb (Show details, pause upload, resume upload work correct)
• upload folder with 803 small images.
• Check pagination, count items per page.
• upload folder(drag folder) "folder_to_share" with sample.pdf
• share folder "folder_to_share" to marie with editor role

Marie:

• accept "folder_to_share"
• upload new file "file.txt" to "folder_to_share" (admin sees file.txt)
• open sample.pdf
• rename sample.pdf to file.pdf (use rigth click) (admin now sees file.pdf)

Admin:

• add new file.jpeg to "folder_to_share"
• move file.pdf to root (ctrl x -> ctrl v) "personal" (marie can not see file.pdf)
• add new "file.txt" (select replace option) create new version. (use drag and drop)
• open "file.tx" in markdown-editor. Change and save. (admin sees "file.txt" updated)

Marie:

• can download both versions (version is not available for sharee)
• can restore old version (version is not available for sharee)

Admin:

• change share "folder_to_share" from role "editor" to "viewer" (marie cannot rename/move/delete files in folder and cannot create new document in the folder)

Marie:

• can decline "folder_to_share"
• can accept again

Admin:

• delete folder "folder_to_share" (removed from shared with me, removed from Marie) [OCIS] Sharee can see a deleted shared folder web#8960

Case 2: admin share file to marie:

Admin:

• upload file.jpeg
• share file.jpeg to marie with role viewer (use main menu. find marie by email marie@example.org)

Marie:

• accept file
• can open/download file
• can share/copy quicklink
• cannot delete/move/rename file

Admin:

• share share "file.txt" with editor role

Marie:

• change content of the file (can see new version)

Admin:

• remove share "file.jpeg" (marie cannot see "file.jpeg")

Case 3: admin create public links to folder

Admin:

• create folder "for upload"
• add link with name "to_upload" with role "Uploader" with password and expiration date
• open link and enter password (can only upload)
• upload file (admin can see new file)
• change share "for upload" from "Uploader" to "editor"
• admin add new file to folder "for upload"
• refresh link (file exist)
• admin changes password (refresh link has to type new password)

Case 4: admin create link to file

Admin:

• create file png
• add link with main menu
• open link(can open, download, see) in the incognito tab
• edit link by adding password
• refresh page (input password)
• delete link
• refresh page (resource not found)
• delete file
• restore
• delete
• Empty trash

Case 5: space story:

Katherine:

• create space
• add space image
• add subtitle "for test"
• edit description
• try to upload file (more 1 Gb)
• increase quota to 5Gb and try again
• delete file
• add member Marie with editor role
• add member Einstein with viewer role

Marie:

• can see space without accepting
• change image and description
• can upload file/folder and create file and folder
• can create resource but cannot share space or space resource
• can see deleted files and can restore files from trash
• cannot disable space

Einstein:

• can see space without accepting
• cannot change image and description
• cannot upload file/folder and create file and folder
• cannot create resource and share space
• can see deleted files and cannot restore files from trash
• cannot disable space

Case 6: create new user via accounts:

Admin:

• create new user account
• create new group
• add user to group
• share folder with group
• change language
• delete users

Case 7: Search

• personal space
• project space
• share jail

[ScharfViktor]

e2e tests agains ocis_traefik using messagepack - successfully

[ScharfViktor]

smoke ocis agains ldap

• connect ocis 2.0.0 to ldap
• create demo users and group
• create ldap user u1
• create ldap group g1
• add user u1 to group g1
• delete philosophy-haters group
• delete marie user
• upgrade ocis to 3.0.0 rc.1 (OCIS_DECOMPOSEDFS_METADATA_BACKEND: messagepack)
• created demo users and group still exist
• created ldap users u1 and group g1 still exist
• deleted group and user doesn't exist
• recurring ldap users u1 can still log in.
• create new ldap user u2
• create new ldap group g2
• add new user u2 to group g1 and g2
• new users u2 can log in
• find sharees?search= by u1, u2, g1, g2, demo users and group and share
• disable user u1, u2, einstein
• delete physics-lovers, g1, g2, einstein, u1, u2

Remarks: Admin can not change/create users or group using Administration Settings but can delete groups and users - fixed here #6164

[grgprarup]

smoke test with s3 storage

Case 1: admin share folder(with file) to marie:

Admin:

• upload big file 10gb (Show details, pause upload, resume upload work correct)
• upload folder with 803 small images.
• Check pagination, count items per page.
• upload folder(drag folder) "folder_to_share" with sample.pdf
• share folder "folder_to_share" to marie with editor role

Marie:

• accept "folder_to_share"
• upload new file "file.txt" to "folder_to_share" (admin sees file.txt)
• open sample.pdf
• rename sample.pdf to file.pdf (use rigth click) (admin now sees file.pdf)

Admin:

• add new file.jpeg to "folder_to_share"
• move file.pdf to root (ctrl x -> ctrl v) "personal" (marie can not see file.pdf)
• add new "file.txt" (select replace option) create new version. (use drag and drop)
• open "file.txt" in markdown-editor. Change and save. (admin sees "file.txt" updated)

Marie:

• can download both versions (version is not available for sharee)
• can restore old version (version is not available for sharee)

Admin:

• change share "folder_to_share" from role "editor" to "viewer" (marie cannot rename/move/delete files in folder and cannot create new document in the folder)

Marie:

• can decline "folder_to_share"
• can accept again

Admin:

• delete folder "folder_to_share" (removed from shared with me, removed from Marie) [OCIS] Sharee can see a deleted shared folder web#8960

Case 2: admin share file to marie:

Admin:

• upload file.jpeg
• share file.jpeg to marie with role viewer (use main menu. find marie by email marie@example.org)

Marie:

• accept file
• can open/download file
• can share/copy quicklink
• cannot delete/move/rename file

Admin:

• share share "file.txt" with editor role

Marie:

• change content of the file (can see new version)

Admin:

• remove share "file.jpeg" (marie cannot see "file.jpeg")

Case 3: admin create public links to folder

Admin:

• create folder "for upload"
• add link with name "to_upload" with role "Uploader" with password and expiration date
• open link and enter password (can only upload)
• upload file (admin can see new file)
• change share "for upload" from "Uploader" to "editor"
• admin add new file to folder "for upload"
• refresh link (file exist)
• admin changes password (refresh link has to type new password)

Case 4: admin create link to file

Admin:

• create file png
• add link with main menu
• open link(can open, download, see) in the incognito tab
• edit link by adding password
• refresh page (input password)
• delete link
• refresh page (resource not found)
• delete file
• restore
• delete
• Empty trash

Case 5: space story:

Katherine:

• create space
• add space image
• add subtitle "for test"
• edit description
• try to upload file (more 1 Gb)
• increase quota to 5Gb and try again
• delete file
• add member Marie with editor role
• add member Einstein with viewer role

Marie:

• can see space without accepting
• change image and description
• can upload file/folder and create file and folder
• can create resource but cannot share space or space resource
• can see deleted files and can restore files from trash
• cannot disable space

Einstein:

• can see space without accepting
• cannot change image and description
• cannot upload file/folder and create file and folder
• cannot create resource and share space
• can see deleted files and cannot restore files from trash
• cannot disable space

Case 6: create new user via accounts:

Admin:

• create new user account
• create new group
• add user to group
• share folder with group
• change language
• delete users

Case 7: Search

• personal space
• project space
• share jail

[ScharfViktor]

e2e tests against ldap:

Remarks:

## no notiffication to user. no configuration in docker compose

log:

{"level":"error","service":"proxy","error":"not found","service":"com.owncloud.userlog.userlog","time":"2023-04-27T12:17:29.423137876Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/router/router.go:139","message":"could not select service from the registry"}


2023/04/27 12:17:29 http: proxy error: unsupported protocol scheme ""

{"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"9651f55d-9ade-4abc-b5cc-2359cd6a079e","remote-addr":"172.29.0.1","method":"GET","status":502,"path":"/ocs/v2.php/apps/notifications/api/v1/notifications","duration":10.633583,"bytes":0,"time":"2023-04-27T12:17:29.423246334Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:28","message":"access-log"}

## batch action add users to group gets error 500

log:

{"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"8274a111-4d0c-4736-bd8e-f31cefea247e","remote-addr":"172.29.0.1","method":"POST","status":204,"path":"/graph/v1.0/groups/be2bdfad-348e-431a-b016-29362024d748/members/$ref","duration":23.627458,"bytes":0,"time":"2023-04-27T12:29:27.500430042Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:28","message":"access-log"}

{"level":"info","service":"graph","request-id":"0484eedc-a675-46f8-8b80-940d94d5651c","error":"LDAP Result Code 16 \"No Such Attribute\": modify/delete: member: no such value","time":"2023-04-27T12:29:27.500694958Z","line":"github.com/owncloud/ocis/v2/services/graph/pkg/identity/ldap_group.go:335","message":"Failed to modify group member entries on PATCH group"}

{"level":"info","service":"graph","request-id":"cc2771a2-ec62-41fe-be2f-6c6039d851de","error":"LDAP Result Code 16 \"No Such Attribute\": modify/delete: member: no such value","time":"2023-04-27T12:29:27.500871875Z","line":"github.com/owncloud/ocis/v2/services/graph/pkg/identity/ldap_group.go:335","message":"Failed to modify group member entries on PATCH group"}

{"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"cc2771a2-ec62-41fe-be2f-6c6039d851de","remote-addr":"172.29.0.1","method":"POST","status":500,"path":"/graph/v1.0/groups/be2bdfad-348e-431a-b016-29362024d748/members/$ref","duration":24.471458,"bytes":204,"time":"2023-04-27T12:29:27.501266958Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:28","message":"access-log"}

{"level":"info","service":"proxy","proto":"HTTP/1.1","request-id":"0484eedc-a675-46f8-8b80-940d94d5651c","remote-addr":"172.29.0.1","method":"POST","status":500,"path":"/graph/v1.0/groups/be2bdfad-348e-431a-b016-29362024d748/members/$ref","duration":24.708583,"bytes":204,"time":"2023-04-27T12:29:27.501528833Z","line":"github.com/owncloud/ocis/v2/services/proxy/pkg/middleware/accesslog.go:28","message":"access-log"}

{"RemoteAddr":"","User":"","URL":"","Method":"","UserAgent":"","Time":"","App":"admin_audit","Message":"user 'ddc2004c-0977-11eb-9d3f-a793888cd0f8' added user 'be2bdfad-348e-431a-b016-29362024d748' was added to group '91b3705c-6df0-47bb-b98f-2b4eac51ff92'","Action":"group_member_added","CLI":false,"Level":1,"GroupID":"be2bdfad-348e-431a-b016-29362024d748","UserID":"91b3705c-6df0-47bb-b98f-2b4eac51ff92"}

[ScharfViktor]

test hello extension- failed
same error as here: #4986 (comment)

[kulmann]

test hello extension- failed
same error as here: #4986 (comment)

That is expected. hello extension is not maintained.