Skip to content

[Task] Add regression tests for session-based models #1047

Open
@bschifferer

Description

@bschifferer

Description

We want to add a CI test, that collects metrics to understand if performance changes between releases.

First step:

@radekosmulski shared ideas on it here: https://nvidia.slack.com/archives/CVBDJUPEZ/p1679617586380369

We will collect:

  • Runtime NVTabular
  • Runtime Training Model with TensorFlow
  • NDCG Performance of Session-based model

I close other tickets related to it:

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions