Skip to content

[Task] Add regression tests for session-based models #1047

Description

@bschifferer

Description

We want to add a CI test, that collects metrics to understand if performance changes between releases.

First step:

@radekosmulski shared ideas on it here: https://nvidia.slack.com/archives/CVBDJUPEZ/p1679617586380369

We will collect:

  • Runtime NVTabular
  • Runtime Training Model with TensorFlow
  • NDCG Performance of Session-based model

I close other tickets related to it:

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions