Skip to content

Typo in parameter name (delimeter) in rt00006 test case for code_completion #7

@Sarang-Nambiar

Description

@Sarang-Nambiar
Image

Description:

In the code_completion task test set, item rt00006 contains delimeter as one of the parameter names and is consistent within the function docstring and the 1st choice in the available choices. However, within 2nd and 4th, the same parameter is referred as delimiter which could potentially confuse LLMs during benchmarking.

Do let me know if this is an intended feature.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions