Select skill for fine-tune

[linyuhongg]

Hi,

The paper states that during finetune the skill is searched through grid-search. However, in the code a fixed skill used, is that normal?

[amberxie88]

The grid search can/should be done in a separate file. The finetune file just finetunes the fixed skill

[sicko-mode-df]

Hi, have you got clear with this problem? I'm confused with this issue too.

[amberxie88]

Finetuning skill selection is not implemented in the CIC repository. However, we build off of the CIC repository and implement skill selection in Intrinsic Reward Matching (IRM): https://github.com/ademiadeniji/irm/blob/main/finetune.py#L303

Feel free to take a look for an example

[sicko-mode-df]

Thank you very much for your help, have a nice day!