Curious on projects using MLX for coding assistants?

[vade]

I'm curious if anyone has seen a nice implementation using MLX / MLX-Swift for a local only coding assistant to run along side Xcode. If I can point it to a local repository and get debug, coding assistance etc it would be huge.

Has anyone seen any projects along those lines?

[davidkoski]

Not exactly what you were looking for, but I wonder if it would be a starting point:

• https://github.com/ml-explore/mlx-swift-examples/blob/main/Libraries/LLM/Models.swift

    public static let codeLlama13b4bit = ModelConfiguration(
        id: "mlx-community/CodeLlama-13b-Instruct-hf-4bit-MLX",
        overrideTokenizer: "PreTrainedTokenizer",
        defaultPrompt: "func sortArray(_ array: [Int]) -> String { <FILL_ME> }"

There is also a Starcoder2 model, though no configuration for it:

• https://github.com/ml-explore/mlx-swift-examples/blob/main/Libraries/LLM/Starcoder2.swift