Skip to content

chore(documentation): add context on why 48-vector element#4

Open
Warkanlock wants to merge 1 commit into
bbycroft:mainfrom
Warkanlock:warkanlock-rewording
Open

chore(documentation): add context on why 48-vector element#4
Warkanlock wants to merge 1 commit into
bbycroft:mainfrom
Warkanlock:warkanlock-rewording

Conversation

@Warkanlock

@Warkanlock Warkanlock commented Dec 3, 2023

Copy link
Copy Markdown

Creating just in case you want to include this information about adding context to the particular 48-element vector explained in the embedding part.

For non-knowledgable people in the field, it might look like a result of the inputs related to the actual architecture of the nano-gpt model.

For me, it took me a while to realize although it will be awesome to add context directly on the visualization

Source: https://github.com/karpathy/minGPT/blob/master/mingpt/model.py

@vercel

vercel Bot commented Dec 3, 2023

Copy link
Copy Markdown

@Warkanlock is attempting to deploy a commit to the Brendan's Team Team on Vercel.

A member of the Team first needs to authorize it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant