Bootstrapping

[Malix-Labs]

Bootstrapping would be a nice milestone

https://bootstrappable.org/

[Malix-Labs]

#51 (comment)

@Ze7111 ?

[Ze7111]

This issue auto-closed due to timeout, but bootstrapping is very much alive. So far we've progressed:

completed

core

• SourceManager: location mapping, file reads, line tables
• VFM: chunking for 32-bit virtual buffers, memory-mapped file handling
• Location primitives: SourceRange, SourceLocation
• Memory mapping: MMapRegion, MemoryBuffer, page files
• Token system: TokenBuffer, Token (crazy sizeof(Token) is only 16bytes), TokenKind
• Memory management: ArenaAllocator, GlobalRecycler
• Threading: lock-free ThreadPool, SmallFunction

lexer

• Keywords, identifiers, numbers, strings, operators, whitespace handling
• ~200ns/token on M2 Pro
• Passes unit tests; approximately 75% of Stage 2 quality
• ThreadPool integration for hot path scheduling

unicode support

• UTF-8 decoding with SIMD optimization
• CharTable for character classification
• Wide character support

utilities

• String hashing (narrow and wide)
• HashState for incremental hashing
• Keyword lookup tables

build system

• cross platform scripts (batch, PowerShell, shell)
• Test harness with extraction and execution

---

In Progress

• Preprocessor (regular macros macro something!)
• Lexer refactoring (all token kinds parsing works, refactor is next)
• DiagnosticEngine @mbambav
• CLI Driver @OjasTalgaonkar

---

Status

Team is on winter break. Development resumes in January.
New name for the language and toolchain coming soon!

---

@Malix-Labs appreciate the ping. Happy to answer questions.