It is easy to configure Mendable to scrape a 🌐 public web site, but what if your web site is 🔐 private?
This utility is designed to scan your Docusaurus site locally, and upload the content to Mendable. It is particularly useful for private web sites where Mendable can't access. However, the markdown is uploaded, which may be better even for public Docusaurus sites.
I was inspired to build this to upload a private Docusaurus site for Mendable Search.
Configure your environment: .env (or .env.local)
MENDABLE_SERVER_API_KEY=9ba...3be
- The
MENDABLE_SERVER_API_KEYvalue may alternatively be passed as a command-line argument (--api-key) - Environment variables may alternatively be configured using the command-line, like:
export MENDABLE_SERVER_API_KEY=9ba...3be
Build the utility: pnpm build
See the usage: pnpm scrape
Run against a project: pnpm scrape ../docusaurus-project-docs https://project-org.github.io/docusaurus-project-docs