A open source proj can build your GPT base on crawler data

Updated on November 22, 2023 View Times: 1194

Catogery: AI
Share on Twitter
gpt-crawler

crawler

gpt-crawler

https://github.com/BuilderIO/gpt-crawler

A very popular GPT-related application recently. It can pass in one or more URLs and use a crawler to crawl down all the content. Then you can create a customized ChatGPT. The AI assistant I want to use as a knowledge base should be A great scene and still very practical.

The principle is also very simple - use crawlee to crawl all the incoming URLs, generate a data.json, and then create a custom GPT/custom assistant to upload the data.