阅读搜索引擎小工具readengine
阅读搜索引擎小工具
可以对网页获取正文内容并且索引,提供用户后期搜索索引查找网页的功能
项目地址 https://github.com/sillydong/readengine
readengine
ReadEngine can index main contents of the url and index into search engine. You can search later by keyword.
ReadEngine used the goreadability
from https://github.com/philipjkim/goreadability and copied the main code into this project as it used goquery
from its vendor which is an older version. Also I changed the fastimage from https://github.com/philipjkim/fastimage to https://github.com/sillydong/fastimage because my fastimage supports more image formats.
How To Install
ReadEngine need CGO_ENABLE=1
because it used the gojieba
library to parse Chinese.
make
will make the bin in the code path.make install
will make and install to your$GOBIN
path with config.yaml and dict.make clean
will clean the bin in the code path
How To Use
Index
readengine url "https://geeks.uniplaces.com/building-a-worker-pool-in-golang-1e6c0fdfd78c"
Search
readengine search "go"
Rebuild
readengine rebuild
History
readengine history
TODO
- maybe index file contents?
- maybe a web page for search and read?
- maybe packup webpage for later read to avoid the source page be deleted?
- maybe a better search engine?