Haiyan Meng f5419e9f72 Check the incomplete_results field of github query responses ...

Currently, we don't check the `incomplete_results` field of a github
query response, which is problematic when incomplete query results are
used to split the query ranges: the splitted query ranges will
be very wild.

2020-02-03 09:59:52 -08:00

..

github

Check the incomplete_results field of github query responses

2020-02-03 09:59:52 -08:00

crawler_test.go

Add a fileType field into the index

2020-01-17 13:15:49 -08:00

crawler.go

Improve the efficiency of crawling github by skipping the documents

2020-01-24 19:55:56 -08:00