5 Commits

Author	SHA1	Message	Date
Haiyan Meng	f5419e9f72	Check the incomplete_results field of github query responses ... Currently, we don't check the `incomplete_results` field of a github query response, which is problematic when incomplete query results are used to split the query ranges: the splitted query ranges will be very wild.	2020-02-03 09:59:52 -08:00
Haiyan Meng	7a87c84403	Reprocess the github filesize search ranges which have more than 1000 items	2020-02-03 09:59:52 -08:00
HowJMay	00f68c12a8	fix typos ... Fix typos	2020-01-23 23:35:38 +08:00
Haiyan Meng	a9244f759e	Add supports for crawling a specific git user or repo	2019-12-13 11:18:33 -08:00
Haiyan Meng	f69d2d2e69	Move hack/crawl under api/internal	2019-11-14 13:17:28 -08:00