25 May
2006
25 May
'06
4:30 a.m.
This should probably have been documented somewhere in the Web.Crawler module (sorry about that, although it's quite some time ago now):
Here are the different stages:
0: "waiting" 1: "fetching" 2: "fetched" 3: "filtered" 4: "indexed" 5: "completed" 6: "error"