Service graphs

daily graph weekly graph
monthly graph yearly graph

Graph Information

Shows how many urls make it to indexing and how many get dropped in the process

Field Internal name Type Warn Crit Info
QueueFeeder successful SUCCESSFULLY_QUEUED gauge     SUCCESSFULLY_QUEUED
QueueFeeder error ERROR_CREATE_FETCH_ITEM gauge     ERROR_CREATE_FETCH_ITEM
QueueFeeder exception ABOVE_EXCEPTION_THRESHOLD gauge     ABOVE_EXCEPTION_THRESHOLD
QueueFeeder hit by timelimit HIT_BY_TIMELIMIT gauge     HIT_BY_TIMELIMIT
Generator skipped per host overflow URLS_SKIPPED_PER_HOST_OVERFLOW gauge      
QueueFeeder total total gauge     total URLs fed to fetcher threads by QueueFeeder
Deleted from index (deplicate) index_delete_dup gauge      
Deleted from index (gone) index_delete_gone gauge      
Deleted from index (redirect) index_delete_redir gauge      
Indexed (add or update) index_add_update gauge      
host queues dropped by fetcher droppedQueues gauge     host queues (not urls) that have been dropped in the fetching process.