To compile and organize entries for a search engine or content index by reading Web pages or other content.