Preface

Project Description

This project is created for the final assignment of Document Processing (INSCI 2770),instructed by Professor Michael B. Spring, fall of 2001. We built a spider using as a web site mapping tool. It gets usful information from a web site and recursively tracks all links in the page. Analyzing the data generated by the spider reports HTML error, number of links per page, site age and so on.

We also built this tutorial site using most of all we learnt from this class such as web design, html, tables, style sheet, frames, image map, CGI, JavaScript, Perl and other technique and knowlegde.

The tutorial will give you the basic concept of spiders, some spider examples written by our classmates and instructor, other resources about spiders. If you like to take a quiz to test what you learn from this tutorial, please do so. We welcome your comments and feedback.

The students working on this project are Man Luo, Wenqi Su, Liqiang Xi.