There are no tricks or hidden agendas. The purpose of this exercise is for you to demonstrate your technical knowledge, reasoning, and engineering practices using current software development ...

javascript-webcrawler is a JavaScript web crawler for collecting links. javascript-webcrawler is in it's alpha stage. Though there is room for improvement, it works right out of the box.

WebCrawler, probably the most bought and sold search engine on the web – and one of the first, celebrates its 10th birthday today. WebCrawler was developed by Brian Pinkerton in his spare time while a ...