cz.utb.caribou.digger.crawler

Class CrawlerManager

java.lang.Object

cz.utb.caribou.digger.crawler.CrawlerManager

public class CrawlerManager
extends Object

Constructor Summary

Constructors

Constructor and Description
CrawlerManager()

Method Summary

Methods

Modifier and Type	Method and Description
void	addParser(GenericParser parser)
void	parseTenderMarket(GenericParser parser) Get list of tenders and download it from tender market when parsing fail tender is saved into fail directory for later offline parsing
void	run()
void	runOffline() Parse tender saved in fail directory
void	saveContent(File directory, String url) Save tender content into directory

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CrawlerManager

public CrawlerManager()

Method Detail

addParser

public void addParser(GenericParser parser)

runOffline

public void runOffline()
                throws ParserConfigurationException,
                       SAXException,
                       Exception

Parse tender saved in fail directory

Throws:

Exception

SAXException

ParserConfigurationException

run

public void run()
         throws IOException

Throws:

IOException

parseTenderMarket

public void parseTenderMarket(GenericParser parser)
                       throws IOException

Get list of tenders and download it from tender market when parsing fail tender is saved into fail directory for later offline parsing

Parameters:

parser -

Throws:

IOException

saveContent

public void saveContent(File directory,
               String url)

Save tender content into directory

Parameters:

directory -

content -

url -