fetchtool.Downloader.Downloader

class documentation

class Downloader(object):

View In Hierarchy

The Downloader

This is the main downloader module. It will save all the requested data into the basedir folder, if requested it can overwrite already downloaded data (replacetree). One downloader work with one fetcher and can use many different Savers.

Parameters
basedirA base folder path to save files.
replacetreeA flag to indicate that the folder should be replaced (overwrite files)
show_resumeA flag to indicate that a print-out of the request should be shown
fetcherA fetcher instance.
saverlistA list of Saver type objects.
Method enableSaveRaw Request to save RAW data before QC
Method isgood A check method for the Downloader
Method work Main download method.
Method __init__ Undocumented
Method _buildfolder Undocumented
Method _makefolders Undocumented
Method _resume Undocumented
Instance Variable __saveraw Undocumented
Instance Variable _basedir Undocumented
Instance Variable _fetcher Undocumented
Instance Variable _force Undocumented
Instance Variable _savers Undocumented
Instance Variable _show_resume Undocumented
def enableSaveRaw(self):

Request to save RAW data before QC

def isgood(self):

A check method for the Downloader

def work(self, request):

Main download method.

This method will receive a request object, download the data and save it to the base folder

Parameters
request:requestA request to work on
Returns
NoneUndocumented
def __init__(self, basedir, replacetree=False, show_resume=False, fetcher=None, saverlist=None):

Undocumented

def _buildfolder(self, key):

Undocumented

def _makefolders(self, requests):

Undocumented

def _resume(self, key, items):

Undocumented

__saveraw: bool =

Undocumented

_basedir =

Undocumented

_fetcher =

Undocumented

_force =

Undocumented

_savers =

Undocumented

_show_resume =

Undocumented