Skip to content

Downloads3File

flowtask.components.DownloadS3File

DownloadS3File

DownloadS3File(loop=None, job=None, stat=None, **kwargs)

Bases: Boto3Client, FlowComponent, PandasDataframe

Download a file from an S3 bucket.

Parameters:

Name Type Description Default
loop AbstractEventLoop

The event loop to use.

None
job Callable

The job to run.

None
stat Callable

The statistics to collect.

None
**kwargs

Additional arguments.

{}

parse_s3_url

parse_s3_url(url)

Parse an S3 URL into bucket and key.

Parameters:

Name Type Description Default
url str

The S3 URL to parse.

required

Returns:

Name Type Description
tuple tuple

A tuple containing the bucket name and the key.

run async

run()

run.

Download the file from S3.

start async

start(**kwargs)

start.

Initialize Task.