Downloads3File¶
flowtask.components.DownloadS3File
¶
DownloadS3File
¶
Bases: Boto3Client, FlowComponent, PandasDataframe
Download a file from an S3 bucket.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
loop
|
AbstractEventLoop
|
The event loop to use. |
None
|
job
|
Callable
|
The job to run. |
None
|
stat
|
Callable
|
The statistics to collect. |
None
|
**kwargs
|
Additional arguments. |
{}
|
parse_s3_url
¶
Parse an S3 URL into bucket and key.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
url
|
str
|
The S3 URL to parse. |
required |
Returns:
| Name | Type | Description |
|---|---|---|
tuple |
tuple
|
A tuple containing the bucket name and the key. |