All Questions
2,455
questions
0
votes
0
answers
38
views
Unable to upload images to S3 using boto3
I am using fastapi to upload images to my s3 bucket. first i tried presigned url method to upload images from postman and it is working fine. But when i try to directly upload image(size ~7kb) from ...
- 33
1
vote
0
answers
44
views
List all objects in an S3 bucket on MinIO
I have a bucket with about 5'000'000 objects inside (as shown from the MinIO web interface).
I need to traverse every single object (and later on do some processing on them).
To test the functionality,...
- 159
0
votes
0
answers
27
views
Slow s3 upload when trying to upload multiple files in parallel with aioboto3
I need to upload multiple files to S3 in parallel. The script I use to upload:
import asyncio
from httpx import AsyncClient
async def upload():
async with AsyncClient(base_url="http://...
0
votes
1
answer
35
views
AWS boto3 can't create a bucket - Python
Iam facing an issue that I my code is not successfully to create bucket in AWS using boto3 python. Below my code
import boto3
s3 = boto3.resource('s3')
def create_bucket(bucket_name, region='us-east-...
1
vote
1
answer
87
views
Getting "cannot schedule new futures after interpreter shutdown" error while using boto3.client download_file and upload_file functions
I am using boto3.client.download_file() and boto3.client.upload_file() functions, For python3.8 environment it's working fine, but after upgrading to python3.10, getting "RuntimeError: cannot ...
- 37
0
votes
0
answers
23
views
How to generate and validate sigV4
I am making an API call to S3 using boto3 with the following code, which is working as expected:
import boto3
boto3.set_stream_logger(name='botocore')
s3 = boto3.resource(
's3',
...
- 1,267
0
votes
0
answers
30
views
custom storage-backend class not working as expected with s3, boto3 and django-storages
I am following this tutorial here from Michael Herman, trying to setup s3 storage for my django project and I am facing some issues right from the start of the tutorial.
First, when I tried running ...
- 1
0
votes
1
answer
39
views
S3 PutObject works but List/Delete fails
I am creating a session token by setting the permissions like this. This is done in kotlin.
val stsClient = applicationContext.getBean("awsSecurityTokenClient", awsClient....
- 1,903
0
votes
1
answer
35
views
How to find out S3 Bucket last accessed time for last 180 days
How to find out S3 Bucket last accessed time for last 180 days which are all in inactive s3 buckets using boto3. i have gone through the documents but that didn't work assist me to achieve this, ...
- 49
0
votes
0
answers
20
views
s3 life cycle managament in AWS for last 180 days
HI Im new to AWS im trying to s3 buckets which are all not accessed for last 180 days using cloudtrail events using python script lambda function but in response im getting all the buckets list in the ...
- 49
0
votes
2
answers
56
views
Initiate copy but exit without waiting for it to finish
I'm using boto3 to copy a large object from one bucket to another (3.5 GiB), I'm using the following code:
boto3.client('s3').copy_object(Bucket=dst_bucket, Key=filepath, CopySource={'Bucket': ...
- 2,446
0
votes
0
answers
33
views
Looking to skip over specific "subfolder" when using list_objects_v2 in AWS Lambda Function
I have a AWS Lambda function that will "move" objects in my S3 bucket to another location in the same bucket (changes the key) after a certain amount of time. I have this location, the ...
0
votes
0
answers
30
views
How many requests are performed in bucket.objects.all() in boto3?
I'm using boto3 to scan my entire bucket, with the aim to know which files are older than a certain time threshold.
As a first approach, I've used
bucket = s3.Bucket(bucket_name)
bucket.objects.all()
...
- 33
1
vote
0
answers
25
views
How can I speed up attribute recovery when using boto3?
I am currently attempting to retrieve the attribute data for all of the buckets within an aws account, the code I have currently works (outside of the environment that each bucket is present in) but ...
- 11
0
votes
1
answer
40
views
STS assume role returns invalid credentials (InvalidToken)
When I call sts:AssumeRole from account A eu-west-1 on role in account B and with those returned credentials I call list objects from s3 bucket located in eu-south-1 it fails with following error.
...
- 1,955