All Questions
974
questions
0
votes
0
answers
22
views
AWS CLI: Query for S3 buckets missing a policy
I need to determine which - if any - of my buckets do not have a specific policy attached to them.
Is this possible with the aws CLI? Specifically, I'm trying to find any buckets with a deprecated ...
- 681
0
votes
1
answer
150
views
How to automate deploying to environments with AWS Copilot CLI?
Needless to say, I am new to AWS. Excuse me.
I had a simple static site project (HTML/CSS/JS/PNG). Then put my files from root to /src, and npm init on root and amongst other things installed webpack ...
- 1,681
0
votes
1
answer
116
views
How to avoid "Invalid argument type" error when executing a seemingly valid AWS CLI command created using jq and bash?
I have a file of s3 paths, sources.lst. Contents:
[
"s3://bucket-name/path/to/file0.tif",
"s3://bucket-name/path/to/file1.tif",
]
I am attempting to iterate over these s3 ...
- 7,541
0
votes
0
answers
16
views
How to copy and paste files or folders based on modified timestamp range in one s3 location to another s3 location using AWS CLI
I am having some data files in a AWS s3 location across different sub-directories. When normally these files are received, AWS Event notification will be triggered and these files will be processed by ...
0
votes
1
answer
69
views
How can I add timestamp to the output from AWS CLI in windows in command prompt?
I am unable to add timestamp to the output from AWS CLI in log file
I have tried through awk but its giving me error
aws s3 --output text sync localPath s3://bucketName --endpoint-url https://s3-...
- 47
-1
votes
1
answer
52
views
(SignatureDoesNotMatch) when calling the GetObject operation
I'm trying to run an S3 copy operation via the aws cli. The object to be copied is large - its a single file at ~9GB.
aws cli s3 cp s3://${my_bucket}/${my_file}
I receive the following error:
download ...
- 154
-1
votes
1
answer
37
views
AWS CP but skip access denied
In a bucket where you have access to some files only, is it possible to use a single cp command but skip all the files you do not have access to?
Ex if I run aws s3 cp s3://mybucket/ .
I will get an ...
- 12.1k
0
votes
1
answer
398
views
Copy files from One S3 Bucket to another S3 Bucket
I have to migrate about 20 TB data from One S3 bucket to another S3 bucket where both are in separate accounts with separate vendors and I am not the owner in either of them.
I have been provided ...
0
votes
1
answer
72
views
aws s3 cp emr stdout.gz file as txt encoding issue
I use aws s3 cp s3://source_bucket/stdout.gz s3://target_bucket/stdout.txt in linux to copy this log file to another s3 location. and if I download the file to my windows folder, the content format of ...
- 159
0
votes
1
answer
53
views
EC2 cannot access S3 in the same account with proper IAM role
I have two EC2 instances: ec2-1 and ec2-2, one s3 bucket: bucket-1, all in the same aws account.
both instances are associated with the same IAM role which has this trust relationship:
{
"...
- 3,524
0
votes
0
answers
63
views
AWSCLI command to get object - object id/x-amz-id-2 AND List/Search object having given object id / x-amz-id-2
AWSCLI command to get object x-amz-id-2 AND List object having given object id / x-amz-id-2
Please advice which AWSCLI we can use to
Get object id / x-amz-id-2 of single/multiple objects under a ...
- 73
1
vote
2
answers
157
views
How to Remove User-Defined Metadata from All Objects in S3 Buckets Using AWS CLI?
I'm looking to remove specific user-defined metadata from all objects across our S3 buckets to eliminate data duplication, as we're storing the metadata externally. Given the large number of objects, ...
- 134
0
votes
0
answers
28
views
Best way to append name last modified timestamp of jar file to S3 bucket in gitlabci?
As shown in the image, in GITLAB CI I am unable to copy/rename a jar file with timestamp. However in local I am able to do it, see below.
aws s3 cp s3://app-jars/app-0.0.1-SNAPSHOT.jar s3://app-jars/...
- 27
1
vote
1
answer
59
views
Error when trying to upload React build artifacts to S3 using AWS CLI in Dockerfile
I am trying to automate the process of building a React application inside a Docker container and then uploading the build artifacts to an S3 bucket using the AWS CLI within the Dockerfile. However, I'...
- 993
0
votes
1
answer
194
views
AWS CLI list files based on a substring recursively
I am new to AWS CLI and I am trying to find a way to list specific files like I could with RCLONE. I am looking to look through a directory recursively and list the file names based on a string. In ...
