Questions tagged [aws-datasync]
The aws-datasync tag has no usage guidance.
aws-datasync
43
questions
0
votes
0
answers
50
views
AWS DataSync Create Location S3 failing
I am trying to set up Data Sync to migrate data from a S3 source bucket to a S3 destination bucket in a different account by following the video below:
https://www.youtube.com/watch?v=boqaSFilGTU
I ...
- 281
0
votes
1
answer
35
views
Hi fellow developers, there is something I need to know about DataSync Start ExecutionApi
I am working with Data sync start execution Api.
I have One stack in which I am creating all the locations, Tasks, Role and I am using DataSync client with startExecutionApi to call the task in the ...
0
votes
0
answers
65
views
Unable to have same source and destination for an data sync task
I am trying to have a same source and destination for a data sync task on AWS.
Data sync has to happen between 2 directories inside the same efs.
But terraform is hitting a error.
creating DataSync ...
0
votes
1
answer
552
views
AWS DataSync some errors in your task execution. No affected files in CloudWatch logs
I'm getting this error when I run a DataSync task:
Transfer and verification completed. There were some errors in your task execution. See a list of affected files in CloudWatch logs. If no files are ...
- 355
0
votes
0
answers
68
views
AWS Datasync Include filter
I'm trying to transfer files using Datasync based on below regular expression. But I found on AWS page that include filter only contains simple_pattern. Is there any way I can achieve this? Please ...
0
votes
0
answers
34
views
AWS SNS Subscription Nested Filter
I am currently trying to set up a pipeline where certain users get notified of Datasync task completion based on the taskID. I have the event triggering, SQS queue set up, and SNS is receiving ...
- 343
0
votes
1
answer
473
views
I'm using AWS DataSync from on-premise to Amazon S3, If I delete the data in on-premise, will it sync to Amazon S3?
Does AWS DataSync sync the file that has been deleted in on-premise to Amazon S3, so from both location it is gone/deleted? If yes, can I turn off this feature? How?
I've read the documentation for ...
0
votes
0
answers
101
views
AWS DataSync Agent Key Generation with VPC Endpoint
I'm trying to activate my KVM Agent using a VPC Endpoint.
I first enter "0" to get the activation key:
Then I enter select the region ("us-east-1"), the service endpoint ("3&...
- 13
0
votes
1
answer
281
views
Which permissions for a cross-accounts transfert across two s3 with aws-datasync
I'm currently following the AWS official documentation tutorial for transferring a large volume of data between two S3 buckets, which can be found at this link: https://docs.aws.amazon.com/datasync/...
- 159
0
votes
0
answers
184
views
DataSync agent ran into an error connecting to AWS
We are trying to move files from EFS to EFS but they are not in the same region. We have connected the 2 VPCs in different regions with PCX and we need to create a EC2 instance hosted in source EFS as ...
- 4,471
0
votes
1
answer
260
views
How to use TaskToken feature with Datasync task in a step function?
I am executing a datasync task from step function using sdk and appending waitforTaskExecution at the end. But the state keeps on running even if the datasync task is completed. I came to know about ...
- 57
0
votes
1
answer
932
views
Execute AWS Datasync task using step function
We have a requirement to create a state machine which includes to datasync tasks followed by each other. These datasync tasks are already created and now I want to execute it using step functions one ...
- 57
1
vote
1
answer
1k
views
Permission issue when creating AWS datasync task
I am trying to use AWS datasync service to copy files from one bucket in one account to another bucket in another account. Also the buckets are in a different region.
I get this error message when I ...
- 31
0
votes
0
answers
267
views
Task timed out when creating DataSync agent through boto3 in aws lambda
I'm trying to create a DataSync agent. When I use the console with the same parameters, it works fine and very quickly (a few seconds). However, if I want to create it by using the lambda function, ...
- 55
0
votes
1
answer
465
views
Airbyte Missing Columns in tables
I am considering Airbyte as a replacement for singer-io because of its user-friendly UI and code reduction features.
However, facing an issue where Airbyte is unable to detect certain columns in our ...
