Questions tagged [azure-data-lake-gen2]
Ask question related to Azure Data Lake Storage Gen2.
azure-data-lake-gen2
732
questions
0
votes
0
answers
12
views
How to retrieve Azure ADLS Gen2 Logs Using Rest API
I am looking for Azure Datalake Gen2 blob logs using REST API, currently I could see these logs can fetch when we enable Azure diagnostics setting like below.
Currently we have enabled diagnostics ...
0
votes
0
answers
29
views
How to set up the call to extension method of DataLakeDirectoryClient object of Azure.Storage.Files.DataLake c# library?
My code is accessing or precisely downloading the file from Azure's DataLake Storage Gen2. That file is placed by an upstream system of our application. The files are organized hierarchy of ...
- 1,548
0
votes
1
answer
71
views
Data Factory Parquet Incorrectly Ingestion Decimals
I am working on an Azure Data Factory pipeline and noticed that when I use a parquet sink to ADLS Gen 2, certain decimals are becoming truncated, and are returning results not consistent with the data ...
- 11
0
votes
1
answer
69
views
Able to write the file to adls processed container from data bricks but unable to see the file in the adls container
I read the file from "adls" raw container and performed certain actions to check the null values renamed the columns and added an additional column to the file.
After all these actions I ...
0
votes
1
answer
54
views
Not able to access zip/exe from ADLSv2 into synapse
I have a zip file containing images uploaded to my storage account (ADLSv2)
storage acc: samplesa
container: samplecontainersa
data1: /folder1/sample1.exe
data2: /folder1/sample2.zip
I need to now ...
- 1,239
0
votes
1
answer
79
views
Azure Data Lake Storage Gen2 REST APIs with C#
I am trying to set the ACL permissions for a user using the azure Azure Data Lake Storage Gen2 REST APIs. Yet I cannot find a way to it.
I used the following microsoft link to do that: microsoft-link-...
- 114
0
votes
1
answer
45
views
How to protect sensitive data in Azure?
I would like to load sensitive data in an Azure Data Lake Storage Gen2. I need to make sure that this data can not be read by the global administrator or any other kind of super user. How can this be ...
- 125
0
votes
1
answer
76
views
How to fix DeltaLake Apache PyArrow TimeStamp conversion error in Python?
I am using DeltaLake's Rust library with Python bindings in order to query some data from an Azure Gen 2 Storage account however I am having problems with this specific error when trying to convert it ...
- 139
0
votes
1
answer
56
views
Google Storage Transfer Service Error on copy ADLS files
I am running a Google Transfer Job to copy files from ADLS to GCS.
Seems when a specific file in ADLS is being written or updated, the storage transfer job fails for that specific file.
Error The ...
0
votes
1
answer
80
views
Fabric Dynamic Binary Content
I have secure storage account in Azure which I am trying to access using Microsoft Fabric Dataflow Gen2. I managed to connect to the storage account using a vnet data gateway.
Getting the data results ...
- 65
0
votes
1
answer
103
views
How do I add Azure Synapse IP address range to ADLS firewall?
I would like a Synapse notebook read ADLS blob data outside of the managed VNet, but I am getting 403 errors. (for both Managed Identity/UPN's)
java.nio.file.AccessDeniedException: Operation failed: &...
- 11
0
votes
1
answer
86
views
Azure storage account shared access key used in ChainedTokenCredential for client authentication in Python SDK?
I've managed to authenticate into my data lake in my storage account fro python using shared access key, but now I'm trying to chain together multiple authentication methods, namely the Managed ...
0
votes
1
answer
65
views
AzureDataLake Upload Files
I wanted to upload files to AzureDataLake but can't decide which method to use
I found these two overloads of DataLakeFileClient.UploadAsync
https://learn.microsoft.com/en-us/dotnet/api/azure.storage....
0
votes
1
answer
352
views
Error retrieving Storage Account: Unexpected status 404 Not Found with Terraform and Azure
While deploying storage account data lake gen2 with service endpoints using Terraform on Azure, encountering a 404 Not Found error
resource "random_integer" "random_suffix1" {
...
1
vote
1
answer
66
views
Unable to upload file to ADLS Gen2 with Microsoft Entra ID(Service Principal) Authorization
I'm trying to upload a file to ADLS Gen2 storage with Microsoft Entra ID(Service Principal) Authorization.
Getting below error message while uploading a file to ADLS gen2 using DataLakeServiceClient
...
- 669