Questions tagged [google-cloud-storage]
Google Cloud Storage is a RESTful service for storing and accessing your data on Google's infrastructure. The service combines the performance and scalability of Google's cloud with advanced security and sharing capabilities. ONLY PROGRAMMING RELATED QUESTIONS ARE ON-TOPIC. Questions which are not specifically programming related are OFF-TOPIC for Stack Overflow.
google-cloud-storage
11,282
questions
0
votes
0
answers
7
views
Google Cloud CDN cache invalidation
I have 2 environments : prod and staging. I deploy static website files on cloud storage buckets. Separate resources have been created for each environment on google cloud:
subdomains: sub.example....
- 1
3
votes
0
answers
13
views
gcloud mistakes event trigger for storage trigger
There's a cloud function in Python that processes some data when a file is uploaded to firebase's bucket:
@storage_fn.on_object_finalized(bucket = "my-bucket", timeout_sec = timeout_sec, ...
- 666
0
votes
0
answers
19
views
ImageView not updating properly
I am trying to generate a pdf in Android Java and I'm doing that by inflating a card view and changing the image using Picasso. I am loading the image from Firebase Storage using getDownloadUrl(). But ...
1
vote
0
answers
53
views
Google Cloud CDN json resource ETag missing from response headers
The ETags are missing from the response headers. Currently, I am using Google Cloud CDN to deliver the resources from Google Cloud Storage (bucket). When the resource is read directly from the bucket, ...
- 195
-1
votes
1
answer
14
views
Difference between folder created using API and folder created using drag & drop on google cloud storage
Trying to fetch metadata for object created using drag and drop on GCS
I am encountering an issue where when i created a folder on gcs using API and tried to fetch its metadata using
const ...
0
votes
0
answers
18
views
Tensorflow Lite .tflite model - improve latency of Google Cloud bucket retrieval object for Inference
I'm following the Image Classification code at MediaPipe. My model runs successfully, it is smaller than EfficientNet. However the latency of inference I get is 5 seconds.
MediaPipe .tflite object, at:...
- 4,978
0
votes
0
answers
45
views
Error Loading ORC Files into BigQuery: "Invalid timestamp value" after 17th July 2024
I've been successfully fetching ORC files from an Azure Blob Storage to a GCS bucket using the Storage Transfer Service. This process handles around 100 files. After loading the files into GCS, I use ...
- 37
0
votes
0
answers
28
views
Writing a small paraquet dataframe into google cloud storage using spark 3.5.0 taking too long
We are using Spark on-premise to simply read a parquet file from GCS(Google Cloud storage) into the DataFrame and write the DataFrame into another folder in parquet format in GCS, using below code:
...
- 61
-1
votes
1
answer
25
views
Gcs fuse with google buckets - Too many open files error with java app
I have a java spring boot application deployed as kubernetes application in GCP.
I use GCS fuse to access Google Cloud Storage buckets with the Cloud Storage FUSE CSI driver because it allows me to ...
- 21.2k
0
votes
1
answer
31
views
How to Resolve Cyclic Dependency Between Google Storage Buckets in Terraform?
I'm trying to set up logging for a Google Storage bucket(already existing) using Terraform, but I'm running into a cyclic dependency issue. Here's my current Terraform configuration:
resource "...
- 11
0
votes
0
answers
26
views
2024-07-16 21:26:40,575 - WARNING - Connection pool is full, discarding connection: storage.googleapis.com
I'm working on a Python script that downloads images from an Amazon S3 bucket and uploads them to Google Cloud Storage (GCS) using the google-cloud-storage library. The script processes a large ...
- 2,539
0
votes
0
answers
12
views
Airflow does not write logs to Cloud Storage
I'm working with Apache Airflow within GKE (Google Kubernetes Engine). I deployed using helm graphics.
Below is a portion of my custom settings YAML:
executor: KubernetesExecutor
airflow:
config:
...
0
votes
0
answers
23
views
How to loop through multiple tables to send to GCS?
I currently have a task where I need to move my external tables into GCS. For that, I'm using the MySQLToGCSOperator to move my external tables and schema to GCS; things like tables, columns, PKs, FKs....
0
votes
1
answer
21
views
Allowing only specific types of objects(image/jpeg) to be transferred during GCP GCS transfer job creation
I want to create a GCS transfer job which transfer only certain type of objects let us say (image/jpeg) only between 2 GCS buckets.
I can't see any way to do it now as there is only prefix match ...
- 113
0
votes
0
answers
16
views
Google Cloud Storage Image Upload not working in Flutter Web App
I have a Flutter Web App that lets me upload an image to Google Cloud storage using Firebase.
It works fine in Debug mode on Flutter and even on "flutter run --release". However when I build ...
- 1