All Questions
2,259
questions
0
votes
2
answers
72
views
How To Import a Big .csv(~2GB) Into a PostgreSQL Table
I am new into databases and PostgreSQL and today I wanted to import this dataset: https://www.kaggle.com/datasets/wilmerarltstrmberg/recipe-dataset-over-2m/data into a PostgreSQL so I can make a ...
- 13
-1
votes
0
answers
46
views
PostgreSQL copy csv file with delimiter semicolon (;)
I'm using PostgreSQL 16.3 and import CSV files into the database with the following command that works pretty well (using the default delimiter comma):
COPY csv_table (value1, value2, value3, value4, ...
- 237
2
votes
1
answer
62
views
Loading CSV files with double quotes in field values via Oracle Loader External table
Requesting your help and expertise on the below:
Oracle DB 19c on UNIX server
Requirement:
CSV files come in on a daily basis in a Unix directory (where the database resides) and gets loaded to a ...
- 51
0
votes
1
answer
41
views
Storing text data from python web scrape
So I have scraped the information that I want but I don't know how to store it. So, I can manipulate it and clean it. It's one long string either I would like to store it in a csv file or a database ...
0
votes
1
answer
99
views
Azure Mapping JSON - convert empty string or whitespace cells from CSV's to null
I'm importing multiple addressbase CSV files that don't have headers via Azure Synapse and ADLS so using MAPPING_JSON in an ETL.Process table with SQL Server Management Studio 20.1.10.0.
That part is ...
-1
votes
2
answers
38
views
Create a kmer database from a huge csv file [closed]
I have a huge csv file (7.5GB) it is structured with three columns (no header), the first it is a string with 7 characters (SSSSDKI), the second is the count (100) and the third represents the length ...
0
votes
1
answer
60
views
How to split values in a varchar column to multiple rows in SQL? [duplicate]
I have a table which has a column 1 containing values such as 01.02.2001;16.07.2003;25.08.2005 belong to person of ID = 1, that looks like this
Person_ID
Column_1
1
01.02.2001;16.07.2003;25.08.2005
...
- 29
0
votes
2
answers
75
views
Python - SPARQWrapper returns me a XML file when I request a CSV file. Need help converting the data into an SQL table [duplicate]
I wrote this code to get names of all gen 1 pokemon from Wikidata, which I then want to turn into a SQL table.
```python
sparql = SPARQLWrapper("https://query.wikidata.org/sparql")
sparql....
0
votes
1
answer
93
views
Google Big Query: SQL request length limitation
I have a question about GBQ and possibility to find big amount of rows at a time. My GBQ table contains 300M rows with 50 columns (f.e brand, model, color). Also, I have a 70K rows CSV file with only ...
1
vote
0
answers
27
views
Enrich csv file with data from GBQ
I have a table "phones" on GBQ with 300M rows with columns:
Color, Brand, RAM, Inches.
I also have a CSV file with 70,000 rows with information about phones: Color, Brand, RAM.
I need to ...
0
votes
2
answers
81
views
I am having a problem writing a .sql file from a .csv file in python
I need to write a .sql file that creates a table.
I am importing the .csv file using pandas:
import os
import pandas as pd
csv_directory = '/.../test/'
# Lecture des fichiers CSV et génération des ...
- 111
0
votes
0
answers
30
views
How does Big Query differentiate between a day and month when we upload any CSV or text file?
I have a local csv file having table name as market_date_info. One of the column in this table is market_date. The date is in DD-MM-YYYY format. Below are first 5 rows of the column shown in attached ...
-1
votes
1
answer
58
views
Rename columns from a list of names
In SQL Server is there a way to code a rename of all the columns in a table from a comma-separated list of names?
Importing a csv that does not have row headers into a SQL Server table, resulting in ...
- 63
0
votes
0
answers
251
views
How do import .csv files in VS Code using SQL, and analyse the data?
I've got the two csv tables below.
Users:
id
name
1
Bradley
2
Peter
3
Sanjay
Purchases:
id
date
user_id
1
2022-11-01
2
2
2023-10-03
3
3
2023-04-21
NULL
I have them saved as csv files on VS ...
- 15
0
votes
0
answers
84
views
Error while uploading CSV files to MySQL despite uploading from a secure file [duplicate]
I'm having difficulty uploading CSV files into mySQL working on the workbench.
From what I have researched and seen there are two main ways to upload files, in each of them I encountered a problem:
...
