Questions tagged [nlp]
Natural language processing (NLP) is a subfield of artificial intelligence that involves transforming or extracting useful information from natural language data. Methods include machine-learning and rule-based approaches.
20,637
questions
0
votes
0
answers
6
views
GGUF model in LM Studio returns broken answer
I try to run LLM GGUF model QuantFactory/T-lite-instruct-0.1-GGUF specifically its quantized version T-lite-instruct-0.1.Q2_K.gguf in LM Studio.
Sometimes it works fine. But sometimes it returns "...
- 99
1
vote
0
answers
13
views
LDA is predicting same topics for all data
I'm using the German political speech dataset to train the LDA model. My goal here is to categorize each speech into some topics. But the problem is that the generated topics are too similar, and all ...
- 11
-1
votes
0
answers
13
views
How can I use Word Embeddings for Sentiment Analysis?
I have a project where I've created a classifier but I've learned that word embeddings are a better approach.
From my search, I found that CBOW and Skip-grams are the methods to use with Word2Vec. I ...
- 1,350
1
vote
0
answers
14
views
CPU Memory Leak While Inference Models in Infinite Loop
I'm experiencing a CPU memory leak while running a Python script that processes text using various NLP models in an infinite loop. The script includes language translation, sentiment analysis, and ...
-2
votes
0
answers
28
views
Divide a text based on Intent Analysis with NLP
I have this input from a chat:
"Set an alarm for 7:00 am and play a song by Caparezza on Spotify."
The input may contain multiple actions to do on the back-end.
I want to divide a text based ...
- 17
0
votes
0
answers
26
views
CUDA error: device-side assert triggered Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions
i am trying to convert my text into its embeddings using a bert model , when i apply this to my my dataset it works fine for some of my inputs then stops and gives that error
i have set ...
-3
votes
0
answers
25
views
Extracting CEO Information [closed]
I am working on a project in which I have to Extract CEOs information (Their company, name, and tenure information) from last 25 years throughout the US and saving it into a CSV format for further ...
-1
votes
0
answers
24
views
Poor Performance and Signs of Overfitting When Fine-Tuning BART with Adapters on CNN/DailyMail Dataset
I am currently fine-tuning the BART model with adapters for a summarization task using the CNN/DailyMail dataset. I've noticed that the model shows poor performance and signs of overfitting. Below is ...
- 349
1
vote
0
answers
15
views
execute lucene query in multiple language utilizing AI Model
We have requirement to support multiple language search for the same field. for example title is "Badminton" and subject is "sports" I want to search in solr like title:Badminton ...
- 333
0
votes
1
answer
39
views
Azure AI Search Scoring Profiles are not modifying the score retrival
I have been using azure ai search and scoring profiles to boost the documents of my index that come form the 'reviewed' source that means I want to send to the very TOP documents that have the string '...
- 711
0
votes
1
answer
36
views
Score Profiles Azure AI search NOT WORKING
I have configured on my Index a default score profile to use on all of my seacrhes, I have an test index that has a field named 'source' if the filed is == to 'reviwed' I want those docs to be move up ...
- 711
0
votes
0
answers
35
views
Separating text into smaller chunks based on meaning
I am working on a project involving approximately 8,000 job advertisements in CSV format. I have extracted job titles, IDs, descriptions, and other relevant information and saved it in a PostgreSQL ...
- 1
0
votes
0
answers
18
views
Transformer models for contextual word embedding in large datasets
I'm interested in using contextual word embeddings generated by a transformer-based model to explore the similarity of certain words in a large dataset.
Most transformer models only allow up to 512 ...
- 13
0
votes
1
answer
52
views
Do I need to use Named Entity Recognition (NER) in tokenization?
I am working on an NLP project for sentiment analysis. I am using SpaCy to tokenize sentences. As I was reading the documentation, I learned about NER. I've read that it can be used to extract ...
- 1,350
-2
votes
0
answers
17
views
Big o notation of neural network [closed]
My problem is that how to calculate the computational complexity which used big o metrics of deep neural network,cart,lightbgm and random forest,
And where I can find the proof process of these?
I ...
- 1