Questions tagged [llama]
LLaMA (Large Language Model Meta AI) is a large language model (LLM) released by Meta AI.
llama
408
questions
0
votes
1
answer
21
views
How do I stream output as it is being generated by an LLM in streamlit python
code:
from langchain_community.vectorstores import FAISS
from langchain_community.embeddings import HuggingFaceEmbeddings
from langchain import PromptTemplate
from langchain_community.llms import ...
0
votes
0
answers
39
views
Ollama Embedding using nomic-embed-text without locally installed instance
import gradio as gr
from langchain.text_splitter import RecursiveCharacterTextSplitter
from langchain_community.document_loaders import pdf
from langchain_community.vectorstores import Chroma
from ...
- 267
0
votes
0
answers
28
views
Unable to solve dtype issue using UnslothAI fine tuning for Llama 3.1 8B model
I am new to fine tuning LLMs and I have been trying to run the notebooks provided by UnSlothAI. For this question, I am running the code for fine-tuning LLaMa 3.1 8B model as posted here
This colab ...
- 411
0
votes
0
answers
13
views
how to import SimpleDirectoryReader, VectorStoreIndex in vscode
from llama_index.core import SimpleDirectoryReader, VectorStoreIndex
tried running the above command in vscode Jupyter notebook
how to solve it, i have installed all the packages and libraries,still ...
0
votes
1
answer
47
views
ImportError: cannot import name 'Ollama' from 'langchain.llms'
Trying to test Ollama customised promt in the vitural environment[.venv (Python 3.11.9] locally in VS Code .ipynb file. However, getting the following error message:
Error:
ImportError: cannot import ...
0
votes
0
answers
27
views
How do i convert in python this type <class 'llama_index.core.base.response.schema.Response'> into a josn format,or acces the score?
I need to make an llm which have a basic response when all the documents has a similarity score less then 0.75...in order to do that i use llama but i can t acces score to compare it and see if is ...
1
vote
0
answers
28
views
TRL SFTTrainer clarification on truncation
I am currently finetuning LLama models using SFTTrainer in huggingface. However, I came up with a question, I can not answer through the documentations (atleast, it is a bit ambigious).
My dataset ...
-2
votes
0
answers
31
views
What is the best language model for fine tuning with dataset in Persian language? [closed]
I try to fine tune llama2 language model with dataset that I created in Persian language. But when I tokenize this dataset I noticed that llama2 tokenizer tokenized dataset in character level not word ...
0
votes
0
answers
100
views
RuntimeError: probability tensor contains either `inf`, `nan` or element < 0
am trying to output the response of the llama2 model that i installed locally, but when i try to execute the following lines:
output = model.generate(**inputs, streamer=streamer,
use_cache=True, ...
0
votes
0
answers
23
views
Huggingface Trainer CUDA Out Of Memory for 500M Model
I'm training MobiLLama for classification. This model is just 500Million Parameters and when I fine-tune it for the downstream tasks, the trainer keep giving me the CUDA out of memory error.
I faced ...
- 187
0
votes
0
answers
20
views
Defining Agent in LLamaIndex and Mistral 7B is throwing Attribute error
I am using llamaIndex and locally downloaded Mistral model (mistral-7b-instruct-v0.2.Q4_K_M.gguf). I have created the python binding for this model using "llama-cpp". On defining the agent ...
- 1
0
votes
0
answers
47
views
'LlamaForCausalLM' object has no attribute 'max_seq_length'
I'm fine-tuning llama3 using unsloth , I trained my model and saved it successfully but when I tried loading using AutoPeftModelForCausalLM.from_pretrained ,then I used TextStreamer from transformer ...
-1
votes
0
answers
29
views
Implementing Few-Shot Learning without Prompts for Llama2
I am working with the Llama2 model. I have successfully started and fine-tuned the model, and I have also used Few-Shot Prompting with and without LangChain. However, now I am looking for a method ...
0
votes
0
answers
50
views
How should I use Llama-3 properly?
I downloaded the Meta-Llama-3-70B-Instruct model using the download.sh and the url provided by Meta email, and this is all the files in the folder.
enter image description here
And when I tried to use ...
- 1
0
votes
1
answer
57
views
Sample request json for Vertex AI endpoint?
I've deployed the Llama 3 model using the Deploy button on the Vertex AI model garden Llama 3 card:
https://pantheon.corp.google.com/vertex-ai/publishers/meta/model-garden/llama3
I can make a ...
- 5,165