Skip to content

Instantly share code, notes, and snippets.

@donflopez
Created April 2, 2023 22:29
Show Gist options
  • Save donflopez/39bb9bc34cc00467679f10bab3e4a734 to your computer and use it in GitHub Desktop.
Save donflopez/39bb9bc34cc00467679f10bab3e4a734 to your computer and use it in GitHub Desktop.
Improved alpaca-lora llama-index prompt.
INFO:llama_index.token_counter.token_counter:> [build_index_from_nodes] Total LLM token usage: 0 tokens
INFO:llama_index.token_counter.token_counter:> [build_index_from_nodes] Total embedding token usage: 0 tokens
INFO:root:___________Promt:____________
INFO:root:Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
What do you think of Facebook's LLaMa?
Answer:
INFO:root:_________Normal model____________
/home/donflopez/.local/lib/python3.10/site-packages/transformers/generation/utils.py:1219: UserWarning: You have modified the pretrained model configuration to control generation. This is a deprecated strategy to control generation and will be removed soon, in a future version. Please use a generation configuration file (see https://huggingface.co/docs/transformers/main_classes/text_generation)
warnings.warn(
INFO:root: I think Facebook's LLaMa is an innovative and powerful tool that can be used to create engaging and interactive experiences. It has the potential to revolutionize the way people interact and engage with each other online.
INFO:root:_________After Documents___________
Token indices sequence length is longer than the specified maximum sequence length for this model (1438 > 512). Running this sequence through the model will result in indexing errors
INFO:llama_index.token_counter.token_counter:> [query] Total LLM token usage: 1312 tokens
INFO:llama_index.token_counter.token_counter:> [query] Total embedding token usage: 0 tokens
INFO:root:I think Facebook's LLaMa is an innovative and ambitious project that has the potential to revolutionize the way people interact with technology. It has the potential to create more personalized and natural user experiences, as well as enable more efficient and secure data processing. Additionally, it could open up new opportunities for businesses to engage with customers in more meaningful ways.
INFO:root:______________________________
INFO:root:___________Promt:____________
INFO:root:Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
How many people lives in Martos?
Answer:
INFO:root:_________Normal model____________
INFO:root:
Approximately 8,000 people live in Martos.
INFO:root:_________After Documents___________
INFO:llama_index.token_counter.token_counter:> [query] Total LLM token usage: 1250 tokens
INFO:llama_index.token_counter.token_counter:> [query] Total embedding token usage: 0 tokens
INFO:root:Approximately 24,207 people live in Martos.
INFO:root:______________________________
INFO:root:___________Promt:____________
INFO:root:Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
What is the capital of England?
Answer:
INFO:root:_________Normal model____________
INFO:root: The capital of England is London.
INFO:root:_________After Documents___________
INFO:llama_index.token_counter.token_counter:> [query] Total LLM token usage: 1245 tokens
INFO:llama_index.token_counter.token_counter:> [query] Total embedding token usage: 0 tokens
INFO:root:The capital of England is London.
INFO:root:______________________________
INFO:root:___________Promt:____________
INFO:root:Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
What are alpacas? and how are they different from llamas?
Answer:
INFO:root:_________Normal model____________
INFO:root: Alpacas are small four-legged animals native to South America. They are members of the camel family and are closely related to llamas. Alpacas are smaller than llamas and have finer fleece, making them ideal for fiber production. They are also more docile and easier to handle than llamas.
INFO:root:_________After Documents___________
INFO:llama_index.token_counter.token_counter:> [query] Total LLM token usage: 1310 tokens
INFO:llama_index.token_counter.token_counter:> [query] Total embedding token usage: 0 tokens
INFO:root:Alpacas are small, domesticated animals native to South America. They are members of the camel family and are closely related to llamas. Alpacas are smaller than llamas and have finer fleece, making them ideal for fiber production. They are also more docile and easier to handle than llamas.
INFO:root:______________________________
INFO:root:___________Promt:____________
INFO:root:Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
how much is 213769*121239?
Answer:
INFO:root:_________Normal model____________
INFO:root:
INFO:root:_________After Documents___________
INFO:llama_index.token_counter.token_counter:> [query] Total LLM token usage: 1259 tokens
INFO:llama_index.token_counter.token_counter:> [query] Total embedding token usage: 0 tokens
INFO:root:213769*121239 is equal to 259,183,818.
INFO:root:______________________________
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment