interfacing with multiple local models via ollama's python bindings

__readme.md

Generating output from Multiple Local LLMs: Willis' Iguana

First install ollama in your system, browse model list and ollama pull the ones you think can be run on your system. Ollama works very well on M3/M4 macs in my experience.

models under consideration

NAME                 ID              SIZE      MODIFIED    
gemma3:12b-it-qat    5d4fa005e7bb    8.9 GB    2 weeks ago    
deepseek-r1:8b       6995872bfe4c    5.2 GB    2 weeks ago    
qwen3:4b             a383baf4993b    2.6 GB    5 weeks ago    
gemma3:latest        a2af6cc3eb7f    3.3 GB    6 weeks ago    

For each, run _ollama.py with the requisite arguments (i have it stored in ~/.local/bin as an executable) The prompt is stolen from Derek Willis.

> _ollama -m "gemma3:12b-it-qat" -p "give me 20 names for a pet iguana" -o "gemma3_12b.md"
> _ollama -m "deepseek-r1:8b" -p "give me 20 names for a pet iguana" -o "deepseek_r1_8b.md"
> _ollama -m "qwen3:4b" -p "give me 20 names for a pet iguana" -o "qwen3_4b.md"
> _ollama -m "gemma3:latest" -p "give me 20 names for a pet iguana" -o "gemma3.md"
> _ollama -m "qwen3:14b" -p "give me 20 names for a pet iguana" -o "qwen314b.md"

Output in respective files. Two of these models are reasoning models, so the answers contain the neurotic thoughts of an LLM that was MK-Ultra-ed to death. A good exercise could bet to modify _ollama.py to hide thinking tokens and only spit out the final output.

_ollama.py

#!/Users/aprvlal/miniforge3/envs/llm/bin/python
# [ollama itself is installed globally]
# make sure this is a virtualenv or mamba env to isolate dependencies 

import argparse
import ollama


def main(msg, mod='qwen3:14b', outfile=None, system_prompt = None):
    mm = list()
    if system_prompt:
        mm.append({
        'role': 'system',
        'content': system_prompt,
      })
    mm.append(
      {
        'role': 'user',
        'content': msg,
      }
    )
    response = ollama.chat(model=mod, messages=mm, stream = True if outfile is None else False)
    if outfile is None:
        for chunk in response:
            print(chunk['message']['content'], end='', flush=True)
    else:
        resp = response['message']['content']
        with open(outfile, "w") as f:
            f.write(resp)

if __name__ == "__main__":
    parser = argparse.ArgumentParser(description='Interface with Ollama chat models.')
    parser.add_argument('--prompt', '-p', 
                        type=str, required=True, 
                        default="Who are you and who am i?",
                        help='Message to send to the model'
                       )
    parser.add_argument('--model', '-m', type=str, default='gemma3:12b-it-qat',
                        help='Model to use (default: gemma3:12b-it-qat)')
    parser.add_argument('--outfile', '-o', type=str, default=None,
                        help='Output file to write response to, e.g. markdown file (default: print to stdout)'
                       )
    parser.add_argument('--sys', '-s', type=str, default=None,
                       help="System prompt. Defaults to None.")
    args = parser.parse_args()
    main(args.prompt, args.model, args.outfile, args.sys)

deepseek_r1_8b.md

Okay, the user asked for 20 names for a pet iguana. That's pretty straightforward! They probably just want creative or fun name ideas to help pick one for their new (or future) reptilian friend.

Hmm, I should think about what makes a good iguana name - it could be based on appearance, personality traits, references to the animal itself, or even pop culture. Some owners prefer silly names while others go for more nature-inspired ones.

First, let's consider descriptive names that would fit different types of iguanas. There are spiky-spined iguanas and smoother ones, so maybe "Spikes" versus "Smoothie"? Colorful varieties like green iguanas could be named after shades - Emerald, Jade, Olive?

Then there are personality-based names... Owners often have pets that match their mood or attitude. Maybe include some funny ones (like Mr. Sniffles) and serious ones too. I think the user would appreciate both categories.

I should also throw in some references to the animal's natural behaviors - "Scaly" is obvious but good, while more specific terms like "Croc" for its lizard cousin relation might be fun.

And don't forget pop culture references! Names from movies or books that have cool reptiles (like Komodo dragon characters) could work well.

The user didn't specify what kind of iguana they have, so I'll include a mix covering different possibilities - spiny land iguanas, green iguanas, and maybe mention the less common marine variety just in case.

I should organize these into categories too: descriptive based on appearance/behavior, personality names, references to other animals or nature, pop culture references... That way it's more helpful than just listing random names.

Let me count them as I go - that'll give exactly 20 options across different naming styles so the user has plenty of inspiration. Some whimsical ones might be good too since iguanas are often seen as cool pets despite being somewhat intimidating creatures. Okay, here are 20 name ideas for your pet iguana, covering various themes:

Descriptive & Nature-Inspired:

1. Spikes: For the prominent spines on a land iguana's back.
2. Greeny: Simple and descriptive if it's a green iguana or primarily green.
3. Emerald: A more specific shade of green, suggesting gem-like beauty.
4. Jade: Another beautiful green color reference; also suggests calmness.
5. Croc (short for Crocodile): Honoring its distant relative and similar reptilian vibe.
6. Marine: If you have a marine iguana (the unique one from the Galapagos).
7. Hoodie: Refers to their dewlap or throat flap, sometimes called a "hood".
8. Stripey: For those interesting markings some iguanas develop.
9. Scaly: A classic name highlighting its skin type (though they have scales!).
10. Scales: Similar to Scaly, but focusing more directly on the feature.

Personality & Behavior:

11. Leo: For a confident and majestic iguana.
12. Mr./Ms. Cool: Fits their cool-blooded and somewhat aloof nature (or perceived one!).
13. Sniffles: If they have a tendency to be a bit of a sniffer or get感冒s occasionally (playfully).
14. Grumpy: For an iguana that seems more grumpy than happy (maybe needs better treats!).
15. Ziggy: Suggesting energetic movement, perhaps if it's active and climbing.

Funny & Whimsical:

16. Mr./Ms. Snappy: A fun contrast to their generally slow-moving nature.
17. Popcorn: A cute nickname for the popping sounds they might make sometimes (or just sounds like a silly pet name).
18. Ooga Booga: A playful, tribal-sounding name.
19. Mr./Ms. Snouty: Emphasizing their head and snout focus while eating or basking.

References & Pop Culture:

20. Komodo (or similar): Named after the related Komodo dragon, even if your iguana isn't one!

Remember to choose a name that fits the specific look of your iguana (if it's green and spiky - Green Spikes! 😉) or its personality. Good luck naming your scaly companion!

gemma3.md

Okay, here are 20 names for a pet iguana, with a variety of styles – some cute, some cool, some referencing their appearance:

Cute & Playful:

1. Pip
2. Spike
3. Bean
4. Mango
5. Ziggy

Cool & Bold:

6. Rex
7. Jagger
8. Rocco
9. Phoenix
10. Zephyr

Descriptive (Based on Color/Appearance):

11. Jade
12. Rusty
13. Slate
14. Ember
15. Moss

Unique & Fun:

16. Zest
17. Cosmo
18. Finn
19. Bandit
20. Kona

To help me narrow it down and give you even better suggestions, could you tell me:

• Is your iguana male or female?
• What color is your iguana? (Green, brown, grey, etc.)
• What's your general style? (e.g., cute, sophisticated, funny, etc.)

gemma3_12b.md

Okay, here are 20 names for a pet iguana, with a variety of vibes (some serious, some silly, some inspired by their nature). I've included a little note about the feeling behind each one to help you choose!

1. Rex: (Classic, regal - suggests a "king" or "ruler")
2. Emerald: (Reflects their green coloring - beautiful and nature-inspired)
3. Zephyr: (Gentle breeze - for a calm and peaceful iguana)
4. Spike: (Playful, nods to their spiky scales)
5. Leaf: (Simple, nature-related, cute)
6. Darwin: (A nod to Charles Darwin and evolution - for the scientifically inclined)
7. Scales: (A straightforward and descriptive name!)
8. Jade: (Another green gemstone name - elegant)
9. Iggy: (Short, cute, and an obvious choice!)
10. Kermit: (A playful reference to the famous Muppet!)
11. Terra: (Means "earth" in Latin - connects them to nature)
12. Basil: (Herb name, sounds cool and slightly mysterious)
13. Finn: (Short, fun, and sounds adventurous)
14. Cosmo: (A bit quirky, evokes a sense of wonder)
15. Rusty: (For an iguana with more brownish hues)
16. Pixel: (Cute, techy vibe, especially if you're into gaming)
17. Goose: (Silly and unexpected - for a quirky personality)
18. Rango: (Inspired by the movie "Rango")
19. Veridian: (A rich shade of green – sounds sophisticated)
20. Sunny: (If your iguana loves basking in the light!)

Hopefully, this list gives you some great options! Do any of them stand out to you?

qwen314b.md

Okay, the user wants 20 names for a pet iguana. Let me start by thinking about what makes a good pet name. Iguanas are reptiles, so maybe names related to their habitat or characteristics. They have scales, they're often green or brown, and they're related to lizards.

First, I should consider names from nature. Maybe names of plants or other animals. For example, "Scales" or "Leaf". But maybe that's too generic. What about names from mythology or legends? Iguanas are sometimes associated with certain cultures. In some South American cultures, iguanas are considered sacred or have symbolic meanings. Maybe names like "Kukulkan" (from Mayan mythology, a feathered serpent god) or "Quetzalcoatl" (another Mesoamerican deity, though more associated with snakes). Wait, but maybe the user wants more unique names.

Also, considering the iguana's physical traits: "Greenie", "Stripe", "Scaly". Maybe more creative names. Think about movies or books with iguanas. There's a character named "Iggy" from "The Secret Life of Pets". Maybe "Iggy" is a good name. Also, "Lizzy" or "Liz" as a nickname.

What about names from other languages? "Sapo" in Spanish means frog, but maybe not. "Sally" is a common name, but maybe too generic. Maybe "Pete" or "Pete the Iguana" from the movie "The Wild". Wait, that's a stretch.

Also, think about famous people or characters. "Steve" from "Steve the Iguana" (if that's a thing). Maybe not. Alternatively, think about terms related to reptiles: "Reptar" (a play on Reptar from the show "Dora the Explorer"). Hmm, maybe too niche.

Another angle: names that sound like they belong to a lizard. "Sandy" or "Sandy the Lizard". Or "Basil" as a name. Maybe "Basilisk" but that's a different creature. "Iggy" is a good start. "Leo" for a lion-like iguana? Maybe. "Moss" because of their color. "Crimson" if they have a red tint. "Terra" for earth. "Zephyr" for a breeze, maybe related to their movement. "Sunny" because they like warmth. "Jade" for the green color. "Kai" as a Hawaiian name meaning ocean, but maybe not. "Rex" for king. "Mossy" as a variation. "Gwen" as a name. "Niko" as a nickname for Nicholas. "Tiki" as a reference to Polynesian culture, maybe. "Percy" as a name. "Spike" for their spiky tail. "Mira" as a name meaning miracle. "Bramble" for a thorny plant. "Kai" again. Wait, need to make sure they are unique and not repeating.

Let me list some possibilities:

1. Iggy
2. Scales
3. Leaf
4. Terra
5. Zephyr
6. Sunny
7. Jade
8. Rex
9. Moss
10. Leo
11. Kukulkan
12. Quetzal
13. Basil
14. Percy
15. Spike
16. Mira
17. Bramble
18. Tiki
19. Niko
20. Gwen

Wait, some of these might be too similar or not quite right. Let me check again. "Quetzal" is a bird, but maybe okay. "Kukulkan" is a good name. "Terra" is earth, which is good. "Zephyr" is a gentle wind, which might fit. "Moss" and "Sunny" are nice. "Scales" is straightforward. Maybe "Iggy" is the most common. Are there other names? Maybe "Gretel" from the story, but not sure. "Luna" for the moon. "Shadow" for their color. "Ember" for a reddish iguana. "Nova" as a star. "Dusty" for their color. "Cobalt" for blue. "Mossy" instead of Moss. Maybe "Sandy" for sandy color. "Taco" as a funny name, but maybe not. "Iggy" is still good. Let me compile a better list with 20 names, ensuring variety and uniqueness.

Here are 20 creative and unique names for your pet iguana, inspired by nature, culture, and personality traits:

1. Iggy – A playful, catchy name that nods to the iguana’s species.
2. Kukulkan – Named after the Mayan feathered serpent deity, linking to the iguana’s ancient heritage.
3. Terra – Meaning “earth” in Latin, reflecting the iguana’s connection to nature.
4. Zephyr – A gentle wind, mirroring the iguana’s graceful movements.
5. Sunny – A cheerful name for a sun-loving reptile.
6. Jade – A gemstone name that suits a vibrant green iguana.
7. Moss – For a lush, earthy-toned iguana.
8. Rex – Latin for “king,” perfect for a regal-looking iguana.
9. Quetzal – Inspired by the Mesoamerican quetzal bird, a symbol of beauty and freedom.
10. Bramble – A thorny plant name, reminiscent of an iguana’s spiky tail.
11. Percy – A classic name with a touch of whimsy.
12. Luna – For a nocturnal or moonlit-colored iguana.
13. Ember – A fiery name for a reddish or orange-toned iguana.
14. Shadow – A mysterious name for a darker-colored iguana.
15. Niko – A short, modern name with a tropical flair.
16. Tiki – A Polynesian-inspired name for a vibrant, adventurous iguana.
17. Spike – A strong, memorable name for a spiky-tailed iguana.
18. Cobalt – A bold name for a blue or strikingly colored iguana.
19. Dusty – A charming name for a sandy or muted-toned iguana.
20. Mira – A name meaning “wonder” in Latin, celebrating the iguana’s unique presence.

Let me know if you’d like names tailored to your iguana’s color, personality, or origin story! 🦎✨

qwen3_4b.md

Okay, the user wants 20 names for a pet iguana. Let me think about how to approach this. First, I need to consider what kind of names would be appropriate for a pet. Iguanas are reptiles, so maybe names that are related to nature, the environment, or have a friendly, cute sound.

I should think about different categories. Maybe names that relate to the iguana's habitat, like desert or tropical regions. Also, maybe names that are playful or have a whimsical feel. Sometimes people use names that sound like sounds the iguana might make, but I'm not sure if iguanas have specific sounds. Alternatively, maybe names that are related to their appearance, like colors or patterns.

I should also think about common naming conventions for pets. Sometimes people use names that are related to elements like water, earth, air, fire, or maybe even mythical creatures. Also, maybe names that are easy to pronounce and remember.

Let me brainstorm some ideas. For example, "Greenie" because iguanas are green. "Trio" if they have a trio of iguanas. "Sally" is a common name. "Ziggy" sounds fun. "Pumpkin" if they have a pumpkin color. "Luna" for a moon-related name. "Benny" is a common pet name. "Coco" is a cute name. "Mango" because of the color. "Sunny" for a sunny habitat. "Rex" is a strong name. "Jelly" sounds cute. "Tina" is a common name. "Bella" is a popular name. "Gina" is another. "Duke" for a more masculine name. "Sally" again. "Pip" is a small name. "Tango" for a playful name. "Nico" is a common name.

Wait, I need to make sure there are 20 unique names. Let me check if I have duplicates. "Sally" is mentioned twice. Maybe replace one of them. "Trio" is a good one. "Ziggy" and "Jelly" are unique. "Mango", "Sunny", "Rex", "Bella", "Gina", "Duke", "Pip", "Tango", "Nico". That's 16. Let me add four more. Maybe "Pumpkin", "Luna", "Benny", "Coco". That makes 20. Let me check again: Greenie, Trio, Ziggy, Pumpkin, Luna, Benny, Coco, Mango, Sunny, Rex, Jelly, Tina, Bella, Gina, Duke, Pip, Tango, Nico. Wait, that's 18. Need two more. Maybe "Sally" and "Milo"? Or "Ava"? Hmm. Alternatively, "Penny" or "Milo". Let me adjust. Maybe "Penny" and "Milo". So the final list would be 20 names. I should make sure they are all different and varied.

Here are 20 fun and unique names for your pet iguana, inspired by nature, whimsy, and the iguana's vibrant personality:

1. Greenie (for its leafy green color)
2. Trio (if you have a trio of iguanas!)
3. Ziggy (a playful, catchy name)
4. Pumpkin (if it has a cozy, orange hue)
5. Luna (for its moonlit, elegant vibe)
6. Benny (a classic, friendly nickname)
7. Coco (cute and tropical)
8. Mango (for its bright, sunny color)
9. Sunny (a cheerful, sun-loving name)
10. Rex (a strong, regal sound)
11. Jelly (for its soft, squishy appearance)
12. Tina (a simple, endearing name)
13. Bella (a popular, elegant choice)
14. Gina (a sweet, floral-inspired name)
15. Duke (for a bold, masculine flair)
16. Pip (a tiny, whimsical name)
17. Tango (for its graceful, dance-like movement)
18. Nico (a stylish, Italian-inspired name)
19. Sally (a timeless, classic choice)
20. Milo (a modern, catchy name)

Let me know if you want names tied to specific traits (e.g., color, behavior, or personality)! 🐊✨