Skip to content

Instantly share code, notes, and snippets.

LLM Agents: Advancements in Multimodal Capabilities and Real-World Applications

Lecture 1: Building LLM Apps with Multimodal Capabilities

Presenter: Gili Nachum

CleanShot 2024-09-22 at 16 32 04@2x

Key Argument

LLM applications can be significantly enhanced through the integration of multimodal capabilities, leading to improved accuracy and versatility.

# imports:
import gym
import random
import numpy as np
import tflearn
from tflearn.layers.core import input_data, dropout, fully_connected
from tflearn.layers.estimator import regression
from statistics import median, mean
from collections import Counter
@oba2311
oba2311 / External Tutorial: Let’s make a bar chart - D3
Created November 26, 2018 14:19
External Tutorial: Let’s make a bar chart - D3
External Tutorial: Let’s make a bar chart
index.html#
<!DOCTYPE html>
<meta charset="utf-8">
<style>
.chart rect {
fill: steelblue;
}
@oba2311
oba2311 / Code Review - Recap of Tutorial - D3 - Udacity
Created November 26, 2018 14:18
Code Review - Recap of Tutorial - D3 - Udacity
Code Review - Recap of Tutorial
Tutorial First Code: China’s circle
// clear the main area
d3.select('.main').html("");
// create an SVG empty canvas
var svg = d3.select('.main').append('svg');
// define size of canvas as (600,300)
svg.attr('width', 600).attr('height',300);
// set y scale: linear. Input: 15,90. Output: 0,250. Remember Y axis is top down.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
# count=100,
# q='*',
search = api.search(q='#jewish',geocode='31.0461,34.8516,200km') #**supply whatever query you want here**
print(len(search))
# count=100,
# q='*',
"""
Adopted and modified from:
https://gist.githubusercontent.com/karpathy/d4dee566867f8291f086/raw/119a6930b670bced5800b6b03ec4b8cb6b8ff4ec/min-char-rnn.py
Minimal character-level Vanilla RNN model. Written by Andrej Karpathy (@karpathy)
BSD License
"""
import numpy as np
"""
Adopted and modified from:
https://gist.githubusercontent.com/karpathy/d4dee566867f8291f086/raw/119a6930b670bced5800b6b03ec4b8cb6b8ff4ec/min-char-rnn.py
Minimal character-level Vanilla RNN model. Written by Andrej Karpathy (@karpathy)
BSD License
"""
import numpy as np
"""
Adopted and modified from:
https://gist.githubusercontent.com/karpathy/d4dee566867f8291f086/raw/119a6930b670bced5800b6b03ec4b8cb6b8ff4ec/min-char-rnn.py
Minimal character-level Vanilla RNN model. Written by Andrej Karpathy (@karpathy)
BSD License
"""
import numpy as np
@oba2311
oba2311 / yaml of Travis CI 13.2
Created April 4, 2018 09:51
yaml of Travis CI 13.2
## Q 1:
https://travis-ci.org/oba2311/cs162-continuous-integration
## Q 2:
# user type:
sudo: required
# prog lang:
language: python