Skip to content

Instantly share code, notes, and snippets.

View danielsgriffin's full-sized avatar

Daniel Griffin danielsgriffin

View GitHub Profile
@danielsgriffin
danielsgriffin / gist:5137995a43ad356cb88e269a5cafe55b
Created September 19, 2024 21:34
Simple and Deceptively Complex Questions
w/ Claude Sonnet 3.5 on 9/18 and 9/19
I apologize for the misunderstanding. You're right, and I appreciate the clarification. Let me provide a new list of ten questions, including some simple ones and some that are superficially simple but actually complex to answer definitively:
1. What is the capital of Japan?
2. How many planets are in our solar system?
3. What is the oldest city in the Americas?

Evaluation

This response provides a detailed examination of the evolution of New York City's government structure, presenting direct, evidence-based, comprehensive, and contextualized information.

Strengths:

  1. Comprehensive Coverage: The response is deeply detailed, examining the structure from its initial formation, through changes notably in its mid-20th century, to the present day system.

  2. Evidence and Examples: The argument is substantiated with references to specific time periods, government officials, economic and social challenges, and government organizations established over time.

@danielsgriffin
danielsgriffin / debing.user.js
Created January 23, 2024 00:08
On ChatGPT, any mention of 'Doing research with Bing' on the page will click the Stop generating button.
// ==UserScript==
// @name DeBing
// @namespace http://tampermonkey.net/
// @version 1.0
// @description Any mention of 'Doing research with Bing' on the page will click the Stop generating button.
// @author danielsgriffin
// @match https://chat.openai.com/*
// @grant GM_addStyle
// ==/UserScript==
import os
import requests
from datetime import datetime
import json
import llm # from Simon Willison's https://llm.datasette.io/en/stable/python-api.html
import tiktoken # for constraining prompt context length
YOU_API_KEY = os.environ.get("YOU_API_KEY")
RESULTS_LOG_FILE = "tiyse_results.json"
@danielsgriffin
danielsgriffin / cshtfc.md
Created October 1, 2023 08:07
Fact check schemas for my Claude Shannon hallucination test page
if you see an edited Tweet it's because we're testing the edit button
this is happening and you'll be okay
have doubts? no worries, we got you. follow this thread as we introduce our team of researchers who have been studying this for the past 3 years.
first, they will share stories from in-depth qualitative research on where we see typos (and the not uncommon 'beautiful oops' 🥰) and the friction & conflict introduced as people interact with the Twitter interface. they show convincingly that people underestimate the effect of making or trying to read typos on others and the disproportionate impact across our community. throughout they highlight great academic research and comments from community members.
second, they will present baseline data covering typos over the entire existence of Twitter. we find typos-rate and typo-friction-rates fluctuating over time. sometimes friction is useful (shoutout to Dr. @annatsing!, everyone welcome her to twitter 👋), so they break out comparisons of productive-friction

screenshot: A mock Google search page: Query: [insert query here]

It looks like there aren't many great matches for your search in our index!

Want help reformulating your query? Check out these free external guides for domain-specific advice from community-experts on identifying and revising queries for your searches.

Need help choosing other search systems? Here is a community-managed open source table for selecting search systems: [insert filterable list of search engines with distinct indexes or filtering/interaction features (inc. Internet Archive, government and library web-based search systems, competitor search engines, experimental search engines), links to and community-written guides to question-asking & exploratory browsing on forums and other social media platforms (inc. expert comments on safety, privacy, & transparency reports like links to Ranking Digital Rights, etc.), links to locale-specific librarian desk reference services, collaboration with Wikimedia: 'how to search Wikimedia'. [inclu

@danielsgriffin
danielsgriffin / check_vdr_library.py
Created May 24, 2022 19:42
Script to check if file is already in Voice Dream Reader library
"""Script to check if file is already in Voice Dream Reader library.
I use this script w/in another to open the Reader programmatically with
a new file added if it isn't already in the library.:
The following in the terminal will add the FILENAME to the library
even if already used:
open -a "Voice Dream Reader" FILENAME
Python snippet from external script:
"""Here is the module docstring to explain what this file does.
Purpose: provide a syllabus of sorts with a light introduction to various
aspects of python.
"""
print("Hello Python Boot Camp Students")
def introduce_syllabus():
"""This function introduces the syllabus (this script) for the Python Boot