Skip to content

Instantly share code, notes, and snippets.

View asowder3943's full-sized avatar

Adam Sowder asowder3943

  • Charlottesville, Virginia
View GitHub Profile

Keybase proof

I hereby claim:

  • I am asowder3943 on github.
  • I am asowder3943 (https://keybase.io/asowder3943) on keybase.
  • I have a public key ASB7_tFrn_HER0Qlc6Kyv_QrtrBeb-VpK38OaASAg07JZQo

To claim this, I am signing this object:

@asowder3943
asowder3943 / Linode Hardening Procedure.md
Last active August 17, 2022 03:00
Procedure for hardening Linode Webserver

Configuring Linode Web Server Procedure

During Linode Provisioning Setup

  1. Enter Secure root user password using password manager

image

2. Add SSH keys for CD Pipeline tool

image

3. Select Backup Add On for data protection

image

@asowder3943
asowder3943 / webscraping-1.md
Last active August 30, 2022 06:13
Web Scraping on Linux with xdotool and Python

Web Scraping on Linux with xdotool and Python Original Creation: (2017)

Read Time: 20 minutes

Introduction

In this post, I am going to demonstrate how to do some simple web scraping with xdotool and the pyperclip Python module.

Web scraping is an important skill to have if you want to work with public data on the internet. Sometimes you may need information from a website on a regular basis, but there is no neat api to send requests to. In these cases web scraping may be necessary. Web scraping on static html pages is easy enough: simply send some requests and parse the results that are returned. Things get a little trickier though when you are dealing with a site that has authentication layers, or dynamically loaded content. What if you could get your data the same way a user with a keyboard and mouse would?

Disclaimer

Importantly before I continue, I feel the need to say: Please don’t be a Jerk when web scraping. Be mindful of the rate at which you are making requests to individual sites,

@asowder3943
asowder3943 / Homebrew.terminal
Last active December 17, 2022 06:00
Macos UI Customization
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
<dict>
<key>BackgroundColor</key>
<data>
YnBsaXN0MDDUAQIDBAUGBwpYJHZlcnNpb25ZJGFyY2hpdmVyVCR0b3BYJG9iamVjdHMS
AAGGoF8QD05TS2V5ZWRBcmNoaXZlctEICVRyb290gAGmCwwXHR4lVSRudWxs1Q0ODxAR
EhMUFRZcTlNDb21wb25lbnRzVU5TUkdCXE5TQ29sb3JTcGFjZV8QEk5TQ3VzdG9tQ29s
b3JTcGFjZVYkY2xhc3NPECgwLjExNzY0NzA1MTggMC4xMTc2NDcwNTE4IDAuMjM5MjE1
@asowder3943
asowder3943 / install-docker.sh
Last active August 21, 2022 00:31
Installing Docker on Debian (Linode Deployment)
#!/bin/bash
#
# Docker installation Script created using instruction from
# https://docs.docker.com/engine/install/debian/
#
# Uninstall old versions
sudo apt-get -y remove docker docker-engine docker.io containerd runc
@asowder3943
asowder3943 / random_connection.sh
Last active August 19, 2022 01:39
ExpressVPN - Connect to Random VPN Server
#!/bin/bash
#
# Express VPN Connect to Random Location
# *** Note: It is highly recommended the client be configured to block traffic on vpn disconnect
#
#
# Options - accept vpn cli as argument
@asowder3943
asowder3943 / gharchive.sh
Last active August 22, 2022 21:20
Downloading All Github Repos of a Given User or Organization
#!/bin/bash
# gharchive is a simple script for downloading all
# github repositories associated with a given user or organization
#
# :dependencies: gh, awk, sed, wget, git
#
# :param: -u pass the user or organization name as it appears on github
# :param: -t pass the download type your wish to preform currently both "clone" and "archive" are supported
@asowder3943
asowder3943 / question.md
Last active August 24, 2022 17:59
Crawlee Documentation Question

Hello Everyone! -> I'm new to crawlee and typescript in general.

I know there are a lot more important things on the maintainers' plates right now, but I was following this section when I encountered the following failure:

error TS2345: Argument of type 'string | undefined' is not assignable to parameter of type 'string'.
  Type 'undefined' is not assignable to type 'string'.

image

@asowder3943
asowder3943 / not_implemented.md
Last active August 31, 2022 07:20
Not Implemented Yet Landing Page

Sorry - That Page or Feature is Not Implemented Yet

Feel free to Leave a comment and let me know how you got here, or have a snack While You wait 🍪🥛