hardeepnarang10

alias cls="clear"
alias python="python3"
alias py="python3"
alias pip="pip3"

for file in /etc/profile.d/*.sh
	bass source $file
end

hardeepnarang10

• Mass convert large media files on cloud VM instance/cluster into smaller size. Output is generally 10X+ smaller on a 1080P or higher format and almost visually lossless. Can be further down-sized using UHARC if you have many files. Also, way cheaper if you're using cloud VMs for scraping as well.

• Quad-core CPU-optimized instances work best in terms of resource vs cost. I've experimented with octa-core instances but the gains aren't linear and rank lower on cost vs time gains.

• Use snap for latest ffmpeg release (possibly improved compression algorithm). If you're using ffplay for testing installed through apt, then ffmpeg command here may cause clash.

sudo snap install ffmpeg
echo "#!/bin/bash" >> Processor.sh
echo "for file in ./*.mp4; do ffmpeg -i \"\$file\" -c:v libx265 -preset fast -c:a copy \"H265/\$(basename \"\$file\" .mp4)_x265.mp4\" done" >> Processor.sh

hardeepnarang10

• Create swap space. If RAM ~ 1G, 4G would be an overkill in most cases and should be replaced with 2G.

sudo fallocate -l 4G /swapfile
sudo chmod 600 /swapfile
sudo mkswap /swapfile
sudo swapon /swapfile
sudo echo "/swapfile swap swap defaults 0 0" >> /etc/fstab

• Update official repo & packages. Install modules for gnome-desktop. Install VNCServer.

hardeepnarang10

Transcode.sh

ffmpeg -i <input file> -hide_banner -y -c:a aac -ar 48000 -c:v h264 -profile:v baseline -crf 20 -sc_threshold 0 -pix_fmt yuv420p -hls_time 10 -strict -2 -vsync 2 -vf scale=w=XXX:h=XXX -b:v 800k -maxrate XXXk -bufsize 1200k -b:a 96k -hls_time 10 -f hls -hls_list_size 0 <output file>

Replace XXXs for scale settings to match your mediaplayer. Preferable to use an autoscaler on upper-medium settings first and let it process heavier resolutions in background. Maxrate of 1000k-1200k should work fine in most cases - keeping note that bufsize is set to 1200k.

Challenges with Transcoders

Can get stuck every now and then. Use health monitor to pass the following checks and have Kubernetes restart container:

hardeepnarang10

Domain Notes:

• Names are arbitrary values. Specified for our use case because CA performs component checks using name as identifiers.
• Component creation is sequenced in a logical order based on dependency.
• Launch Template (LTs) are templates and Launch Configuration (LCs) & Auto-Scaling Group (ASGs) are implementation of the said template.

---

Target Group:

• Type: Instances.
• Name: website-tg.

hardeepnarang10

package main

import (
	"context"
	"fmt"
	"log"
	"time"
)

func gracefulStop(ctx context.Context, graceDuration time.Duration, stop func() error) error {

hardeepnarang10

2020 - September

Why a Tech Lead Readme?

I wrote this document following my deeply believe that clarity and honesty can help build and strengthen relationships. So I aim to provide a clear understanding of how I can help you and how we can interact better.

TL;DR: I’m here to serve you, not the other way around.

My role

• Help you to succeed and be happy as part of the team.
• Enforce best practices in the team, technical, communications, development workflow.
• Help the team to deliver quality technical solutions in alignment with product and business necessities.
• Help to solve any internal or external technical blocking that may affect the team roadmap.

hardeepnarang10

-> <-

The Novice's LLM Training Guide

->Written by Alpin<- ->Inspired by /hdg/'s LoRA train rentry<- !!!warning This guide is being slowly updated. We've already moved to the axolotl trainer.

---

[TOC2]

hardeepnarang10

package main

import (
	"context"
	"log"
	"strings"
	"time"

	"github.com/aws/aws-sdk-go-v2/aws"
	"github.com/aws/aws-sdk-go-v2/config"

hardeepnarang10

package main

import (
	"archive/tar"
	"fmt"
	"io"
	"io/ioutil"
	"os"

	"github.com/docker/docker/api/types"