yspkm

#include <stdio.h>
#include <stdlib.h>

#define assert(expr) do { \
    if (!(expr)) { \
        fprintf(stderr, "Assertion failed: %s:%d: %s\n", __FILE__, __LINE__, #expr); \
        exit(EXIT_FAILURE); \
    } \
} while(0)

yspkm

Make these changes in the cassandra.yaml config file:

start_rpc: true

rpc_address: 0.0.0.0

broadcast_rpc_address: 1.2.3.4

listen_address: [node-ip]

yspkm

seq <개수> | xargs -I % 명령어 <file명_넘버링은 %>.<식별자>

yspkm

FROM rockylinux:9.2

WORKDIR /app

RUN dnf update -y && dnf install -y \
    python3 \
    python3-devel \
    gcc \
    openssl-devel \
    libffi-devel \

yspkm

sudo apt-get update
sudo apt-get upgrade -y

sudo apt-get install build-essential -y
sudo apt-get install openjdk-20-jdk -y
sudo apt-get install python3 python3-pip python-is-python3 -y
sudo apt-get install golang-go -y

sudo apt-get install net-tools
sudo apt-get install ucommon-utils

yspkm

gcloud container clusters create k8s \
--cluster-version 1.27.2-gke.1200 \
--zone asia-northeast3-a \
--num-nodes 3 \
--machine-type n1-standard-4 \
--enable-network-policy \
--enable-vertical-pod-autoscaling

yspkm

python3 -m venv env-id
source env-id/bin/activate #요 부분이 21년 자료랑 약가 다름?

yspkm

1. code 명령어 생성

command + shift + p 누르고 shell 입력한 뒤에 code 명령어 생성

2. 플러그인과 실행시 방향키 꾹 누르면 연속입력

defaults write -g ApplePressAndHoldEnabled -bool false

yspkm

pyspark --packages com.datastax.spark:spark-cassandra-connector_2.12:3.4.0 --conf spark.cassandra.connection.host=ip주소
spark-submit --packages com.datastax.spark:spark-cassandra-connector_2.12:3.4.0 /abs/path/test.py 

yspkm

https://velog.io/@statco19/pyspark-kafka-streaming