Setting up my pyspark enviorment.

app.sh

if [ -e log4j2.properties.template ];
then
	echo "Renaming file"
	chmod u+rwx log4j2.properties.template
	mv log4j2.properties.template log4j2.properties
fi

sed  '/Logger/{
s/info/ERROR/
}' log4* >> log4j2.properties

Note: Pyspark only work with Java8 or Java11.
Also,
path[10]=/Users/kazimsyed/Organized/all_folders/spark-3.3.2-bin-hadoop3/bin;
Here to have ur changes persist add this to ur .zlogin or .zprofile.