In this article, I will share some of my experience on installing NVIDIA driver and CUDA on Linux OS. Here I mainly use Ubuntu as example. Comments for CentOS/Fedora are also provided as much as I can.
View Install Python 3.7.5 on CentOS 7
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Install Python 3.7.5 on CentOS/RHEL 7 | |
1.Requirements: | |
yum install gcc openssl-devel bzip2-devel libffi-devel | |
# Below requirement for djang projects | |
yum install readline-devel tk-devel tk-devel openssl-devel sqlite-devel openssl tk readline sqlite | |
2.Download Python 3.7: |
View .gitignore
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
# Byte-compiled / optimized / DLL files | |
__pycache__/ | |
*.py[cod] | |
*$py.class | |
# C extensions | |
*.so | |
# Distribution / packaging |
View fix-wsl2-dns-resolution
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
More recent resolution: | |
1. cd ~/../../etc (go to etc folder in WSL). | |
2. echo "[network]" | sudo tee wsl.conf (Create wsl.conf file and add the first line). | |
3. echo "generateResolvConf = false" | sudo tee -a wsl.conf (Append wsl.conf the next line). | |
4. wsl --terminate Debian (Terminate WSL in Windows cmd, in case is Ubuntu not Debian). | |
5. cd ~/../../etc (go to etc folder in WSL). | |
6. sudo rm -Rf resolv.conf (Delete the resolv.conf file). | |
7. In windows cmd, ps or terminal with the vpn connected do: Get-NetIPInterface or ipconfig /all for get the dns primary and | |
secondary. |
View gist_1.py
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
def get_surname_code(surname: str, fill_string='0') -> str: | |
seperators, i, pos = ("'", " ", "-"), 0, 0 | |
for letter in surname: | |
i += 1 | |
if letter in seperators: | |
pos = i | |
return surname[pos:pos+3].upper().ljust(3,fill_string) | |
# Example: |
View kafka_file_from_beginning.sh
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
#!/usr/bin/env bash | |
########################################################################### | |
##### $Author Mike Houngbadji (mike.kenneth47@gmail.com) | |
# $Description: data Real time Pipeline in kafka | |
# $History | |
# 20161009 @MIKE | |
########################################################################### | |
kafka_producer='$KAFKA_HOME/bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test'; |
View clean_dataframe_with_pandera_schema.py
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
import pandas as pd | |
import pandera as pa | |
def clean_dataframe_with_schema(dataframe, schema): | |
try: | |
return schema.validate(dataframe) | |
except (pa.errors.SchemaErrors, pa.errors.SchemaError) as err: | |
return dataframe.drop(labels=err.failure_cases['index'].to_list()) |