Last active
February 3, 2024 18:49
-
-
Save cdown/1163649 to your computer and use it in GitHub Desktop.
Bash urlencode and urldecode
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
urlencode() { | |
# urlencode <string> | |
old_lc_collate=$LC_COLLATE | |
LC_COLLATE=C | |
local length="${#1}" | |
for (( i = 0; i < length; i++ )); do | |
local c="${1:$i:1}" | |
case $c in | |
[a-zA-Z0-9.~_-]) printf '%s' "$c" ;; | |
*) printf '%%%02X' "'$c" ;; | |
esac | |
done | |
LC_COLLATE=$old_lc_collate | |
} | |
urldecode() { | |
# urldecode <string> | |
local url_encoded="${1//+/ }" | |
printf '%b' "${url_encoded//%/\\x}" | |
} |
@ThePredators this breaks on unicode
input: a:/b c?d=e&f#g-+-`-´-ä-€
input hex:
\x61\x3A\x2F\x62\x20\x63\x3F\x64\x3D\x65\x26\x66\x23\x67\x2D\x2B\x2D\x60\x2D\xC2\xB4\x2D\xC3\xA4\x2D\xE2\x82\xAC
input hexdump:
00000000 61 3a 2f 62 20 63 3f 64 3d 65 26 66 23 67 2d 2b |a:/b c?d=e&f#g-+|
00000010 2d 60 2d c2 b4 2d c3 a4 2d e2 82 ac |-`-..-..-...|
0000001c
actual: a%3A%2Fb%20c%3Fd%3De%26f%23g-%2B-%60-%B4-%E4-%20AC
expected: a%3A%2Fb%20c%3Fd%3De%26f%23g-%2B-%60-%C2%B4-%C3%A4-%E2%82%AC
@ThePredators works like a charm 👍
Hi,
Characters used in France are not taken into account: (é è à ù ê â û ...) if you work in fr_FR locale.
You need to convert your data source from Windows-1252 to UTF-8 before entering in the function ::
data_utf8=$(echo "$data_ISO" | iconv -f iso8859-1 -t utf-8)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
This works for me.