Extract unique values using Bash

extract-unique-values-using-bash.md

Extract unique values using Bash

awk

Usage

[command with duplicate output |] awk '!a[$0]++' [filename with duplicate values]

Examples

cat file_with_duplicate_values.txt | awk '!a[$0]++'

awk '!a[$0]++' file_with_duplicate_values.txt

sort & unique pipes

Usage

<command with duplicate output> | sort | unique

Example

cat file_with_duplicate_values.txt | sort | unique