Created
September 25, 2018 03:42
-
-
Save rjdudley/7df48e4792414b6c0b169b6738ba03de to your computer and use it in GitHub Desktop.
First test of log parser in U-SQL
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
@input = | |
EXTRACT ip string, | |
identd string, | |
remote_user string, | |
timestamp string, | |
offset string, | |
method_file_protocol string, | |
response int, | |
size string, | |
domain string, | |
url string, | |
user_agent string, | |
forwarded string | |
FROM "adl://redactedprojctname.azuredatalakestore.net/mylogs_raw/2017/access.log.45" | |
USING Extractors.Text(delimiter:' '); | |
OUTPUT @input | |
TO "adl://redactedprojectname.azuredatalakestore.net/mylogs_transformed/input45.txt" | |
USING Outputters.Csv(); |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment