Skip to content

Instantly share code, notes, and snippets.

@rjdudley
Created September 25, 2018 03:42
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save rjdudley/7df48e4792414b6c0b169b6738ba03de to your computer and use it in GitHub Desktop.
Save rjdudley/7df48e4792414b6c0b169b6738ba03de to your computer and use it in GitHub Desktop.
First test of log parser in U-SQL
@input =
EXTRACT ip string,
identd string,
remote_user string,
timestamp string,
offset string,
method_file_protocol string,
response int,
size string,
domain string,
url string,
user_agent string,
forwarded string
FROM "adl://redactedprojctname.azuredatalakestore.net/mylogs_raw/2017/access.log.45"
USING Extractors.Text(delimiter:' ');
OUTPUT @input
TO "adl://redactedprojectname.azuredatalakestore.net/mylogs_transformed/input45.txt"
USING Outputters.Csv();
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment