Skip to content

Instantly share code, notes, and snippets.

@jaketf
Created November 18, 2020 02:04
Show Gist options
  • Save jaketf/72db54336a322b2836621e4abdceb0df to your computer and use it in GitHub Desktop.
Save jaketf/72db54336a322b2836621e4abdceb0df to your computer and use it in GitHub Desktop.
bigquery-utils initial pre-commit log
No-tabs checker..........................................................Failed
- hook id: forbid-tabs
- exit code: 1
Tabs detected in file: tools/vscode_sql_extraction/.vscode/tasks.json
Tabs detected in file: tools/template_based_query_generation/src/test/java/graph/MarkovChainTest.java
Tabs detected in file: udfs/community/README.md
Tabs detected in file: tools/vscode_query_breakdown/src/test/suite/index.ts
Tabs detected in file: tools/unsupervised_dataset/sql_classifier/classifier/src/test/resources/queries_large.csv
Tabs detected in file: udfs/tests/run.sh
Tabs detected in file: tools/vscode_automatic_query_fixer/.vscode/tasks.json
Tabs detected in file: udfs/community/translate.sql
Tabs detected in file: tools/template_based_query_generation/src/main/java/parser/Utils.java
Tabs detected in file: tools/vscode_automatic_query_fixer/.vscode/extensions.json
Tabs detected in file: tools/template_based_query_generation/src/main/java/graph/Node.java
Tabs detected in file: tools/vscode_sql_extraction/.vscode/launch.json
Tabs detected in file: tools/vscode_query_breakdown/.vscode/tasks.json
Tabs detected in file: tools/vscode_sql_extraction/package-lock.json
Tabs detected in file: tools/vscode_query_breakdown/src/test/runTest.ts
Tabs detected in file: tools/vscode_query_breakdown/.vscode/extensions.json
Tabs detected in file: tools/vscode_query_breakdown/.vscode/launch.json
Tabs detected in file: tools/vscode_query_breakdown/package-lock.json
Tabs detected in file: tools/vscode_automatic_query_fixer/.vscode/launch.json
Tabs detected in file: tools/vscode_sql_extraction/.vscode/extensions.json
Tabs detected in file: tools/template_based_query_generation/src/test/java/QueryGeneratorTest.java
Tabs detected in file: tools/vscode_query_breakdown/src/test/suite/extension.test.ts
Tabs detected in file: tools/template_based_query_generation/src/test/java/graph/NodeTest.java
Add license for all terraform files......................................Passed
Add license for all shell files..........................................Failed
- hook id: insert-license
- exit code: 1
Some sources ['udfs/tests/run.sh'] contain TODO about inconsistent licenses
Now aborting the commit.
You should check the changes made. Then simply "git add --update ." and re-commit
Some sources ['release/build.sh'] contain TODO about inconsistent licenses
Now aborting the commit.
You should check the changes made. Then simply "git add --update ." and re-commit
Add license for all python files.....................(no files to check)Skipped
Add license for all java files.......................(no files to check)Skipped
Add license for all golang files.....................(no files to check)Skipped
Add license for all yaml files...........................................Passed
Check for merge conflicts................................................Passed
Debug Statements (Python)................................................Passed
Check builtin type constructor use.......................................Failed
- hook id: check-builtin-literals
- exit code: 1
tools/cloud_functions/gcs_event_based_ingest/gcs_ocn_bq_ingest/main.py:360:20: replace dict() with {}
Detect Private Key.......................................................Passed
Fix End of Files.........................................................Passed
Mixed line ending........................................................Passed
Check that executables have shebangs.....................................Failed
- hook id: check-executables-have-shebangs
- exit code: 1
release/build.sh: marked executable but has no (or invalid) shebang!
If it isn't supposed to be executable, try: `chmod -x release/build.sh`
If it is supposed to be executable, double-check its shebang.
Trim Trailing Whitespace.................................................Passed
Fix python encoding pragma...............................................Passed
Terraform fmt............................................................Passed
Terraform validate.......................................................Passed
tflint...................................................................Passed
Terraform docs...........................................................Passed
use logger.warning(......................................................Passed
Check yaml files with yamllint...........................................Failed
- hook id: yamllint
- exit code: 1
udfs/cloudbuild.yaml
30:1 warning missing document start "---" (document-start)
34:1 error wrong indentation: expected 2 but found 0 (indentation)
.github/workflows/sql-extraction.yml
1:1 warning missing document start "---" (document-start)
3:1 warning truthy value should be one of [false, true] (truthy)
.github/workflows/vscode-sql-extraction.yml
1:1 warning missing document start "---" (document-start)
3:1 warning truthy value should be one of [false, true] (truthy)
udfs/migration/redshift/test_cases.yaml
15:1 warning missing document start "---" (document-start)
39:111 error line too long (116 > 110 characters) (line-length)
48:111 error line too long (116 > 110 characters) (line-length)
.github/workflows/vscode-automatic-query-fixer.yml
1:1 warning missing document start "---" (document-start)
3:1 warning truthy value should be one of [false, true] (truthy)
udfs/migration/teradata/test_cases.yaml
15:1 warning missing document start "---" (document-start)
46:29 warning too few spaces before comment (comments)
47:11 warning too few spaces before comment (comments)
udfs/migration/snowflake/test_cases.yaml
1:1 error too many blank lines (1 > 0) (empty-lines)
16:1 warning missing document start "---" (document-start)
cloudbuild.yaml
34:1 error wrong indentation: expected 2 but found 0 (indentation)
tools/cloud_functions/gcs_event_based_ingest/cloudbuild.yaml
41:1 error wrong indentation: expected 2 but found 0 (indentation)
57:3 error wrong indentation: expected 4 but found 2 (indentation)
65:3 error wrong indentation: expected 4 but found 2 (indentation)
78:3 error wrong indentation: expected 4 but found 2 (indentation)
85:3 error wrong indentation: expected 4 but found 2 (indentation)
92:3 error wrong indentation: expected 4 but found 2 (indentation)
94:3 error wrong indentation: expected 4 but found 2 (indentation)
udfs/community/test_cases.yaml
15:1 warning missing document start "---" (document-start)
193:11 warning too few spaces before comment (comments)
202:11 warning too few spaces before comment (comments)
210:29 warning too few spaces before comment (comments)
211:11 warning too few spaces before comment (comments)
216:29 warning too few spaces before comment (comments)
220:11 warning too few spaces before comment (comments)
225:29 warning too few spaces before comment (comments)
229:11 warning too few spaces before comment (comments)
237:29 warning too few spaces before comment (comments)
247:49 warning too few spaces before comment (comments)
250:49 warning too few spaces before comment (comments)
Run isort to sort imports................................................Passed
flake8...................................................................Failed
- hook id: flake8
- exit code: 1
tools/unsupervised_dataset/sql_crawler/crawler_log.py:144:111: E501 line too long (118 > 110 characters)
tools/unsupervised_dataset/sql_crawler/crawler_log.py:166:17: E128 continuation line under-indented for visual indent
tools/unsupervised_dataset/sql_crawler/cloud_integration.py:32:5: F841 local variable 'e' is assigned to but never used
tools/unsupervised_dataset/sql_crawler/cloud_integration.py:36:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/cloud_integration.py:56:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/cloud_integration.py:87:5: F841 local variable 'e' is assigned to but never used
tools/unsupervised_dataset/sql_crawler/cloud_integration.py:91:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_2.py:5:111: E501 line too long (264 > 110 characters)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_2.py:8:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_2.py:24:73: E227 missing whitespace around bitwise or shift operator
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_4.py:5:111: E501 line too long (371 > 110 characters)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_4.py:8:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/tests/crawler_test.py:11:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/tests/crawler_test.py:20:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/tests/crawler_test.py:26:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/tests/cq_node_test.py:9:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/tests/cq_node_test.py:12:1: E302 expected 2 blank lines, found 1
udfs/tests/test_create_udfs.py:27:111: E501 line too long (114 > 110 characters)
udfs/tests/test_create_udfs.py:28:111: E501 line too long (112 > 110 characters)
tools/unsupervised_dataset/sql_crawler/tests/crawler_log_test.py:17:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/extraction_modules/generic_extraction_module.py:7:1: E302 expected 2 blank lines, found 1
udfs/tests/test_run_udfs.py:26:111: E501 line too long (114 > 110 characters)
udfs/tests/test_run_udfs.py:29:111: E501 line too long (117 > 110 characters)
udfs/tests/test_run_udfs.py:64:111: E501 line too long (115 > 110 characters)
tools/unsupervised_dataset/sql_crawler/extractor.py:16:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/extractor.py:28:5: F841 local variable 'e' is assigned to but never used
tools/unsupervised_dataset/sql_crawler/extractor.py:47:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/extractor.py:59:32: W605 invalid escape sequence '\s'
tools/unsupervised_dataset/sql_crawler/extractor.py:62:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/tests/extractor_test.py:16:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/tests/extractor_test.py:22:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/tests/extractor_test.py:28:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/tests/extractor_test.py:35:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/sql_crawler/crawler.py:90:62: E226 missing whitespace around arithmetic operator
tools/unsupervised_dataset/run_crawler.py:5:1: F401 'sys' imported but unused
tools/unsupervised_dataset/run_crawler.py:17:111: E501 line too long (124 > 110 characters)
tools/unsupervised_dataset/run_crawler.py:18:111: E501 line too long (146 > 110 characters)
tools/unsupervised_dataset/run_crawler.py:19:111: E501 line too long (142 > 110 characters)
tools/unsupervised_dataset/run_crawler.py:20:111: E501 line too long (237 > 110 characters)
tools/unsupervised_dataset/run_crawler.py:27:111: E501 line too long (156 > 110 characters)
tools/unsupervised_dataset/run_crawler.py:30:1: E302 expected 2 blank lines, found 1
tools/unsupervised_dataset/run_crawler.py:33:1: E305 expected 2 blank lines after class or function definition, found 1
tools/unsupervised_dataset/sql_crawler/extraction_modules/sql_file_extraction_module.py:27:25: W605 invalid escape sequence '\s'
tools/unsupervised_dataset/sql_crawler/extraction_modules/google_extraction_module.py:7:1: E302 expected 2 blank lines, found 1
mypy.....................................................................Passed
Run pylint...............................................................Failed
- hook id: pylint
- exit code: 30
************* Module sql_crawler.crawler_log
tools/unsupervised_dataset/sql_crawler/crawler_log.py:65:0: C0325: Unnecessary parens after 'while' keyword (superfluous-parens)
tools/unsupervised_dataset/sql_crawler/crawler_log.py:144:0: C0301: Line too long (118/110) (line-too-long)
tools/unsupervised_dataset/sql_crawler/crawler_log.py:1:0: C0114: Missing module docstring (missing-module-docstring)
tools/unsupervised_dataset/sql_crawler/crawler_log.py:10:0: R0902: Too many instance attributes (14/7) (too-many-instance-attributes)
tools/unsupervised_dataset/sql_crawler/crawler_log.py:10:0: R0205: Class 'CrawlerLog' inherits from object, can be safely removed from bases in python3 (useless-object-inheritance)
tools/unsupervised_dataset/sql_crawler/crawler_log.py:34:8: C0103: Variable name "logName" doesn't conform to snake_case naming style (invalid-name)
tools/unsupervised_dataset/sql_crawler/crawler_log.py:84:4: R0201: Method could be a function (no-self-use)
tools/unsupervised_dataset/sql_crawler/crawler_log.py:94:4: C0103: Argument name "errorMessage" doesn't conform to snake_case naming style (invalid-name)
tools/unsupervised_dataset/sql_crawler/crawler_log.py:128:8: W0201: Attribute 'gcs_project' defined outside __init__ (attribute-defined-outside-init)
tools/unsupervised_dataset/sql_crawler/crawler_log.py:128:26: W0201: Attribute 'gcs_bucket' defined outside __init__ (attribute-defined-outside-init)
tools/unsupervised_dataset/sql_crawler/crawler_log.py:140:8: W0201: Attribute 'bq_project' defined outside __init__ (attribute-defined-outside-init)
tools/unsupervised_dataset/sql_crawler/crawler_log.py:140:25: W0201: Attribute 'bq_dataset' defined outside __init__ (attribute-defined-outside-init)
tools/unsupervised_dataset/sql_crawler/crawler_log.py:141:8: W0201: Attribute 'bq_table' defined outside __init__ (attribute-defined-outside-init)
------------------------------------------------------------------
Your code has been rated at 8.27/10 (previous run: 8.27/10, +0.00)
************* Module sql_crawler.cloud_integration
tools/unsupervised_dataset/sql_crawler/cloud_integration.py:32:11: W0703: Catching too general exception Exception (broad-except)
tools/unsupervised_dataset/sql_crawler/cloud_integration.py:32:4: C0103: Variable name "e" doesn't conform to snake_case naming style (invalid-name)
tools/unsupervised_dataset/sql_crawler/cloud_integration.py:32:4: W0612: Unused variable 'e' (unused-variable)
tools/unsupervised_dataset/sql_crawler/cloud_integration.py:87:11: W0703: Catching too general exception Exception (broad-except)
tools/unsupervised_dataset/sql_crawler/cloud_integration.py:87:4: C0103: Variable name "e" doesn't conform to snake_case naming style (invalid-name)
tools/unsupervised_dataset/sql_crawler/cloud_integration.py:87:4: W0612: Unused variable 'e' (unused-variable)
tools/unsupervised_dataset/sql_crawler/cloud_integration.py:110:11: W0703: Catching too general exception Exception (broad-except)
tools/unsupervised_dataset/sql_crawler/cloud_integration.py:110:4: C0103: Variable name "e" doesn't conform to snake_case naming style (invalid-name)
************* Module sql_crawler.extraction_modules.extraction_module_2
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_2.py:5:0: C0301: Line too long (264/110) (line-too-long)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_2.py:1:0: C0114: Missing module docstring (missing-module-docstring)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_2.py:3:0: E0401: Unable to import 'bs4' (import-error)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_2.py:8:0: C0115: Missing class docstring (missing-class-docstring)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_2.py:10:4: E0213: Method should have "self" as first argument (no-self-argument)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_2.py:19:29: E1101: Instance of 'ExtractionModule2' has no 'text' member (no-member)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_2.py:8:0: R0903: Too few public methods (1/2) (too-few-public-methods)
************* Module sql_crawler.extraction_modules.extraction_module_4
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_4.py:5:0: C0301: Line too long (371/110) (line-too-long)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_4.py:1:0: C0114: Missing module docstring (missing-module-docstring)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_4.py:3:0: E0401: Unable to import 'bs4' (import-error)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_4.py:8:0: C0115: Missing class docstring (missing-class-docstring)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_4.py:10:4: E0213: Method should have "self" as first argument (no-self-argument)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_4.py:20:29: E1101: Instance of 'ExtractionModule4' has no 'text' member (no-member)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_4.py:8:0: R0903: Too few public methods (1/2) (too-few-public-methods)
************* Module sql_crawler.cq_node
tools/unsupervised_dataset/sql_crawler/cq_node.py:1:0: C0114: Missing module docstring (missing-module-docstring)
tools/unsupervised_dataset/sql_crawler/cq_node.py:1:0: R0205: Class 'CQNode' inherits from object, can be safely removed from bases in python3 (useless-object-inheritance)
------------------------------------------------------------------
Your code has been rated at 3.77/10 (previous run: 3.77/10, +0.00)
************* Module sql_crawler.tests.crawler_test
tools/unsupervised_dataset/sql_crawler/tests/crawler_test.py:6:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/unsupervised_dataset/sql_crawler/tests/crawler_test.py:11:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/unsupervised_dataset/sql_crawler/tests/crawler_test.py:20:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/unsupervised_dataset/sql_crawler/tests/crawler_test.py:26:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module sql_crawler.tests.cq_node_test
tools/unsupervised_dataset/sql_crawler/tests/cq_node_test.py:5:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/unsupervised_dataset/sql_crawler/tests/cq_node_test.py:9:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/unsupervised_dataset/sql_crawler/tests/cq_node_test.py:12:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module gcs_event_based_ingest.tests.test_gcs_ocn_bq_ingest_it
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:28:0: E0401: Unable to import 'gcs_ocn_bq_ingest' (import-error)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:28:0: C0413: Import "from gcs_ocn_bq_ingest import main" should be placed at the top of the module (wrong-import-position)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:35:0: C0103: Function name "bq" doesn't conform to snake_case naming style (invalid-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:48:24: W0621: Redefining name 'gcs' from outer scope (line 41) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:69:13: W0621: Redefining name 'gcs' from outer scope (line 41) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:78:0: C0103: Argument name "bq" doesn't conform to snake_case naming style (invalid-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:78:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:78:26: W0621: Redefining name 'bq' from outer scope (line 35) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:78:30: W0621: Redefining name 'mock_env' from outer scope (line 69) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:78:30: W0613: Unused argument 'mock_env' (unused-argument)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:97:0: C0103: Argument name "bq" doesn't conform to snake_case naming style (invalid-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:97:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:97:24: W0621: Redefining name 'bq' from outer scope (line 35) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:97:28: W0621: Redefining name 'mock_env' from outer scope (line 69) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:97:38: W0621: Redefining name 'dest_dataset' from outer scope (line 78) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:97:28: W0613: Unused argument 'mock_env' (unused-argument)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:118:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:118:22: W0621: Redefining name 'gcs_bucket' from outer scope (line 48) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:118:34: W0621: Redefining name 'dest_dataset' from outer scope (line 78) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:119:13: W0621: Redefining name 'dest_table' from outer scope (line 97) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:130:12: C0103: Variable name "do" doesn't conform to snake_case naming style (invalid-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:139:0: C0103: Argument name "bq" doesn't conform to snake_case naming style (invalid-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:139:18: W0621: Redefining name 'bq' from outer scope (line 35) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:139:22: W0621: Redefining name 'gcs_data' from outer scope (line 118) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:139:32: W0621: Redefining name 'dest_dataset' from outer scope (line 78) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:139:46: W0621: Redefining name 'dest_table' from outer scope (line 97) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:139:58: W0621: Redefining name 'mock_env' from outer scope (line 69) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:139:32: W0613: Unused argument 'dest_dataset' (unused-argument)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:139:58: W0613: Unused argument 'mock_env' (unused-argument)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:157:0: C0103: Argument name "bq" doesn't conform to snake_case naming style (invalid-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:157:32: W0621: Redefining name 'bq' from outer scope (line 35) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:157:36: W0621: Redefining name 'gcs_data' from outer scope (line 118) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:157:46: W0621: Redefining name 'dest_dataset' from outer scope (line 78) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:157:60: W0621: Redefining name 'dest_table' from outer scope (line 97) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:158:32: W0621: Redefining name 'mock_env' from outer scope (line 69) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:157:46: W0613: Unused argument 'dest_dataset' (unused-argument)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:158:32: W0613: Unused argument 'mock_env' (unused-argument)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:184:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:184:40: W0621: Redefining name 'gcs_bucket' from outer scope (line 48) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:184:52: W0621: Redefining name 'dest_dataset' from outer scope (line 78) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:185:31: W0621: Redefining name 'dest_table' from outer scope (line 97) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:205:30: W0621: Redefining name 'gcs_bucket' from outer scope (line 48) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:205:42: W0621: Redefining name 'dest_dataset' from outer scope (line 78) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:206:21: W0621: Redefining name 'dest_table' from outer scope (line 97) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:222:12: C0103: Variable name "do" doesn't conform to snake_case naming style (invalid-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:231:0: C0103: Argument name "bq" doesn't conform to snake_case naming style (invalid-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:231:37: W0621: Redefining name 'bq' from outer scope (line 35) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:231:41: W0621: Redefining name 'gcs_batched_data' from outer scope (line 205) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:232:37: W0621: Redefining name 'gcs_truncating_load_config' from outer scope (line 184) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:232:65: W0621: Redefining name 'dest_dataset' from outer scope (line 78) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:233:37: W0621: Redefining name 'dest_table' from outer scope (line 97) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:233:49: W0621: Redefining name 'mock_env' from outer scope (line 69) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:243:8: W0621: Redefining name 'gcs_data' from outer scope (line 118) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:231:0: R0913: Too many arguments (6/5) (too-many-arguments)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:232:65: W0613: Unused argument 'dest_dataset' (unused-argument)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:233:49: W0613: Unused argument 'mock_env' (unused-argument)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:260:0: C0103: Argument name "bq" doesn't conform to snake_case naming style (invalid-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:260:36: W0621: Redefining name 'bq' from outer scope (line 35) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:260:40: W0621: Redefining name 'gcs_batched_data' from outer scope (line 205) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:260:58: W0621: Redefining name 'dest_dataset' from outer scope (line 78) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:261:36: W0621: Redefining name 'dest_table' from outer scope (line 97) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:261:48: W0621: Redefining name 'mock_env' from outer scope (line 69) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:273:11: W0621: Redefining name 'gcs_data' from outer scope (line 118) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:260:58: W0613: Unused argument 'dest_dataset' (unused-argument)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:261:48: W0613: Unused argument 'mock_env' (unused-argument)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:288:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:288:33: W0621: Redefining name 'gcs_bucket' from outer scope (line 48) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:288:45: W0621: Redefining name 'dest_dataset' from outer scope (line 78) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:289:24: W0621: Redefining name 'dest_table' from outer scope (line 97) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:328:12: C0103: Variable name "do" doesn't conform to snake_case naming style (invalid-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:337:0: C0103: Argument name "bq" doesn't conform to snake_case naming style (invalid-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:337:24: W0621: Redefining name 'bq' from outer scope (line 35) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:337:28: W0621: Redefining name 'gcs_data' from outer scope (line 118) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:337:38: W0621: Redefining name 'gcs_external_config' from outer scope (line 288) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:337:59: W0621: Redefining name 'dest_dataset' from outer scope (line 78) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:338:24: W0621: Redefining name 'dest_table' from outer scope (line 97) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:338:36: W0621: Redefining name 'mock_env' from outer scope (line 69) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:337:0: R0913: Too many arguments (6/5) (too-many-arguments)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:337:59: W0613: Unused argument 'dest_dataset' (unused-argument)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:338:36: W0613: Unused argument 'mock_env' (unused-argument)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:362:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:362:34: W0621: Redefining name 'gcs_bucket' from outer scope (line 48) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:362:46: W0621: Redefining name 'dest_dataset' from outer scope (line 78) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:363:25: W0621: Redefining name 'dest_partitioned_table' from outer scope (line 387) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:387:0: C0103: Argument name "bq" doesn't conform to snake_case naming style (invalid-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:387:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:387:36: W0621: Redefining name 'bq' from outer scope (line 35) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:387:57: W0621: Redefining name 'mock_env' from outer scope (line 69) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:388:27: W0621: Redefining name 'dest_dataset' from outer scope (line 78) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:387:57: W0613: Unused argument 'mock_env' (unused-argument)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:414:0: C0103: Argument name "bq" doesn't conform to snake_case naming style (invalid-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:414:30: W0621: Redefining name 'bq' from outer scope (line 35) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:414:34: W0621: Redefining name 'gcs_partitioned_data' from outer scope (line 362) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:415:30: W0621: Redefining name 'gcs_truncating_load_config' from outer scope (line 184) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:415:58: W0621: Redefining name 'dest_dataset' from outer scope (line 78) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:416:30: W0621: Redefining name 'dest_partitioned_table' from outer scope (line 387) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:416:54: W0621: Redefining name 'mock_env' from outer scope (line 69) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:429:8: W0621: Redefining name 'gcs_data' from outer scope (line 118) (redefined-outer-name)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:414:0: R0913: Too many arguments (6/5) (too-many-arguments)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:415:58: W0613: Unused argument 'dest_dataset' (unused-argument)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest_it.py:416:54: W0613: Unused argument 'mock_env' (unused-argument)
************* Module create_udf_signatures
udfs/tests/create_udf_signatures.py:1:0: C0114: Missing module docstring (missing-module-docstring)
udfs/tests/create_udf_signatures.py:25:0: C0115: Missing class docstring (missing-class-docstring)
udfs/tests/create_udf_signatures.py:32:4: C0116: Missing function or method docstring (missing-function-docstring)
udfs/tests/create_udf_signatures.py:50:8: C0103: Variable name "e" doesn't conform to snake_case naming style (invalid-name)
------------------------------------------------------------------
Your code has been rated at 5.50/10 (previous run: 5.50/10, +0.00)
************* Module test_create_udfs
udfs/tests/test_create_udfs.py:27:0: C0301: Line too long (114/110) (line-too-long)
udfs/tests/test_create_udfs.py:28:0: C0301: Line too long (112/110) (line-too-long)
udfs/tests/test_create_udfs.py:1:0: C0114: Missing module docstring (missing-module-docstring)
udfs/tests/test_create_udfs.py:37:4: C0116: Missing function or method docstring (missing-function-docstring)
udfs/tests/test_create_udfs.py:52:8: C0103: Variable name "e" doesn't conform to snake_case naming style (invalid-name)
************* Module udf_test_utils
udfs/tests/udf_test_utils.py:1:0: C0114: Missing module docstring (missing-module-docstring)
udfs/tests/udf_test_utils.py:37:0: C0116: Missing function or method docstring (missing-function-docstring)
udfs/tests/udf_test_utils.py:41:0: C0116: Missing function or method docstring (missing-function-docstring)
udfs/tests/udf_test_utils.py:51:0: C0116: Missing function or method docstring (missing-function-docstring)
udfs/tests/udf_test_utils.py:57:4: R1705: Unnecessary "else" after "return" (no-else-return)
udfs/tests/udf_test_utils.py:64:0: C0116: Missing function or method docstring (missing-function-docstring)
udfs/tests/udf_test_utils.py:70:4: R1705: Unnecessary "else" after "return" (no-else-return)
udfs/tests/udf_test_utils.py:77:0: C0116: Missing function or method docstring (missing-function-docstring)
udfs/tests/udf_test_utils.py:86:4: R1705: Unnecessary "else" after "return" (no-else-return)
udfs/tests/udf_test_utils.py:92:0: C0116: Missing function or method docstring (missing-function-docstring)
udfs/tests/udf_test_utils.py:97:0: C0116: Missing function or method docstring (missing-function-docstring)
udfs/tests/udf_test_utils.py:103:0: C0116: Missing function or method docstring (missing-function-docstring)
udfs/tests/udf_test_utils.py:109:0: C0116: Missing function or method docstring (missing-function-docstring)
------------------------------------------------------------------
Your code has been rated at 8.06/10 (previous run: 8.06/10, +0.00)
************* Module sql_crawler.tests.crawler_log_test
tools/unsupervised_dataset/sql_crawler/tests/crawler_log_test.py:7:0: C0325: Unnecessary parens after 'assert' keyword (superfluous-parens)
tools/unsupervised_dataset/sql_crawler/tests/crawler_log_test.py:10:0: C0325: Unnecessary parens after 'assert' keyword (superfluous-parens)
tools/unsupervised_dataset/sql_crawler/tests/crawler_log_test.py:11:0: C0325: Unnecessary parens after 'assert' keyword (superfluous-parens)
tools/unsupervised_dataset/sql_crawler/tests/crawler_log_test.py:14:0: C0325: Unnecessary parens after 'assert' keyword (superfluous-parens)
tools/unsupervised_dataset/sql_crawler/tests/crawler_log_test.py:15:0: C0325: Unnecessary parens after 'assert' keyword (superfluous-parens)
tools/unsupervised_dataset/sql_crawler/tests/crawler_log_test.py:25:0: C0325: Unnecessary parens after 'assert' keyword (superfluous-parens)
tools/unsupervised_dataset/sql_crawler/tests/crawler_log_test.py:5:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/unsupervised_dataset/sql_crawler/tests/crawler_log_test.py:17:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module sql_crawler.extraction_modules.extraction_module_1
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_1.py:1:0: C0114: Missing module docstring (missing-module-docstring)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_1.py:1:0: E0401: Unable to import 'bs4' (import-error)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_1.py:4:0: C0115: Missing class docstring (missing-class-docstring)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_1.py:6:4: E0213: Method should have "self" as first argument (no-self-argument)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_1.py:16:29: E1101: Instance of 'ExtractionModule1' has no 'text' member; maybe 'next'? (no-member)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_1.py:4:0: R0903: Too few public methods (1/2) (too-few-public-methods)
************* Module gcs_event_based_ingest.tests.test_gcs_ocn_bq_ingest
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest.py:24:0: E0401: Unable to import 'gcs_ocn_bq_ingest' (import-error)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest.py:24:0: C0413: Import "from gcs_ocn_bq_ingest import main" should be placed at the top of the module (wrong-import-position)
tools/cloud_functions/gcs_event_based_ingest/tests/test_gcs_ocn_bq_ingest.py:85:0: C0116: Missing function or method docstring (missing-function-docstring)
------------------------------------------------------------------
Your code has been rated at 8.72/10 (previous run: 8.72/10, +0.00)
************* Module sql_crawler.extraction_modules.generic_extraction_module
tools/unsupervised_dataset/sql_crawler/extraction_modules/generic_extraction_module.py:12:4: E0213: Method should have "self" as first argument (no-self-argument)
tools/unsupervised_dataset/sql_crawler/extraction_modules/generic_extraction_module.py:23:18: E1101: Instance of 'GenericExtractionModule' has no 'text' member (no-member)
tools/unsupervised_dataset/sql_crawler/extraction_modules/generic_extraction_module.py:7:0: R0903: Too few public methods (1/2) (too-few-public-methods)
************* Module test_run_udfs
udfs/tests/test_run_udfs.py:26:0: C0301: Line too long (114/110) (line-too-long)
udfs/tests/test_run_udfs.py:29:0: C0301: Line too long (117/110) (line-too-long)
udfs/tests/test_run_udfs.py:64:0: C0301: Line too long (115/110) (line-too-long)
udfs/tests/test_run_udfs.py:1:0: C0114: Missing module docstring (missing-module-docstring)
udfs/tests/test_run_udfs.py:38:4: C0116: Missing function or method docstring (missing-function-docstring)
udfs/tests/test_run_udfs.py:68:12: C0103: Variable name "e" doesn't conform to snake_case naming style (invalid-name)
************* Module sql_crawler.extractor
tools/unsupervised_dataset/sql_crawler/extractor.py:59:0: W1401: Anomalous backslash in string: '\s'. String constant might be missing an r prefix. (anomalous-backslash-in-string)
tools/unsupervised_dataset/sql_crawler/extractor.py:10:0: E0401: Unable to import 'bs4' (import-error)
tools/unsupervised_dataset/sql_crawler/extractor.py:28:11: W0703: Catching too general exception Exception (broad-except)
tools/unsupervised_dataset/sql_crawler/extractor.py:28:4: C0103: Variable name "e" doesn't conform to snake_case naming style (invalid-name)
tools/unsupervised_dataset/sql_crawler/extractor.py:28:4: W0612: Unused variable 'e' (unused-variable)
tools/unsupervised_dataset/sql_crawler/extractor.py:75:4: R1705: Unnecessary "else" after "return" (no-else-return)
------------------------------------------------------------------
Your code has been rated at 6.14/10 (previous run: 6.14/10, +0.00)
************* Module sql_crawler.tests.extractor_test
tools/unsupervised_dataset/sql_crawler/tests/extractor_test.py:5:0: R0205: Class 'MockRequest' inherits from object, can be safely removed from bases in python3 (useless-object-inheritance)
tools/unsupervised_dataset/sql_crawler/tests/extractor_test.py:5:0: R0903: Too few public methods (0/2) (too-few-public-methods)
tools/unsupervised_dataset/sql_crawler/tests/extractor_test.py:16:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/unsupervised_dataset/sql_crawler/tests/extractor_test.py:22:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/unsupervised_dataset/sql_crawler/tests/extractor_test.py:28:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/unsupervised_dataset/sql_crawler/tests/extractor_test.py:35:0: C0116: Missing function or method docstring (missing-function-docstring)
************* Module sql_crawler.crawler
tools/unsupervised_dataset/sql_crawler/crawler.py:1:0: C0114: Missing module docstring (missing-module-docstring)
tools/unsupervised_dataset/sql_crawler/crawler.py:7:0: R0205: Class 'Crawler' inherits from object, can be safely removed from bases in python3 (useless-object-inheritance)
tools/unsupervised_dataset/sql_crawler/crawler.py:13:4: R0913: Too many arguments (7/5) (too-many-arguments)
************* Module run_crawler
tools/unsupervised_dataset/run_crawler.py:17:0: C0301: Line too long (124/110) (line-too-long)
tools/unsupervised_dataset/run_crawler.py:18:0: C0301: Line too long (146/110) (line-too-long)
tools/unsupervised_dataset/run_crawler.py:19:0: C0301: Line too long (142/110) (line-too-long)
tools/unsupervised_dataset/run_crawler.py:20:0: C0301: Line too long (237/110) (line-too-long)
tools/unsupervised_dataset/run_crawler.py:27:0: C0301: Line too long (156/110) (line-too-long)
tools/unsupervised_dataset/run_crawler.py:30:0: C0116: Missing function or method docstring (missing-function-docstring)
tools/unsupervised_dataset/run_crawler.py:5:0: W0611: Unused import sys (unused-import)
************* Module sql_crawler.extraction_modules.sql_file_extraction_module
tools/unsupervised_dataset/sql_crawler/extraction_modules/sql_file_extraction_module.py:27:0: W1401: Anomalous backslash in string: '\s'. String constant might be missing an r prefix. (anomalous-backslash-in-string)
tools/unsupervised_dataset/sql_crawler/extraction_modules/sql_file_extraction_module.py:12:4: E0213: Method should have "self" as first argument (no-self-argument)
tools/unsupervised_dataset/sql_crawler/extraction_modules/sql_file_extraction_module.py:8:0: R0903: Too few public methods (1/2) (too-few-public-methods)
------------------------------------------------------------------
Your code has been rated at 7.91/10 (previous run: 7.91/10, +0.00)
************* Module sql_crawler.extraction_modules.extraction_module_3
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_3.py:1:0: C0114: Missing module docstring (missing-module-docstring)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_3.py:1:0: E0401: Unable to import 'bs4' (import-error)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_3.py:4:0: C0115: Missing class docstring (missing-class-docstring)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_3.py:6:4: E0213: Method should have "self" as first argument (no-self-argument)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_3.py:16:29: E1101: Instance of 'ExtractionModule3' has no 'text' member (no-member)
tools/unsupervised_dataset/sql_crawler/extraction_modules/extraction_module_3.py:4:0: R0903: Too few public methods (1/2) (too-few-public-methods)
************* Module sql_crawler.extraction_modules.google_extraction_module
tools/unsupervised_dataset/sql_crawler/extraction_modules/google_extraction_module.py:1:0: C0114: Missing module docstring (missing-module-docstring)
tools/unsupervised_dataset/sql_crawler/extraction_modules/google_extraction_module.py:3:0: E0401: Unable to import 'bs4' (import-error)
tools/unsupervised_dataset/sql_crawler/extraction_modules/google_extraction_module.py:7:0: C0115: Missing class docstring (missing-class-docstring)
tools/unsupervised_dataset/sql_crawler/extraction_modules/google_extraction_module.py:7:0: R0205: Class 'GoogleExtractionModule' inherits from object, can be safely removed from bases in python3 (useless-object-inheritance)
tools/unsupervised_dataset/sql_crawler/extraction_modules/google_extraction_module.py:9:4: E0213: Method should have "self" as first argument (no-self-argument)
tools/unsupervised_dataset/sql_crawler/extraction_modules/google_extraction_module.py:22:29: E1101: Instance of 'GoogleExtractionModule' has no 'text' member (no-member)
tools/unsupervised_dataset/sql_crawler/extraction_modules/google_extraction_module.py:7:0: R0903: Too few public methods (1/2) (too-few-public-methods)
--------------------------------------------------------------------
Your code has been rated at -7.62/10 (previous run: -7.62/10, +0.00)
Hadolint.................................................................Failed
- hook id: hadolint
- exit code: 1
tools/zetasql_helper/Dockerfile:6 DL3015 Avoid additional packages by specifying `--no-install-recommends`
tools/zetasql_helper/Dockerfile:13 DL3027 Do not use apt as it is meant to be a end-user tool, use apt-get or apt-cache instead
tools/zetasql_helper/Dockerfile:29 DL3000 Use absolute WORKDIR
Check Shell scripts syntax correctness...................................Failed
- hook id: shellcheck
- exit code: 1
In ci/image/fix_ownership.sh line 25:
source "$( dirname "${BASH_SOURCE[0]}" )/_functions.sh"
^-- SC1091: Not following: scripts/ci-image/_functions.sh: openBinaryFile: does not exist (No such file or directory)
In ci/cache/_functions.sh line 32:
source "${ROOT_DIR}/scripts/_common_values.sh"
^-- SC1091: Not following: scripts/_common_values.sh: openBinaryFile: does not exist (No such file or directory)
In ci/cache/restore_cache.sh line 21:
source "$( dirname "${BASH_SOURCE[0]}" )/_functions.sh"
^-- SC1091: Not following: scripts/cache/_functions.sh: openBinaryFile: does not exist (No such file or directory)
For more information:
https://www.shellcheck.net/wiki/SC1091 -- Not following: scripts/_common_va...
In ci/cache/store_cache.sh line 22:
source "$( dirname "${BASH_SOURCE[0]}" )/_functions.sh"
^-- SC1091: Not following: scripts/cache/_functions.sh: openBinaryFile: does not exist (No such file or directory)
For more information:
https://www.shellcheck.net/wiki/SC1091 -- Not following: scripts/cache/_fun...
In ci/image/_functions.sh line 30:
source "${ROOT_DIR}/scripts/_common_values.sh"
^-- SC1091: Not following: scripts/_common_values.sh: openBinaryFile: does not exist (No such file or directory)
In release/build.sh line 3:
#!/usr/bin/env bash
^-- SC1128: The shebang must be on the first line. Delete blanks and move comments.
In release/build.sh line 20:
SCRIPT_DIR="$( cd "$(dirname "$0")" ; pwd -P )"
^------------------^ SC2164: Use 'cd ... || exit' or 'cd ... || return' in case cd fails.
Did you mean:
SCRIPT_DIR="$( cd "$(dirname "$0")" || exit ; pwd -P )"
In release/build.sh line 83:
if ! bq show --headless $dataset > /dev/null 2>&1; then
^------^ SC2086: Double quote to prevent globbing and word splitting.
Did you mean:
if ! bq show --headless "$dataset" > /dev/null 2>&1; then
In release/build.sh line 84:
bq mk --headless -d --data_location=$LOCATION $dataset
^------^ SC2086: Double quote to prevent globbing and word splitting.
Did you mean:
bq mk --headless -d --data_location=$LOCATION "$dataset"
In release/build.sh line 107:
printf "${BOLD}${file}${NORMAL}\n"
^-------------------------^ SC2059: Don't use variables in the printf format string. Use printf '..%s..' "$foo".
In release/build.sh line 109:
bq query --dataset_id $dataset --headless --nouse_legacy_sql --dry_run "$(cat $file)"
^------^ SC2086: Double quote to prevent globbing and word splitting.
^---^ SC2086: Double quote to prevent globbing and word splitting.
Did you mean:
bq query --dataset_id "$dataset" --headless --nouse_legacy_sql --dry_run "$(cat "$file")"
In release/build.sh line 111:
bq query --dataset_id $dataset --headless --nouse_legacy_sql "$(cat $file)"
^------^ SC2086: Double quote to prevent globbing and word splitting.
^---^ SC2086: Double quote to prevent globbing and word splitting.
Did you mean:
bq query --dataset_id "$dataset" --headless --nouse_legacy_sql "$(cat "$file")"
In release/build.sh line 114:
if [[ $? -gt 0 ]]; then
^-- SC2181: Check exit code directly with e.g. 'if mycmd;', not indirectly with $?.
In release/build.sh line 115:
printf "Failed to create: $file"
^-----------------------^ SC2059: Don't use variables in the printf format string. Use printf '..%s..' "$foo".
In release/build.sh line 132:
local sql_files=$(find . -type f -name "*.sql")
^-------^ SC2155: Declare and assign separately to avoid masking return values.
In release/build.sh line 133:
local num_files=$(echo "$sql_files" | wc -l)
^-------^ SC2155: Declare and assign separately to avoid masking return values.
In release/build.sh line 135:
printf "Building $num_files database objects...\n"
^-- SC2059: Don't use variables in the printf format string. Use printf '..%s..' "$foo".
In release/build.sh line 137:
local dataset=$(get_dataset $file)
^-----^ SC2155: Declare and assign separately to avoid masking return values.
^---^ SC2086: Double quote to prevent globbing and word splitting.
Did you mean:
local dataset=$(get_dataset "$file")
In release/build.sh line 139:
if [[ ! -z $dataset ]]; then
^-- SC2236: Use -n instead of ! -z.
In release/build.sh line 140:
create_dataset_if_not_exists $dataset
^------^ SC2086: Double quote to prevent globbing and word splitting.
Did you mean:
create_dataset_if_not_exists "$dataset"
In release/build.sh line 141:
execute_query $file true $dataset
^---^ SC2086: Double quote to prevent globbing and word splitting.
^------^ SC2086: Double quote to prevent globbing and word splitting.
Did you mean:
execute_query "$file" true "$dataset"
In release/build.sh line 158:
local sql_files=$(find $UDF_DIR -type f -name "*.sql")
^-------^ SC2155: Declare and assign separately to avoid masking return values.
In release/build.sh line 159:
local num_files=$(echo "$sql_files" | wc -l)
^-------^ SC2155: Declare and assign separately to avoid masking return values.
In release/build.sh line 161:
printf "Creating or updating $num_files database objects...\n"
^-- SC2059: Don't use variables in the printf format string. Use printf '..%s..' "$foo".
In release/build.sh line 163:
local dataset=$(get_dataset $file)
^-----^ SC2155: Declare and assign separately to avoid masking return values.
^---^ SC2086: Double quote to prevent globbing and word splitting.
Did you mean:
local dataset=$(get_dataset "$file")
In release/build.sh line 166:
create_dataset_if_not_exists $dataset
^------^ SC2086: Double quote to prevent globbing and word splitting.
Did you mean:
create_dataset_if_not_exists "$dataset"
In release/build.sh line 167:
execute_query $file false $dataset
^---^ SC2086: Double quote to prevent globbing and word splitting.
^------^ SC2086: Double quote to prevent globbing and word splitting.
Did you mean:
execute_query "$file" false "$dataset"
In release/build.sh line 185:
cd $SCRIPT_DIR/.. || exit
^---------^ SC2086: Double quote to prevent globbing and word splitting.
Did you mean:
cd "$SCRIPT_DIR"/.. || exit
For more information:
https://www.shellcheck.net/wiki/SC1128 -- The shebang must be on the first ...
https://www.shellcheck.net/wiki/SC2155 -- Declare and assign separately to ...
https://www.shellcheck.net/wiki/SC2164 -- Use 'cd ... || exit' or 'cd ... |...
Add TOC for md files.....................................................Passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment