Skip to content

Instantly share code, notes, and snippets.

@carrbrpoa
Created February 19, 2021 12:13
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save carrbrpoa/b4c62917921d1e320aeb72f396ffe14a to your computer and use it in GitHub Desktop.
Save carrbrpoa/b4c62917921d1e320aeb72f396ffe14a to your computer and use it in GitHub Desktop.
[2021-02-19 09:10:22,108] DEBUG {datahub.ingestion.source.sql_common:155} - sql_alchemy_url=postgresql+psycopg2://myuser:mypass@mydb:5000/geodb
/home/me/git-github/datahub/venv/lib/python3.6/site-packages/sqlalchemy/dialects/postgresql/base.py:3199: SAWarning: Did not recognize type 'geometry' of column 'geom'
"Did not recognize type '%s' of column '%s'" % (attype, name)
Traceback (most recent call last):
File "/home/me/git-github/datahub/venv/bin/datahub", line 11, in <module>
load_entry_point('datahub', 'console_scripts', 'datahub')()
File "/home/me/git-github/datahub/venv/lib/python3.6/site-packages/click/core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "/home/me/git-github/datahub/venv/lib/python3.6/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/home/me/git-github/datahub/venv/lib/python3.6/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/home/me/git-github/datahub/venv/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/home/me/git-github/datahub/venv/lib/python3.6/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/home/me/git-github/datahub/metadata-ingestion/src/datahub/entrypoints.py", line 64, in ingest
pipeline.run()
File "/home/me/git-github/datahub/metadata-ingestion/src/datahub/ingestion/run/pipeline.py", line 86, in run
for wu in self.source.get_workunits():
File "/home/me/git-github/datahub/metadata-ingestion/src/datahub/ingestion/source/sql_common.py", line 174, in get_workunits
self.report, dataset_name, platform, columns
File "/home/me/git-github/datahub/metadata-ingestion/src/datahub/ingestion/source/sql_common.py", line 122, in get_schema_metadata
type=get_column_type(sql_report, dataset_name, column["type"]),
File "/home/me/git-github/datahub/metadata-ingestion/src/datahub/ingestion/source/sql_common.py", line 107, in get_column_type
dataset_name, f"unable to map type {column_type} to metadata schema"
File "/home/me/git-github/datahub/venv/lib/python3.6/site-packages/sqlalchemy/sql/type_api.py", line 622, in __str__
return str(self.compile())
File "/home/me/git-github/datahub/venv/lib/python3.6/site-packages/sqlalchemy/sql/type_api.py", line 605, in compile
return dialect.type_compiler.process(self)
File "/home/me/git-github/datahub/venv/lib/python3.6/site-packages/sqlalchemy/sql/compiler.py", line 402, in process
return type_._compiler_dispatch(self, **kw)
File "/home/me/git-github/datahub/venv/lib/python3.6/site-packages/sqlalchemy/sql/visitors.py", line 96, in _compiler_dispatch
return meth(self, **kw)
File "/home/me/git-github/datahub/venv/lib/python3.6/site-packages/sqlalchemy/sql/compiler.py", line 3481, in visit_null
"type on this Column?" % type_
sqlalchemy.exc.CompileError: Can't generate DDL for NullType(); did you forget to specify a type on this Column?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment