Skip to content

Instantly share code, notes, and snippets.

@HyukjinKwon
Created July 4, 2017 00:53
Show Gist options
  • Save HyukjinKwon/57b1916395794ce924faa32b14a3fe19 to your computer and use it in GitHub Desktop.
Save HyukjinKwon/57b1916395794ce924faa32b14a3fe19 to your computer and use it in GitHub Desktop.
[PYSPARK] SPARK-19507 error mssage
struct<a:int>
IntegerType can not accept object 'a' in type <type 'str'>
int
IntegerType can not accept object 'a' in type <type 'str'>
struct<a:array<int>>
StructType can not accept object 'a' in type <type 'str'>
struct<a:array<int>>
ArrayType(IntegerType,true) can not accept object 'a' in type <type 'str'>
struct<a:array<int>>
IntegerType can not accept object 'a' in type <type 'str'>
struct<a:array<struct<a:int>>>
StructType can not accept object 'b' in type <type 'str'>
struct<a:map<int,int>>
MapType(IntegerType,IntegerType,true) can not accept object '1' in type <type 'str'>
struct<a:map<int,int>>
IntegerType can not accept object '1' in type <type 'str'>
struct<a:map<int,int>>
IntegerType can not accept object 'aa' in type <type 'str'>
struct<a:map<int,struct<a:int>>>
IntegerType can not accept object '1' in type <type 'str'>
struct<a:struct<b:int>>
IntegerType can not accept object '1' in type <type 'str'>
struct<a:struct<b:struct<c:int>>>
IntegerType can not accept object '1' in type <type 'str'>
struct<a:struct<b:struct<c:struct<b:int>>>>
IntegerType can not accept object '1' in type <type 'str'>
struct<a:array<array<int>>>
IntegerType can not accept object 'a' in type <type 'str'>
struct<a:map<string,map<int,int>>>
IntegerType can not accept object 'a' in type <type 'str'>
struct<a:map<string,map<int,int>>>
IntegerType can not accept object 'b' in type <type 'str'>
struct<a:struct<b:map<string,map<int,int>>>>
IntegerType can not accept object 'b' in type <type 'str'>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment