Skip to content

Instantly share code, notes, and snippets.

@HyukjinKwon
Last active July 4, 2017 00:58
Show Gist options
  • Save HyukjinKwon/7a494e4557fe32a652ce1236e504a395 to your computer and use it in GitHub Desktop.
Save HyukjinKwon/7a494e4557fe32a652ce1236e504a395 to your computer and use it in GitHub Desktop.
[PYSPARK] SPARK-19507 error message (after)
struct<a:int>
field a: IntegerType can not accept object 'a' in type <type 'str'>
int
field value: IntegerType can not accept object 'a' in type <type 'str'>
struct<a:array<int>>
StructType can not accept object 'a' in type <type 'str'>
struct<a:array<int>>
field a: ArrayType(IntegerType,true) can not accept object 'a' in type <type 'str'>
struct<a:array<int>>
element in array field a: IntegerType can not accept object 'a' in type <type 'str'>
struct<a:array<struct<a:int>>>
element in array field a: StructType can not accept object 'b' in type <type 'str'>
struct<a:map<int,int>>
field a: MapType(IntegerType,IntegerType,true) can not accept object '1' in type <type 'str'>
struct<a:map<int,int>>
key of map field a: IntegerType can not accept object '1' in type <type 'str'>
struct<a:map<int,int>>
value of map field a: IntegerType can not accept object 'aa' in type <type 'str'>
struct<a:map<int,struct<a:int>>>
field a in value of map field a: IntegerType can not accept object '1' in type <type 'str'>
struct<a:struct<b:int>>
field b in field a: IntegerType can not accept object '1' in type <type 'str'>
struct<a:struct<b:struct<c:int>>>
field c in field b in field a: IntegerType can not accept object '1' in type <type 'str'>
struct<a:struct<b:struct<c:struct<b:int>>>>
field b in field c in field b in field a: IntegerType can not accept object '1' in type <type 'str'>
struct<a:array<array<int>>>
element in array element in array field a: IntegerType can not accept object 'a' in type <type 'str'>
struct<a:map<string,map<int,int>>>
key of map value of map field a: IntegerType can not accept object 'a' in type <type 'str'>
struct<a:map<string,map<int,int>>>
value of map value of map field a: IntegerType can not accept object 'b' in type <type 'str'>
struct<a:struct<b:map<string,map<int,int>>>>
value of map value of map field b in field a: IntegerType can not accept object 'b' in type <type 'str'>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment