Skip to content

Instantly share code, notes, and snippets.

@gaurav
Created August 29, 2011 21:06
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save gaurav/1179412 to your computer and use it in GitHub Desktop.
Save gaurav/1179412 to your computer and use it in GitHub Desktop.
Error output while uploading LayerIndex
[INFO 2011-08-29 14:38:22,517 bulkloader.py] Logging to bulkloader-log-20110829.143822
[INFO 2011-08-29 14:38:22,518 bulkloader.py] Throttling transfers:
[INFO 2011-08-29 14:38:22,518 bulkloader.py] Bandwidth: 250000 bytes/second
[INFO 2011-08-29 14:38:22,518 bulkloader.py] HTTP connections: 8/second
[INFO 2011-08-29 14:38:22,518 bulkloader.py] Entities inserted/fetched/modified: 20/second
[INFO 2011-08-29 14:38:22,518 bulkloader.py] Batch Size: 10
[INFO 2011-08-29 14:38:23,649 bulkloader.py] Opening database: bulkloader-progress-20110829.143822.sql3
[DEBUG 2011-08-29 14:38:23,656 adaptive_thread_pool.py] [WorkerThread-0] WorkerThread: started
[DEBUG 2011-08-29 14:38:23,657 adaptive_thread_pool.py] [WorkerThread-1] WorkerThread: started
[DEBUG 2011-08-29 14:38:23,657 adaptive_thread_pool.py] [WorkerThread-2] WorkerThread: started
[DEBUG 2011-08-29 14:38:23,658 adaptive_thread_pool.py] [WorkerThread-3] WorkerThread: started
[DEBUG 2011-08-29 14:38:23,658 adaptive_thread_pool.py] [WorkerThread-4] WorkerThread: started
[DEBUG 2011-08-29 14:38:23,658 adaptive_thread_pool.py] [WorkerThread-5] WorkerThread: started
[DEBUG 2011-08-29 14:38:23,659 adaptive_thread_pool.py] [WorkerThread-6] WorkerThread: started
[DEBUG 2011-08-29 14:38:23,659 adaptive_thread_pool.py] [WorkerThread-7] WorkerThread: started
[DEBUG 2011-08-29 14:38:23,659 adaptive_thread_pool.py] [WorkerThread-8] WorkerThread: started
[DEBUG 2011-08-29 14:38:23,660 adaptive_thread_pool.py] [WorkerThread-9] WorkerThread: started
[DEBUG 2011-08-29 14:38:23,661 bulkloader.py] Configuring remote_api. url_path = /_ah/remote_api, servername = localhost:8080
[DEBUG 2011-08-29 14:38:23,661 bulkloader.py] Bulkloader using app_id: dev~mol-lab
[INFO 2011-08-29 14:38:23,661 bulkloader.py] Connecting to localhost:8080/_ah/remote_api
[DEBUG 2011-08-29 14:38:23,725 bulkloader.py] [Thread-11] ProgressTrackerThread: started
[DEBUG 2011-08-29 14:38:23,726 bulkloader.py] [Thread-12] DataSourceThread: started
[INFO 2011-08-29 14:38:23,726 bulkloader.py] Starting import; maximum 10 entities per post
[DEBUG 2011-08-29 14:38:23,728 bulkloader.py] [Thread-12] DataSourceThread: exiting
[DEBUG 2011-08-29 14:38:23,730 bulkloader.py] Waiting for worker threads to finish...
[DEBUG 2011-08-29 14:38:23,771 adaptive_thread_pool.py] [WorkerThread-0] Got work item [1-2]
[ERROR 2011-08-29 14:38:23,795 adaptive_thread_pool.py] [WorkerThread-0] WorkerThread:
Traceback (most recent call last):
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/adaptive_thread_pool.py", line 176, in WorkOnItems
status, instruction = item.PerformWork(self.__thread_pool)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 764, in PerformWork
transfer_time = self._TransferItem(thread_pool)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 933, in _TransferItem
self.content = self.request_manager.EncodeContent(self.rows)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 1392, in EncodeContent
entity = loader.create_entity(values, key_name=key, parent=parent)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/bulkload/bulkloader_config.py", line 445, in create_entity
entity = self.dict_to_entity(input_dict, self.bulkload_state)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/bulkload/bulkloader_config.py", line 145, in dict_to_entity
instance = self.__create_instance(input_dict, bulkload_state_copy)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/bulkload/bulkloader_config.py", line 223, in __create_instance
key = self.__dict_to_prop(self._create_key, input_dict, bulkload_state)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/bulkload/bulkloader_config.py", line 205, in __dict_to_prop
value = transform.import_transform(value, bulkload_state=bulkload_state)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/bulkload/bulkloader_parser.py", line 111, in __call__
return self.method(*args, **kwargs)
File "/Users/vaidyagi/Development/mol/workflow/mol-data/bulkload_helper.py", line 91, in wrapper
('LayerIndex', 'polygonid'))(value, bulkload_state)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/bulkload/transform.py", line 189, in create_deep_key_lambda
return datastore.Key.from_path(*path)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/datastore_types.py", line 490, in from_path
ValidateString(id_or_name, 'name')
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/datastore_types.py", line 159, in ValidateString
raise exception('%s must not be empty.' % name)
BadValueError: name must not be empty.
[DEBUG 2011-08-29 14:38:23,800 adaptive_thread_pool.py] [WorkerThread-0] WorkerThread: exiting
[INFO 2011-08-29 14:38:23,800 adaptive_thread_pool.py] [WorkerThread-1] Backing off due to errors: 1.0 seconds
[INFO 2011-08-29 14:38:24,231 bulkloader.py] An error occurred. Shutting down...
[DEBUG 2011-08-29 14:38:24,233 adaptive_thread_pool.py] [WorkerThread-3] WorkerThread: exiting
[DEBUG 2011-08-29 14:38:24,233 adaptive_thread_pool.py] [WorkerThread-2] WorkerThread: exiting
[DEBUG 2011-08-29 14:38:24,234 adaptive_thread_pool.py] [WorkerThread-5] WorkerThread: exiting
[DEBUG 2011-08-29 14:38:24,234 adaptive_thread_pool.py] [WorkerThread-6] WorkerThread: exiting
[DEBUG 2011-08-29 14:38:24,234 adaptive_thread_pool.py] [WorkerThread-4] WorkerThread: exiting
[DEBUG 2011-08-29 14:38:24,234 adaptive_thread_pool.py] [WorkerThread-7] WorkerThread: exiting
[DEBUG 2011-08-29 14:38:24,235 adaptive_thread_pool.py] [WorkerThread-8] WorkerThread: exiting
[DEBUG 2011-08-29 14:38:24,235 adaptive_thread_pool.py] [WorkerThread-9] WorkerThread: exiting
[DEBUG 2011-08-29 14:38:24,237 adaptive_thread_pool.py] Waiting for Anonymous_WorkerThread to exit
[DEBUG 2011-08-29 14:38:24,237 adaptive_thread_pool.py] Waiting for Anonymous_WorkerThread to exit
[DEBUG 2011-08-29 14:38:24,301 adaptive_thread_pool.py] [WorkerThread-1] WorkerThread: exiting
[DEBUG 2011-08-29 14:38:24,301 adaptive_thread_pool.py] Waiting for Anonymous_WorkerThread to exit
[DEBUG 2011-08-29 14:38:24,301 adaptive_thread_pool.py] Waiting for Anonymous_WorkerThread to exit
[DEBUG 2011-08-29 14:38:24,301 adaptive_thread_pool.py] Waiting for Anonymous_WorkerThread to exit
[DEBUG 2011-08-29 14:38:24,302 adaptive_thread_pool.py] Waiting for Anonymous_WorkerThread to exit
[DEBUG 2011-08-29 14:38:24,302 adaptive_thread_pool.py] Waiting for Anonymous_WorkerThread to exit
[DEBUG 2011-08-29 14:38:24,302 adaptive_thread_pool.py] Waiting for Anonymous_WorkerThread to exit
[DEBUG 2011-08-29 14:38:24,302 adaptive_thread_pool.py] Waiting for Anonymous_WorkerThread to exit
[DEBUG 2011-08-29 14:38:24,302 adaptive_thread_pool.py] Waiting for Anonymous_WorkerThread to exit
[ERROR 2011-08-29 14:38:24,302 adaptive_thread_pool.py] Error in WorkerThread-0: name must not be empty.
[DEBUG 2011-08-29 14:38:24,303 adaptive_thread_pool.py] Traceback (most recent call last):
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/adaptive_thread_pool.py", line 176, in WorkOnItems
status, instruction = item.PerformWork(self.__thread_pool)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 764, in PerformWork
transfer_time = self._TransferItem(thread_pool)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 933, in _TransferItem
self.content = self.request_manager.EncodeContent(self.rows)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/tools/bulkloader.py", line 1392, in EncodeContent
entity = loader.create_entity(values, key_name=key, parent=parent)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/bulkload/bulkloader_config.py", line 445, in create_entity
entity = self.dict_to_entity(input_dict, self.bulkload_state)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/bulkload/bulkloader_config.py", line 145, in dict_to_entity
instance = self.__create_instance(input_dict, bulkload_state_copy)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/bulkload/bulkloader_config.py", line 223, in __create_instance
key = self.__dict_to_prop(self._create_key, input_dict, bulkload_state)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/bulkload/bulkloader_config.py", line 205, in __dict_to_prop
value = transform.import_transform(value, bulkload_state=bulkload_state)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/bulkload/bulkloader_parser.py", line 111, in __call__
return self.method(*args, **kwargs)
File "/Users/vaidyagi/Development/mol/workflow/mol-data/bulkload_helper.py", line 91, in wrapper
('LayerIndex', 'polygonid'))(value, bulkload_state)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/ext/bulkload/transform.py", line 189, in create_deep_key_lambda
return datastore.Key.from_path(*path)
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/datastore_types.py", line 490, in from_path
ValidateString(id_or_name, 'name')
File "/Applications/GoogleAppEngineLauncher.app/Contents/Resources/GoogleAppEngine-default.bundle/Contents/Resources/google_appengine/google/appengine/api/datastore_types.py", line 159, in ValidateString
raise exception('%s must not be empty.' % name)
BadValueError: name must not be empty.
[DEBUG 2011-08-29 14:38:24,303 bulkloader.py] Waiting for progress_thread to terminate...
[DEBUG 2011-08-29 14:38:24,312 bulkloader.py] [Thread-11] ProgressTrackerThread: exiting
[DEBUG 2011-08-29 14:38:24,319 bulkloader.py] ... done.
[INFO 2011-08-29 14:38:24,319 bulkloader.py] 2 entities total, 0 previously transferred
[INFO 2011-08-29 14:38:24,319 bulkloader.py] 0 entities (456 bytes) transferred in 1.8 seconds
[INFO 2011-08-29 14:38:24,319 bulkloader.py] Some entities not successfully transferred
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment