gistfile1.txt

[2020-11-02 04:08:12,097] DEBUG in daily_activity: Calculating listening_activity_month
[2020-11-02 04:08:12,611] DEBUG in daily_activity: Done!
[2020-11-02 04:08:12,612] DEBUG in request_consumer: Pushing result to RabbitMQ...
[2020-11-02 04:08:15,607] CRITICAL in request_consumer: Error in spark-request-consumer: integer division or modulo by zero
Traceback (most recent call last):
  File "/rec/listenbrainz_spark/request_consumer/request_consumer.py", line 148, in run
    self.request_channel.start_consuming()
  File "/usr/local/lib/python3.6/site-packages/pika/adapters/blocking_connection.py", line 1822, in start_consuming
    self.connection.process_data_events(time_limit=None)
  File "/usr/local/lib/python3.6/site-packages/pika/adapters/blocking_connection.py", line 758, in process_data_events
    self._dispatch_channel_events()
  File "/usr/local/lib/python3.6/site-packages/pika/adapters/blocking_connection.py", line 521, in _dispatch_channel_events
    impl_channel._get_cookie()._dispatch_events()
  File "/usr/local/lib/python3.6/site-packages/pika/adapters/blocking_connection.py", line 1445, in _dispatch_events
    evt.body)
  File "/rec/listenbrainz_spark/request_consumer/request_consumer.py", line 103, in callback
    self.push_to_result_queue(messages)
  File "/rec/listenbrainz_spark/request_consumer/request_consumer.py", line 92, in push_to_result_queue
    avg_size_of_message //= num_of_messages
ZeroDivisionError: integer division or modulo by zero
[2020-11-02 04:08:17,840] INFO in request_consumer: Request consumer started!
[2020-11-02 05:00:03,754] INFO in request_consumer: Received a request!
[2020-11-02 05:00:07,328] INFO in train_models: Splitting dataframe...
[2020-11-02 05:00:18,325] INFO in train_models: Training model with model id: listenbrainz-recommendation-model-2305774e-3ff7-4569-80a3-30208d56da50
[2020-11-02 05:00:26,143] INFO in train_models: Model trained!
[2020-11-02 05:00:26,143] INFO in train_models: Calculating validation RMSE for model with model id : listenbrainz-recommendation-model-2305774e-3ff7-4569-80a3-30208d56da50
[2020-11-02 05:00:42,452] INFO in train_models: Validation RMSE calculated!
[2020-11-02 05:00:42,453] INFO in train_models: Training model with model id: listenbrainz-recommendation-model-bd8a8f36-fa78-48cb-8eed-d22945bf1395
[2020-11-02 05:00:52,946] INFO in train_models: Model trained!
[2020-11-02 05:00:52,946] INFO in train_models: Calculating validation RMSE for model with model id : listenbrainz-recommendation-model-bd8a8f36-fa78-48cb-8eed-d22945bf1395
[2020-11-02 05:01:09,231] INFO in train_models: Validation RMSE calculated!
[2020-11-02 05:01:09,232] INFO in train_models: Training model with model id: listenbrainz-recommendation-model-a94c794e-ca4c-4796-aa40-d2db8c96675c
[2020-11-02 05:01:16,369] INFO in train_models: Model trained!
[2020-11-02 05:01:16,369] INFO in train_models: Calculating validation RMSE for model with model id : listenbrainz-recommendation-model-a94c794e-ca4c-4796-aa40-d2db8c96675c
[2020-11-02 05:01:32,450] INFO in train_models: Validation RMSE calculated!
[2020-11-02 05:01:32,451] INFO in train_models: Training model with model id: listenbrainz-recommendation-model-1c242967-6087-4433-8dc1-44b62f9732c8
[2020-11-02 05:01:42,173] INFO in train_models: Model trained!
[2020-11-02 05:01:42,174] INFO in train_models: Calculating validation RMSE for model with model id : listenbrainz-recommendation-model-1c242967-6087-4433-8dc1-44b62f9732c8
[2020-11-02 05:01:57,999] INFO in train_models: Validation RMSE calculated!
[2020-11-02 05:01:58,000] INFO in train_models: Training model with model id: listenbrainz-recommendation-model-c042f3dd-e1f6-4e74-b3da-2c028aeceabf
[2020-11-02 05:02:05,785] INFO in train_models: Model trained!
[2020-11-02 05:02:05,785] INFO in train_models: Calculating validation RMSE for model with model id : listenbrainz-recommendation-model-c042f3dd-e1f6-4e74-b3da-2c028aeceabf
[2020-11-02 05:02:21,095] INFO in train_models: Validation RMSE calculated!
[2020-11-02 05:02:21,096] INFO in train_models: Training model with model id: listenbrainz-recommendation-model-ba642aac-44b9-42bd-b531-f7ee8fa3fe5a
[2020-11-02 05:02:32,319] INFO in train_models: Model trained!
[2020-11-02 05:02:32,319] INFO in train_models: Calculating validation RMSE for model with model id : listenbrainz-recommendation-model-ba642aac-44b9-42bd-b531-f7ee8fa3fe5a
[2020-11-02 05:02:48,218] INFO in train_models: Validation RMSE calculated!
[2020-11-02 05:02:48,219] INFO in train_models: Training model with model id: listenbrainz-recommendation-model-4d10b1f9-1cd1-45e2-8d4a-8e16f986076d
[2020-11-02 05:02:55,971] INFO in train_models: Model trained!
[2020-11-02 05:02:55,971] INFO in train_models: Calculating validation RMSE for model with model id : listenbrainz-recommendation-model-4d10b1f9-1cd1-45e2-8d4a-8e16f986076d
[2020-11-02 05:03:12,046] INFO in train_models: Validation RMSE calculated!
[2020-11-02 05:03:12,046] INFO in train_models: Training model with model id: listenbrainz-recommendation-model-80552d17-ee61-42a2-a10f-a19085e5b5f5
[2020-11-02 05:03:23,348] INFO in train_models: Model trained!
[2020-11-02 05:03:23,348] INFO in train_models: Calculating validation RMSE for model with model id : listenbrainz-recommendation-model-80552d17-ee61-42a2-a10f-a19085e5b5f5
[2020-11-02 05:03:39,055] INFO in train_models: Validation RMSE calculated!
[2020-11-02 05:03:39,056] INFO in train_models: Calculating test RMSE for best model with model id: listenbrainz-recommendation-model-ba642aac-44b9-42bd-b531-f7ee8fa3fe5a
[2020-11-02 05:03:55,136] INFO in train_models: Test RMSE calculated!
[2020-11-02 05:03:55,676] INFO in train_models: Saving model...
[2020-11-02 05:03:57,444] INFO in train_models: Model saved!
[2020-11-02 05:03:57,460] INFO in train_models: Saving model metadata...
[2020-11-02 05:03:57,705] INFO in train_models: Model metadata saved...
[2020-11-02 05:03:57,719] INFO in train_models: Saving HTML...
[2020-11-02 05:03:57,727] INFO in train_models: Done!
[2020-11-02 05:03:57,727] DEBUG in request_consumer: Pushing result to RabbitMQ...
[2020-11-02 05:03:57,728] INFO in request_consumer: Done!
[2020-11-02 05:03:57,728] INFO in request_consumer: Number of messages sent: 1
[2020-11-02 05:03:57,729] INFO in request_consumer: Average size of message: 105 bytes
[2020-11-02 05:03:57,729] INFO in request_consumer: Request done!
[2020-11-02 05:03:57,729] INFO in request_consumer: Received a request!
[2020-11-02 05:04:03,098] INFO in recommend: Loading model...
[2020-11-02 05:04:06,204] INFO in recommend: Took 0.69sec to get active user count
[2020-11-02 05:04:06,204] INFO in recommend: Generating recommendations...
[2020-11-02 05:05:04,482] INFO in recommend: Recommendations generated!
[2020-11-02 05:05:04,483] INFO in recommend: Took 58.28sec to generate recommendations for all active users
[2020-11-02 05:05:25,502] INFO in recommend: Took 21.02sec to get top artist and similar artist user count
[2020-11-02 05:06:05,030] INFO in recommend: Some ratings are greater than 1 
Max rating: 2.210067110150449
[2020-11-02 05:06:05,071] INFO in recommend: Took 39.57sec to scale the ratings
[2020-11-02 05:06:05,132] INFO in recommend: Took 0.06sec to get mbids corresponding to recording ids
[2020-11-02 05:06:05,132] INFO in recommend: Total time: 119.62sec
[2020-11-02 05:06:05,133] DEBUG in request_consumer: Pushing result to RabbitMQ...
[2020-11-02 05:07:25,086] INFO in request_consumer: Done!
[2020-11-02 05:07:25,086] INFO in request_consumer: Number of messages sent: 1987
[2020-11-02 05:07:25,086] INFO in request_consumer: Average size of message: 120198 bytes
[2020-11-02 05:07:25,086] INFO in request_consumer: Request done!