Skip to content

Instantly share code, notes, and snippets.

@jcreed

jcreed/wa-sidekiq-star pod

Created April 18, 2024 15:48
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save jcreed/f4c2c43b78de99772d18291814fe94ad to your computer and use it in GitHub Desktop.
Save jcreed/f4c2c43b78de99772d18291814fe94ad to your computer and use it in GitHub Desktop.
Download ZIP
scheduled jobs
Raw
wa-sidekiq-star pod
bash: cannot set terminal process group (-1): Inappropriate ioctl for device
bash: no job control in this shell
Welcome to namespace 'abhi-tech-approach'
rake aborted!
Psych::SyntaxError: (<unknown>): did not find expected key while parsing a block mapping at line 1 column 1
/opt/app/config/application.rb:117:in `<class:Application>'
/opt/app/config/application.rb:31:in `<module:Webadmit>'
/opt/app/config/application.rb:30:in `<top (required)>'
/opt/app/Rakefile:6:in `require'
/opt/app/Rakefile:6:in `<top (required)>'
/home/app/bundle/ruby/3.3.0/gems/rake-13.0.6/exe/rake:27:in `<top (required)>'
/home/app/bundle/bin/bundle:113:in `load'
/home/app/bundle/bin/bundle:113:in `<main>'
(See full trace by running task with --trace)
real 0m7.280s
user 0m5.145s
sys 0m2.065s
DEPRECATION WARNING: Calling silenced= on ActiveSupport::Deprecation is deprecated and will be removed from Rails (use Rails.application.deprecators.silenced= instead) (called from <class:Application> at /opt/app/config/application.rb:129)
Running Rails 7.1.2
Running Ruby 3.3.0
NOTICE: Your OS collation is set differently from production. This doesn't affect most features, but WebAdMIT does expect case-insensitive ordering. Find more information and work-around instructions here: https://liaison-intl.atlassian.net/wiki/display/S1/Collation
Running PostgreSQL 13.2 (Debian 13.2-1.pgdg100+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 8.3.0-6) 8.3.0, 64-bit
statement_timeout: 1h
/opt/app/config/initializers/sidekiq.rb:5: warning: already initialized constant Sidekiq::BasicFetch::TIMEOUT
/home/app/bundle/ruby/3.3.0/gems/sidekiq-7.2.0/lib/sidekiq/fetch.rb:12: warning: previous definition of TIMEOUT was here
/home/app/bundle/ruby/3.3.0/bundler/gems/after_party-6ea2d03ac6b2/lib/after_party/models/task_recorder.rb:7: warning: already initialized constant AfterParty::TaskRecorder::FILE_MASK
/home/app/bundle/ruby/3.3.0/bundler/gems/after_party-6ea2d03ac6b2/lib/after_party/models/task_recorder.rb:7: warning: previous definition of FILE_MASK was here
2024-04-18T14:12:12.632Z pid=1 tid=5al INFO: Booted Rails 7.1.2 application in qa environment
2024-04-18T14:12:12.632Z pid=1 tid=5al INFO: Running in ruby 3.3.0 (2023-12-25 revision 5124f9ac75) [x86_64-linux]
2024-04-18T14:12:12.632Z pid=1 tid=5al INFO: See LICENSE and the LGPL-3.0 for licensing details.
2024-04-18T14:12:12.632Z pid=1 tid=5al INFO: Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org
2024-04-18T14:12:12.632Z pid=1 tid=5al INFO: Sidekiq 7.2.0 connecting to Redis with options {:size=>10, :pool_name=>"internal", :url=>"redis://redis-svc:6379/3"}
2024-04-18T14:12:12.638Z pid=1 tid=5al INFO: Sidekiq 7.2.0 connecting to Redis with options {:size=>10, :pool_name=>"default", :url=>"redis://redis-svc:6379/3"}
2024-04-18T14:12:12.641Z pid=1 tid=5al INFO: Loading Schedule
2024-04-18T14:12:12.641Z pid=1 tid=5al INFO: Scheduling schedule_search_job {"cron"=>"*/15 * * * *", "class"=>"ScheduleSearchJob", "queue"=>"scheduler", "description"=>"This job search for schedules that should be performed", "enabled"=>true}
2024-04-18T14:12:12.645Z pid=1 tid=5al INFO: Schedules Loaded
2024-04-18T14:12:12.649Z pid=1 tid=5al uniquejobs=reaper INFO: Starting Reaper
2024-04-18T14:12:12.659Z pid=1 tid=5fh9 uniquejobs=reaper INFO: Nothing to delete; exiting.
2024-04-18T14:12:12.662Z pid=1 tid=5fh9 uniquejobs=reaper INFO: Nothing to delete; exiting.
2024-04-18T14:14:07.935Z pid=1 tid=5fht class=Cas3BatchLookupLoaderJob jid=836d91b84b55080d2e4f114f INFO: start
2024-04-18T14:14:13.065Z pid=1 tid=5fht class=Cas3BatchLookupLoaderJob jid=836d91b84b55080d2e4f114f INFO: Adding dead Cas3BatchLookupLoaderJob job 836d91b84b55080d2e4f114f
2024-04-18T14:14:13.072Z pid=1 tid=5fht class=Cas3BatchLookupLoaderJob jid=836d91b84b55080d2e4f114f INFO: delete_by_digest(uniquejobs:e5ea7d45acbeec17d0aa33657ba91c5c) completed in 2ms
2024-04-18T14:14:13.072Z pid=1 tid=5fht class=Cas3BatchLookupLoaderJob jid=836d91b84b55080d2e4f114f elapsed=5.137 INFO: fail
2024-04-18T14:14:13.072Z pid=1 tid=5fht WARN: {"context":"Job raised exception","job":{"retry":0,"queue":"default","lock":"until_executed","args":[{"types":["Major","Lookups::ApTestType"]}],"class":"Cas3BatchLookupLoaderJob","jid":"836d91b84b55080d2e4f114f","created_at":1713449647.9226465,"lock_timeout":0,"lock_ttl":null,"lock_prefix":"uniquejobs","lock_args":[{"association_ids":[643,647,648,649,650,651,652,653,654,655,656,657,658,659,660,661,662,663,664,665,666,667,668,669,670,671,672,673,674,675,676,677,678,679,680,681,682,683,684,685,686,687,688,689,690,691,692,693,694,695,696,697,698,699,700,701,702,703,704,705,706,707,708,709,710,711,712,713,714,715,716,717,718,719,720,721,722,723,724,725,726,727,728,729,730,731,732,733,734,735,736,737,738,739,740,741,742,743,744,745,746,747,748,749,750,751,752,753,754,755,756,757,758,759,760,761,762,763,764,765,766,767,768,769,770,771,772,773,774,775,776,777,778,779,780,781,782,783,784,785,786,787,788,789,790,791,792,793,794,795,796,797,798,799,800,801,802,803,804,805,806,807,808,809,810,811,812,813,814,815,816,817,818,819,820,821,822,823,824,825,826,827,828,829,830,831,832,833,834,835,836,837,838,839,840,841,842,843,844,845,846,847,848,849,850,851,852,853,854,855,856,857,858,859,860,861,862,863,864,865],"user_identity_id":268630,"types":["Major","Lookups::ApTestType"]}],"lock_digest":"uniquejobs:e5ea7d45acbeec17d0aa33657ba91c5c","enqueued_at":1713449647.935043,"error_message":"Failed to open TCP connection to cas-unicas-ws-svc:8080 (Connection refused - connect(2) for \"cas-unicas-ws-svc\" port 8080)","error_class":"Errno::ECONNREFUSED","processor":"wa-sidekiq-star-58d78c5cc6-fm6dn:1","failed_at":1713449653.0635204}}
2024-04-18T14:14:13.072Z pid=1 tid=5fht WARN: Errno::ECONNREFUSED: Failed to open TCP connection to cas-unicas-ws-svc:8080 (Connection refused - connect(2) for "cas-unicas-ws-svc" port 8080)
2024-04-18T14:14:13.073Z pid=1 tid=5fht WARN: lib/unicas/api/v1/client.rb:7:in `get'
lib/unicas/api/v1/lookups.rb:10:in `get_all_lookup_values_by_reference_data_set_id'
lib/cas3/reference_data_loader.rb:16:in `block in load!'
lib/cas3/reference_data_loader.rb:15:in `load!'
lib/cas3/reference_data_loader.rb:9:in `load!'
app/workers/cas3_batch_lookup_loader_job.rb:15:in `perform'
config/initializers/sidekiq.rb:14:in `call'
2024-04-18T14:15:00.223Z pid=1 tid=5fv5 INFO: queueing ScheduleSearchJob (schedule_search_job)
2024-04-18T14:15:00.228Z pid=1 tid=5fvp class=ScheduleSearchJob jid=5f940d66f8c5b40df99da950 INFO: start
2024-04-18T14:15:00.436Z pid=1 tid=5g05 class=ExportJob jid=058cae47a292f85e7993831e INFO: start
2024-04-18T14:15:00.585Z pid=1 tid=5ga5 class=ExportJob jid=8f3611f7398d749da1354cb7 INFO: start
2024-04-18T14:15:00.629Z pid=1 tid=5gcx class=ExportJob jid=4c4978eb0a2a6b333c908a46 INFO: start
2024-04-18T14:15:00.799Z pid=1 tid=5gmd class=ExportJob jid=9efacf7b636eb5609b95c0f1 INFO: start
2024-04-18T14:15:00.951Z pid=1 tid=5gtl class=ExportJob jid=d7c71e0474edc5e053ce6e2e INFO: start
2024-04-18T14:15:00.996Z pid=1 tid=5fvp class=ScheduleSearchJob jid=5f940d66f8c5b40df99da950 elapsed=0.767 INFO: done
2024-04-18T14:15:02.408Z pid=1 tid=5ga5 class=ExportJob jid=8f3611f7398d749da1354cb7 uniquejobs=server until_executed=uniquejobs:dac9f891c4a8b3a90e9d79881223318d INFO:  S3 Storage (510.3ms) Uploaded file to key: a83d1d01/export/251814/Outcomes-Application-Data-Export_72aedc0bc122.csv (checksum: dRY63XG2N6qiF3LFs779ng==)
2024-04-18T14:15:02.413Z pid=1 tid=63vl class=ActiveStorage::PurgeJob jid=65414b16244f08ba01d5b79b INFO: start
2024-04-18T14:15:02.413Z pid=1 tid=5ga5 class=ExportJob jid=8f3611f7398d749da1354cb7 uniquejobs=server until_executed=uniquejobs:dac9f891c4a8b3a90e9d79881223318d INFO: Enqueued ActiveStorage::PurgeJob (Job ID: 0fd8989e-c34f-4de9-b26a-5b1d7736891d) to Sidekiq(low) with arguments: #<GlobalID:0x00007fdc21b42300 @uri=#<URI::GID gid://webadmit/ActiveStorage::Blob/43917>>
2024-04-18T14:15:02.416Z pid=1 tid=5gmd class=ExportJob jid=9efacf7b636eb5609b95c0f1 uniquejobs=server until_executed=uniquejobs:e800ccdd6317e30c20ccd0a3e3c10eb7 INFO:  S3 Storage (574.7ms) Uploaded file to key: fc43a5b4/report/252018/Graduate-Applicants-for-Audiology-and-Speech-2024-Cycle_8e3bc1a55cde.csv (checksum: oukf7c6YOFfMhqMCzSVsRg==)
2024-04-18T14:15:02.421Z pid=1 tid=63w5 class=ActiveStorage::PurgeJob jid=547782dc06fafcd9c9df0fa0 INFO: start
2024-04-18T14:15:02.421Z pid=1 tid=5gmd class=ExportJob jid=9efacf7b636eb5609b95c0f1 uniquejobs=server until_executed=uniquejobs:e800ccdd6317e30c20ccd0a3e3c10eb7 INFO: Enqueued ActiveStorage::PurgeJob (Job ID: b507144e-0e79-47db-a4da-c53a46fc15df) to Sidekiq(low) with arguments: #<GlobalID:0x00007fdc21c938d0 @uri=#<URI::GID gid://webadmit/ActiveStorage::Blob/43414>>
2024-04-18T14:15:02.427Z pid=1 tid=63vl class=ActiveStorage::PurgeJob jid=65414b16244f08ba01d5b79b INFO: Performing ActiveStorage::PurgeJob (Job ID: 0fd8989e-c34f-4de9-b26a-5b1d7736891d) from Sidekiq(low) enqueued at 2024-04-18T14:15:02.412278101Z with arguments: #<GlobalID:0x00007fdc21ced498 @uri=#<URI::GID gid://webadmit/ActiveStorage::Blob/43917>>
2024-04-18T14:15:02.456Z pid=1 tid=5gcx class=ExportJob jid=4c4978eb0a2a6b333c908a46 uniquejobs=server until_executed=uniquejobs:86dbf44401561661c600254f5dda6e02 INFO:  S3 Storage (524.1ms) Uploaded file to key: 5cefa19f/export/251822/LocalStatusNursingCAS_9eedbfbe3314.csv (checksum: PqDT5Inhg+WBQZa1We6abA==)
2024-04-18T14:15:02.459Z pid=1 tid=65nh class=ActiveStorage::PurgeJob jid=6366289db20aad7e03d80bea INFO: start
2024-04-18T14:15:02.459Z pid=1 tid=5gcx class=ExportJob jid=4c4978eb0a2a6b333c908a46 uniquejobs=server until_executed=uniquejobs:86dbf44401561661c600254f5dda6e02 INFO: Enqueued ActiveStorage::PurgeJob (Job ID: 5b918f1e-635f-423d-91b2-a347e9394cbf) to Sidekiq(low) with arguments: #<GlobalID:0x00007fdc21f3dfe0 @uri=#<URI::GID gid://webadmit/ActiveStorage::Blob/43931>>
2024-04-18T14:15:02.467Z pid=1 tid=63w5 class=ActiveStorage::PurgeJob jid=547782dc06fafcd9c9df0fa0 INFO: Performing ActiveStorage::PurgeJob (Job ID: b507144e-0e79-47db-a4da-c53a46fc15df) from Sidekiq(low) enqueued at 2024-04-18T14:15:02.420563718Z with arguments: #<GlobalID:0x00007fdc21f58a70 @uri=#<URI::GID gid://webadmit/ActiveStorage::Blob/43414>>
2024-04-18T14:15:02.503Z pid=1 tid=65nh class=ActiveStorage::PurgeJob jid=6366289db20aad7e03d80bea INFO: Performing ActiveStorage::PurgeJob (Job ID: 5b918f1e-635f-423d-91b2-a347e9394cbf) from Sidekiq(low) enqueued at 2024-04-18T14:15:02.458786779Z with arguments: #<GlobalID:0x00007fdc21fb75e8 @uri=#<URI::GID gid://webadmit/ActiveStorage::Blob/43931>>
2024-04-18T14:15:02.565Z pid=1 tid=5g05 class=ExportJob jid=058cae47a292f85e7993831e uniquejobs=server until_executed=uniquejobs:772ac00b28d707340189ca0a825559da INFO:  S3 Storage (183.5ms) Uploaded file to key: 46246d3d/export/251738/outcomesTestImport_695a433e8827.csv (checksum: GnOH91eeJbwLXVurqFxxzg==)
2024-04-18T14:15:02.569Z pid=1 tid=68zh class=ActiveStorage::PurgeJob jid=bb7abd7da673bc857d9a2b0c INFO: start
2024-04-18T14:15:02.572Z pid=1 tid=63vl class=ActiveStorage::PurgeJob jid=65414b16244f08ba01d5b79b INFO:  S3 Storage (117.9ms) Deleted file from key: a83d1d01/export/251814/Outcomes-Application-Data-Export_1702627206.csv
2024-04-18T14:15:02.569Z pid=1 tid=5g05 class=ExportJob jid=058cae47a292f85e7993831e uniquejobs=server until_executed=uniquejobs:772ac00b28d707340189ca0a825559da INFO: Enqueued ActiveStorage::PurgeJob (Job ID: 93fd4ea9-0b9d-4f69-b1f5-ba7038601482) to Sidekiq(low) with arguments: #<GlobalID:0x00007fdc22f6bfc0 @uri=#<URI::GID gid://webadmit/ActiveStorage::Blob/43901>>
2024-04-18T14:15:02.574Z pid=1 tid=63vl class=ActiveStorage::PurgeJob jid=65414b16244f08ba01d5b79b INFO: Performed ActiveStorage::PurgeJob (Job ID: 0fd8989e-c34f-4de9-b26a-5b1d7736891d) from Sidekiq(low) in 160.29ms
2024-04-18T14:15:02.576Z pid=1 tid=63vl class=ActiveStorage::PurgeJob jid=65414b16244f08ba01d5b79b elapsed=0.163 INFO: done
2024-04-18T14:15:02.689Z pid=1 tid=65nh class=ActiveStorage::PurgeJob jid=6366289db20aad7e03d80bea INFO:  S3 Storage (171.4ms) Deleted file from key: 5cefa19f/export/251822/LocalStatusNursingCAS_1702638002.csv
2024-04-18T14:15:02.690Z pid=1 tid=65nh class=ActiveStorage::PurgeJob jid=6366289db20aad7e03d80bea INFO: Performed ActiveStorage::PurgeJob (Job ID: 5b918f1e-635f-423d-91b2-a347e9394cbf) from Sidekiq(low) in 229.07ms
2024-04-18T14:15:02.691Z pid=1 tid=65nh class=ActiveStorage::PurgeJob jid=6366289db20aad7e03d80bea elapsed=0.232 INFO: done
2024-04-18T14:15:02.703Z pid=1 tid=68zh class=ActiveStorage::PurgeJob jid=bb7abd7da673bc857d9a2b0c INFO: Performing ActiveStorage::PurgeJob (Job ID: 93fd4ea9-0b9d-4f69-b1f5-ba7038601482) from Sidekiq(low) enqueued at 2024-04-18T14:15:02.568575640Z with arguments: #<GlobalID:0x00007fdc23427b40 @uri=#<URI::GID gid://webadmit/ActiveStorage::Blob/43901>>
2024-04-18T14:15:02.723Z pid=1 tid=5gcx class=ExportJob jid=4c4978eb0a2a6b333c908a46 elapsed=2.094 INFO: fail
2024-04-18T14:15:02.724Z pid=1 tid=5gcx WARN: {"context":"Job raised exception","job":{"retry":1,"queue":"export_processing","lock":"until_executed","args":[{"export_file_id":251822,"callback":null,"user_identity_id":381689,"list_params":{},"schedule_id":68,"on_schedule":true,"enqueued_time":"2024-04-18 10:15:00 -0400","aasm_state":"queued","scope":"organization"}],"class":"ExportJob","jid":"4c4978eb0a2a6b333c908a46","created_at":1713449700.6247077,"lock_timeout":0,"lock_ttl":null,"lock_prefix":"uniquejobs","lock_args":[{"export_file_id":251822,"callback":null,"user_identity_id":381689,"list_params":{},"schedule_id":68,"on_schedule":true,"enqueued_time":"2024-04-18 10:15:00 -0400","aasm_state":"queued","scope":"organization"}],"lock_digest":"uniquejobs:86dbf44401561661c600254f5dda6e02","enqueued_at":1713449700.6278138,"error_message":"ActiveRecord::Encryption::Errors::Decryption","error_class":"ActiveRecord::Encryption::Errors::Decryption","processor":"wa-sidekiq-star-58d78c5cc6-fm6dn:1","failed_at":1713449702.7195864}}
2024-04-18T14:15:02.724Z pid=1 tid=5gcx WARN: ActiveRecord::Encryption::Errors::Decryption: ActiveRecord::Encryption::Errors::Decryption
2024-04-18T14:15:02.724Z pid=1 tid=5gcx WARN: app/models/destination.rb:74:in `initialize_connection'
app/models/schedule.rb:134:in `block in upload'
app/models/schedule.rb:182:in `with_retry'
app/models/schedule.rb:133:in `upload'
app/workers/export_job.rb:66:in `perform'
config/initializers/sidekiq.rb:14:in `call'
2024-04-18T14:15:02.740Z pid=1 tid=5gtl class=ExportJob jid=d7c71e0474edc5e053ce6e2e uniquejobs=server until_executed=uniquejobs:a2432cf6ffa63d31f4a4c684924a0906 INFO:  S3 Storage (364.8ms) Uploaded file to key: 7177cf28/export/252176/small-export_c669b6d56792.csv (checksum: AEaWg0KkvvMaLuWNrg5Xog==)
2024-04-18T14:15:02.750Z pid=1 tid=5fvp class=ActiveStorage::PurgeJob jid=8205f85c05a57c75bbfee0b6 INFO: start
2024-04-18T14:15:02.750Z pid=1 tid=5gtl class=ExportJob jid=d7c71e0474edc5e053ce6e2e uniquejobs=server until_executed=uniquejobs:a2432cf6ffa63d31f4a4c684924a0906 INFO: Enqueued ActiveStorage::PurgeJob (Job ID: 06c55f79-af16-4a4a-89ea-82a18a369823) to Sidekiq(low) with arguments: #<GlobalID:0x00007fdc23afb868 @uri=#<URI::GID gid://webadmit/ActiveStorage::Blob/43427>>
2024-04-18T14:15:02.756Z pid=1 tid=5fvp class=ActiveStorage::PurgeJob jid=8205f85c05a57c75bbfee0b6 INFO: Performing ActiveStorage::PurgeJob (Job ID: 06c55f79-af16-4a4a-89ea-82a18a369823) from Sidekiq(low) enqueued at 2024-04-18T14:15:02.747406061Z with arguments: #<GlobalID:0x00007fdc23c57fe0 @uri=#<URI::GID gid://webadmit/ActiveStorage::Blob/43427>>
2024-04-18T14:15:02.774Z pid=1 tid=5ga5 class=ExportJob jid=8f3611f7398d749da1354cb7 elapsed=2.189 INFO: fail
2024-04-18T14:15:02.774Z pid=1 tid=5ga5 WARN: {"context":"Job raised exception","job":{"retry":1,"queue":"export_processing","lock":"until_executed","args":[{"export_file_id":251814,"callback":null,"user_identity_id":370233,"list_params":{},"schedule_id":104,"on_schedule":true,"enqueued_time":"2024-04-18 10:15:00 -0400","aasm_state":"queued","scope":"organization"}],"class":"ExportJob","jid":"8f3611f7398d749da1354cb7","created_at":1713449700.57702,"lock_timeout":0,"lock_ttl":null,"lock_prefix":"uniquejobs","lock_args":[{"export_file_id":251814,"callback":null,"user_identity_id":370233,"list_params":{},"schedule_id":104,"on_schedule":true,"enqueued_time":"2024-04-18 10:15:00 -0400","aasm_state":"queued","scope":"organization"}],"lock_digest":"uniquejobs:dac9f891c4a8b3a90e9d79881223318d","enqueued_at":1713449700.5824823,"error_message":"ActiveRecord::Encryption::Errors::Decryption","error_class":"ActiveRecord::Encryption::Errors::Decryption","processor":"wa-sidekiq-star-58d78c5cc6-fm6dn:1","failed_at":1713449702.769844}}
2024-04-18T14:15:02.774Z pid=1 tid=5ga5 WARN: ActiveRecord::Encryption::Errors::Decryption: ActiveRecord::Encryption::Errors::Decryption
2024-04-18T14:15:02.774Z pid=1 tid=5ga5 WARN: app/models/destination.rb:74:in `initialize_connection'
app/models/schedule.rb:134:in `block in upload'
app/models/schedule.rb:182:in `with_retry'
app/models/schedule.rb:133:in `upload'
app/workers/export_job.rb:66:in `perform'
config/initializers/sidekiq.rb:14:in `call'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment