Skip to content

Instantly share code, notes, and snippets.

View sonalkr132's full-sized avatar
🐶
‏‏‎

Aditya Prakash sonalkr132

🐶
‏‏‎
View GitHub Profile
[compact_index:correct_info_checksum] version: activerecord-mysql2legacydb-adapter-0.2.0 old_checksum: 497a4c51f6e7ff2d01296b136799e111 new_checksum: 8a2c1cb34cfaba7ff899cfe8a4bae3f5
[compact_index:correct_info_checksum] version: activerecord-postgres-earthdistance-0.7.1 old_checksum: b3a1b4a20d3e906d941a3ab0a9006192 new_checksum: dfcd3a9b12755205ad3ebb0683c108f9
[compact_index:correct_info_checksum] version: active_scaffold_export-3.3.2 old_checksum: fa0aa6932b64fe177a41d9cfea200e09 new_checksum: 38aeb4090bae8a51861e756f72a59707
[compact_index:correct_info_checksum] version: active_zuora-2.6.0 old_checksum: 41d3dbb00c440d437178edc1864e51dc new_checksum: b8c6d8b182b698ff1a6127abe3c3d046
[compact_index:correct_info_checksum] version: acts_as_account-3.2.1 old_checksum: a438f287993a696a975630bcb0bbef4d new_checksum: cbeb7161e9d0b6fe9c2ffffdd12a5a2d
[compact_index:correct_info_checksum] version: addressabler-0.1.2 old_checksum: 02fef9f7b30e4457325987b8e12c0d05 new_checksum: e1c8a5ae37d5ef4305f83074e03eb74e
[comp
num=9
log_file_path = "/home/aditya/rubygems.org/exta-dep-check-#{num}.log"
log_file = File.open(log_file_path, 'w')
#versions = Version.joins("inner join dependencies on versions.id = dependencies.version_id").where("DATE_PART('minute', dependencies.created_at - versions.created_at) > 1").where("versions.indexed = 'true'").distinct("versions.id")
versions = Version.where("id < 101000").where("id % 10 = ?", num).where("versions.indexed = 'true'")
total = versions.count
dev_mis_match, run_mis_match, mis_match_total, processed = 0, 0, 0, 0
body= ""
treetop expected: 3da6d52e6ad53e73f44f9aeafef2b513 found: 69b8eaba3799146168b68cbd8ea56653
taza expected: 9d6f6ff1f2eef510134cb038294a916f found: 724b82d9cb9618c30895931a7175cbc0
stompserver expected: 5205ecb0d1294dd8c78f36cc551f53ab found: fa735614d741091864f9673967d55959
sproutcore expected: 34bc2599551293e70dd0d9018c3cd49d found: 2e42c25ade6b3ed880b3ffa155a59d2f
shenandoah expected: 4d18ae46ce28b326bdf46aef0fb0f7ea found: ace54f4c6ce855025481f27b93ed60d2
rye expected: a65c44f4b6603f04de5d40c92783f385 found: 059d872c514caf92ea61ac1492dd1ae9
rudy expected: d4f3ad807767252ab7ff52a4d1add604 found: d0c47ad44a71f62356af02bc65b81d95
ruby-smpp expected: e5e39e8e3be5817493c9e216f02546f4 found: 32902deaca2cadeb803e587a3ff2ddec
rascut expected: 37653be9eb5a25fbc821a533cbfa4665 found: 7c07a551be07b0d0b922c148cd5abdd8
rails-toolkit expected: f68ede36778d748265a577e6a6fa4bae found: 872524b84c26b3541ca8b09da28a9248
@sonalkr132
sonalkr132 / same-dep-gems.txt
Last active May 31, 2020 09:05
all gems which has info checksum mismatch because of duplicate dependency
activerecord-postgres-earthdistance expected: dfcd3a9b12755205ad3ebb0683c108f9 found: b3a1b4a20d3e906d941a3ab0a9006192
activerecord-postgres-earthdistance same deps:
0.1.0 pg:>= 0.11 pg:>= 0
0.1.0 rails:>= 3.0.0 rails:>= 0
spree_core expected: b65505e600cb4ac93721ab076c19def5 found: 84ec1d81e58373563d0441c36c3995fc
spree_core same deps:
1.2.4 select2-rails:~> 3.0 select2-rails:~> 3.2
1.2.5 select2-rails:~> 3.0 select2-rails:~> 3.2
chef expected: 8dc5943fe9f7664da1ac33e7517f8a5b found: 13c350c92f8a10c62e6d46dc3c73cc0c
chef same deps:
activerecord-postgres-earthdistance b3a1b4a20d3e906d941a3ab0a9006192 dfcd3a9b12755205ad3ebb0683c108f9
spree_core 84ec1d81e58373563d0441c36c3995fc b65505e600cb4ac93721ab076c19def5
chef 13c350c92f8a10c62e6d46dc3c73cc0c 8dc5943fe9f7664da1ac33e7517f8a5b
breezy 3b59e2dc16ae724866c8631021fac42c c8dc429dc5f6370ab040f4972ed9f624
rdf-rdfa 60a88c30c400715de405ca0f6fc1f9a4 898ac0bc715d31fdd9fe2569a7828653
pleaserun b4583653bcfff14104222ec073284cbf 90173d73349edd4ff3abc80b9e95f412
active-fedora 99b6766982e133c8da77e200da594779 bb45f5a8a2fd141927488e27ef80cc39
tzispa_data dfd7231a6f2b96dc21e72ee0c3f71122 3938483cbddca328e51f2e1e3f956a1d
capistrano 6756fda6471069fd9e3cc3fe906bbc11 b8cb2db1f16711f6960116b2d75bab9c
txp d58cf4bc0e170b5f27f6cdfcac030d8e c783bd18f59884ffa9364a43af812683
DimaD-daylite-models 7f9d8f57d2a182f9dc4203148ae2ec8c e952ace57ea68b446c959c90c8bffa98
MINT-core 84e933a5d0c7789eea7db2b0499d23f1 56e955b122b9eaf9e7794c521817f024
NetAnalyzer b705f325b329a609d92483d0d1f7aee0 e83289b648b58551b0baee531deaa922
ShyCouch a466cf230cb6001781d027eda43d5f79 96b1e37a8b373d2de15e55e112ba9d73
TheAdmin 89a530413e52d763168dc890beba3f98 e63029cc3d7df95a37566707866bf865
active-fedora 99b6766982e133c8da77e200da594779 bb45f5a8a2fd141927488e27ef80cc39
active_scaffold_export fa0aa6932b64fe177a41d9cfea200e09 38aeb4090bae8a51861e756f72a59707
active_zuora 41d3dbb00c440d437178edc1864e51dc b8c6d8b182b698ff1a6127abe3c3d046
activefacts 9a94223d87f13eb914b4c939a1f613b5 5a26a761cb57c65730ba910b8df688db
activerecord-mysql2legacydb-adapter 497a4c51f6e7ff2d01296b136799e111 8a2c1cb34cfaba7ff899cfe8a4bae3f5
[extraneous_dependencies:clean] found 3548 versions for clean up
[extraneous_dependencies:clean] spec and db run deps don't match for: zomg-1.0.2 spec: ["ruby2ruby"] db: {"97380"=>"hoe", "97379"=>"ruby2ruby"}
[extraneous_dependencies:clean] deleting dependencies with ids: ["97380"]
[extraneous_dependencies:clean] spec and db run deps don't match for: zomg-1.0.1 spec: ["ruby2ruby"] db: {"97382"=>"hoe", "97381"=>"ruby2ruby"}
[extraneous_dependencies:clean] deleting dependencies with ids: ["97382"]
[extraneous_dependencies:clean] spec and db run deps don't match for: zomg-1.0.0 spec: ["ruby2ruby"] db: {"97384"=>"hoe", "97383"=>"ruby2ruby"}
[extraneous_dependencies:clean] deleting dependencies with ids: ["97384"]
[extraneous_dependencies:clean] spec and db run deps don't match for: zergling-0.0.1 spec: ["zerg_support"] db: {"97395"=>"echoe", "97394"=>"zerg_support"}
[extraneous_dependencies:clean] deleting dependencies with ids: ["97395"]
[extraneous_dependencies:clean] spec and db run deps don't match for: zerg_
log_file_path = '/home/aditya/rubygems.org/some7.log'
log_file = File.open(log_file_path, 'w')
versions = Version.joins("inner join dependencies on versions.id = dependencies.version_id")
.where("date_trunc('day', dependencies.created_at) = '2009-09-02 00:00:00'::timestamp")
.where("versions.indexed = 'true'")
.distinct("versions.id")
total = versions.count
dev_mis_match, run_mis_match, mis_match_total, processed = 0, 0, 0, 0
log_file = '/home/aditya/rubygems.org/some5.log'
File.open(log_file, 'w') { |file| file.puts('') }
# versions = Version.joins("inner join dependencies on versions.id = dependencies.version_id").where("date_trunc('day', dependencies.created_at) = '2009-09-02 00:00:00'::timestamp").where("versions.indexed = 'true'").distinct("versions.id")
versions = Version.joins("inner join dependencies on versions.id = dependencies.version_id").where("date_trunc('hour', versions.created_at) != date_trunc('hour', dependencies.created_at) and date_trunc('day', dependencies.created_at) != '2009-09-02 00:00:00'::timestamp").where("versions.indexed = 'true'").distinct("versions.id")
total = versions.count
mis_match = 0
processed = 0
versions.each do |version|
@sonalkr132
sonalkr132 / just_updated.new.sql
Created April 26, 2020 14:57
just_updated.new.sql is 1350ms faster it scans fewer rows
rubygems_development=# explain analyze SELECT "versions".* FROM "versions" INNER JOIN "rubygems" ON "rubygems"."id" = "versions"."rubygem_id" WHERE ( versions.rubygem_id IN (SELECT versions.rubygem_id FROM versions where versions.indexed = 'true' GROUP BY versions.rubygem_id HAVING COUNT(versions.id) > 1 order by max(created_at) desc limit 50)) AND "versions"."indexed" = 'true' ORDER BY "versions"."created_at" DESC LIMIT 50;
QUERY PLAN
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Limit (cost=79874.05..79874.18 rows=50 width=403) (actual time=643.328..643.334 rows=50 loops=1)
-> Sort (cost=79874.05..79874.83 rows=310 width=403) (actual time=643.326..643.330 rows=50 loops=1)
Sort Key: versions.created_at DESC