Skip to content

Instantly share code, notes, and snippets.

@dlangille
Last active July 9, 2022 13:22
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save dlangille/7291b099bf75081e0bdb45965a4acf65 to your computer and use it in GitHub Desktop.
Save dlangille/7291b099bf75081e0bdb45965a4acf65 to your computer and use it in GitHub Desktop.
no new commits on dev/test/stage
2022.07.07 00:12:03 git-delta.sh /usr/local/libexec/freshports/git-to-freshports-xml.py --repo ports --path /var/db/ingress/repos/ports --branch main --commit-range e92af65a1220ad4e3a567f67e3ab0ff259910631..271ce919763ea8e3bad7f642f13e4cc13fbad5ce --spooling /var/db/ingress/message-queues/spooling --output /var/db/ingress/message-queues/incoming
/usr/local/libexec/freshports/git-delta.sh: /usr/local/libexec/freshports/git-to-freshports-xml.py: not found
But the file exists:
[dev-ingress01 dan /var/log/freshports] % pkg which /usr/local/libexec/freshports/git-to-freshports-xml.py 19:27:27
/usr/local/libexec/freshports/git-to-freshports-xml.py was installed by package py39-freshports-git-proc-commit-0.1.1
[dev-ingress01 dan /var/log/freshports] % head /usr/local/libexec/freshports/git-to-freshports-xml.py 19:27:46
#!/usr/local/bin/python3.8
Yeah, I shouldn't be doing that.
Interesting how they solved this:
[dev-ingress01 dan /usr/local/libexec/freshports] % grep python * 19:36:00
UpdatePackagesFromRawPackages.py:#!/usr/local/bin/python3.9
check_repos_for_new_stuff.py:#!/usr/local/bin/python3.9
get-list-of-current-categories.sh:# ports-mgmt portuguese print python ruby rubygems russian scheme science security shells spanish sysutils tcl
git-to-freshports-xml.py:#!/usr/local/bin/python3.8
import-via-copy-packagesite-all-raw-fields.py:#!/usr/local/bin/python3.9
import_packagesite.py:#!/usr/local/bin/python3.9
Some already have 3.9...
I think I have to reset the latest-commits for each repo.
2022.07.07 19:42:01 git-delta.sh has started. Will check these repos: 'doc ports src'
2022.07.07 19:42:01 git-delta.sh XML dir is /var/db/ingress/message-queues/incoming
2022.07.07 19:42:01 git-delta.sh Now processing repo: doc ---------------
2022.07.07 19:42:01 git-delta.sh REPODIR='/var/db/ingress/repos/doc' exists
2022.07.07 19:42:01 git-delta.sh Repodir is /var/db/ingress/repos/doc
2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git fetch:
2022.07.07 19:42:01 git-delta.sh fetch completed.
2022.07.07 19:42:01 git-delta.sh working on 'origin/main'
2022.07.07 19:42:01 git-delta.sh Is freshports/origin/main defined on the repo 'doc'?
2022.07.07 19:42:01 git-delta.sh running: git rev-parse -q --verify freshports/origin/main^{}
3a4370a41f988ad0b30f1f256c6ac73aa6e9b248
2022.07.07 19:42:01 git-delta.sh the latest commit we have for freshports/origin/main is:
3a4370a41f988ad0b30f1f256c6ac73aa6e9b248
2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/main..origin/main
2022.07.07 19:42:01 git-delta.sh Done.
2022.07.07 19:42:01 git-delta.sh No commits were found
2022.07.07 19:42:01 git-delta.sh Now processing repo: ports ---------------
2022.07.07 19:42:01 git-delta.sh REPODIR='/var/db/ingress/repos/ports' exists
2022.07.07 19:42:01 git-delta.sh Repodir is /var/db/ingress/repos/ports
2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git fetch:
2022.07.07 19:42:01 git-delta.sh fetch completed.
2022.07.07 19:42:01 git-delta.sh working on 'origin/2021Q2'
2022.07.07 19:42:01 git-delta.sh Is freshports/origin/2021Q2 defined on the repo 'ports'?
2022.07.07 19:42:01 git-delta.sh running: git rev-parse -q --verify freshports/origin/2021Q2^{}
d1da14bab7a800be62786aeb321b781179ea8b3f
2022.07.07 19:42:01 git-delta.sh the latest commit we have for freshports/origin/2021Q2 is:
d1da14bab7a800be62786aeb321b781179ea8b3f
2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/2021Q2..origin/2021Q2
2022.07.07 19:42:01 git-delta.sh Done.
2022.07.07 19:42:01 git-delta.sh No commits were found
2022.07.07 19:42:01 git-delta.sh working on 'origin/2021Q3'
2022.07.07 19:42:01 git-delta.sh Is freshports/origin/2021Q3 defined on the repo 'ports'?
2022.07.07 19:42:01 git-delta.sh running: git rev-parse -q --verify freshports/origin/2021Q3^{}
5d6eb9d394c16d3e3ff4816090470feb64b39239
2022.07.07 19:42:01 git-delta.sh the latest commit we have for freshports/origin/2021Q3 is:
5d6eb9d394c16d3e3ff4816090470feb64b39239
2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/2021Q3..origin/2021Q3
2022.07.07 19:42:01 git-delta.sh Done.
2022.07.07 19:42:01 git-delta.sh No commits were found
2022.07.07 19:42:01 git-delta.sh working on 'origin/main'
2022.07.07 19:42:01 git-delta.sh Is freshports/origin/main defined on the repo 'ports'?
2022.07.07 19:42:01 git-delta.sh running: git rev-parse -q --verify freshports/origin/main^{}
133d6738b973567b7450dd27687aa4ed7151efee
2022.07.07 19:42:01 git-delta.sh the latest commit we have for freshports/origin/main is:
133d6738b973567b7450dd27687aa4ed7151efee
2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/main..origin/main
2022.07.07 19:42:01 git-delta.sh Done.
2022.07.07 19:42:01 git-delta.sh No commits were found
2022.07.07 19:42:01 git-delta.sh Now processing repo: src ---------------
2022.07.07 19:42:01 git-delta.sh REPODIR='/var/db/ingress/repos/src' exists
2022.07.07 19:42:01 git-delta.sh Repodir is /var/db/ingress/repos/src
2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git fetch:
2022.07.07 19:42:02 git-delta.sh fetch completed.
2022.07.07 19:42:02 git-delta.sh working on 'origin/main'
2022.07.07 19:42:02 git-delta.sh Is freshports/origin/main defined on the repo 'src'?
2022.07.07 19:42:02 git-delta.sh running: git rev-parse -q --verify freshports/origin/main^{}
a6e734d779b3b5f5679588c1e6f66d0d1533fcbf
2022.07.07 19:42:02 git-delta.sh the latest commit we have for freshports/origin/main is:
a6e734d779b3b5f5679588c1e6f66d0d1533fcbf
2022.07.07 19:42:02 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/main..origin/main
2022.07.07 19:42:02 git-delta.sh Done.
2022.07.07 19:42:02 git-delta.sh No commits were found
2022.07.07 19:42:02 git-delta.sh Ending
[dev-ingress01 dan /var/log/freshports] %
freshports.devgit=# select * from repo;
id | name | description | repo_hostname | path_to_repo | repository | db_root_prefix
----+-------+------------------------+--------------------+--------------+------------+----------------
1 | ports | The FreeBSD Ports tree | svnweb.freebsd.org | /ports | subversion |
2 | doc | The FreeBSD doc tree | svnweb.freebsd.org | /doc | subversion |
3 | src | The FreeBSD src tree | svnweb.freebsd.org | /base | subversion |
9 | src | The FreeBSD src tree | cgit.freebsd.org | /src | git | /base
8 | doc | The FreeBSD doc tree | cgit.freebsd.org | /doc | git | /doc
7 | ports | The FreeBSD Ports tree | cgit.freebsd.org | /ports | git | /ports
(6 rows)
freshports.devgit=# select id, message_id from commit_log where repo_id = 7 order by message_date desc limit 1;
id | message_id
--------+------------------------------------------
911534 | db5eeb201b93c19c42724ec98f8ca1be9e88db15
(1 row)
freshports.devgit=# select id, message_id from commit_log where repo_id = 8 order by message_date desc limit 1;
id | message_id
--------+------------------------------------------
911515 | 21de22b400a3970b2d3d4b2831c44702698f57e7
(1 row)
freshports.devgit=# select id, message_id from commit_log where repo_id = 9 order by message_date desc limit 1;
id | message_id
--------+------------------------------------------
911537 | 03473e8ec8fa8d0f1ea30f85d8796ea9bf94bf29
(1 row)
freshports.devgit=#
for each of: doc ports src
src:
git tag -m "last known commit of freshports/origin/main" -f freshports/03473e8ec8fa8d0f1ea30f85d8796ea9bf94bf29 03473e8ec8fa8d0f1ea30f85d8796ea9bf94bf29
2022.07.04 20:45:04
doc:
git tag -m "last known commit of freshports/origin/main" -f freshports/21de22b400a3970b2d3d4b2831c44702698f57e7 21de22b400a3970b2d3d4b2831c44702698f57e7
2022.07.04 16:51:02
ports:
git tag -m "last known commit of freshports/origin/main" -f freshports/freshports/origin/main db5eeb201b93c19c42724ec98f8ca1be9e88db15
2022.07.04 20:30:03
[dev-ingress01 dan /usr/local/libexec/freshports] % grep python39 /var/log/messages 20:15:13
Jul 4 20:49:21 dev-ingress01 pkg[66393]: python39-3.9.13 installed
@dlangille
Copy link
Author

dlangille commented Jul 9, 2022

We have 269 commits to catch up on:

[dev-ingress01 dan ~ingress/message-queues] % ls incoming | wc -l
     269

@dlangille
Copy link
Author

[dev-ingress01 dan ~ingress/message-queues] % sudo service freshports start                                                               13:21:17
Starting freshports.

*** /var/log/freshports/freshports-daemon.log ***
Jul  9 13:21:58 dev-ingress01 freshports[53578]: starting up!
Jul  9 13:21:58 dev-ingress01 freshports[53578]: incoming: /var/db/ingress/message-queues/incoming
Jul  9 13:21:58 dev-ingress01 freshports[53578]: recent: /var/db/freshports/message-queues/recent
Jul  9 13:21:58 dev-ingress01 freshports[53578]: retry: /var/db/freshports/message-queues/retry
Jul  9 13:21:58 dev-ingress01 freshports[53578]: ready
Jul  9 13:21:58 dev-ingress01 freshports[53578]: found stuff in /var/db/ingress/message-queues/incoming
Jul  9 13:21:58 dev-ingress01 freshports[53578]: processing /var/db/ingress/message-queues/incoming/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.xml
Jul  9 13:21:58 dev-ingress01 freshports[53578]: loading that XML into the database via load_xml_into_db.pl
Jul  9 13:21:58 dev-ingress01 freshports[53578]: /usr/local/bin/perl /usr/local/libexec/freshports/load_xml_into_db.pl /var/db/ingress/message-queues/incoming/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.xml /var/db/freshports/message-queues/recent/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.log /var/db/freshports/message-queues/recent/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.errors
Jul  9 13:22:13 dev-ingress01 freshports[53578]: XML loading finished
Jul  9 13:22:13 dev-ingress01 freshports[53578]: result=0
Jul  9 13:22:13 dev-ingress01 freshports[53578]: drwxrwxr-x  2 freshports  freshports     2 Jul  6 00:05 /var/db/freshports/message-queues/incoming/
Jul  9 13:22:13 dev-ingress01 freshports[53578]: drwxrwxr-x  2 freshports  freshports  3520 Jul  9 13:22 /var/db/freshports/message-queues/recent/
Jul  9 13:22:13 dev-ingress01 freshports[53578]: -rw-rw-r--  1 ingress     freshports   899 Jul  9 13:18 /var/db/ingress/message-queues/incoming/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.xml
Jul  9 13:22:13 dev-ingress01 freshports[53578]: removing /var/db/ingress/message-queues/incoming/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.xml
Jul  9 13:22:13 dev-ingress01 freshports[53578]: removal completed
Jul  9 13:22:13 dev-ingress01 freshports[53578]: yes, there is a job waiting

*** /var/log/freshports/freshports.log ***
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: running job-waiting.pl 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: starting ./job-waiting.pl (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: running ./job-waiting.pl as user = 'freshports' (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: checking jobs for freshports (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: flag '/var/db/freshports/signals/ports_to_refresh' not set.  no work for refresh-ports.sh (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: flag '/var/db/freshports/signals/refresh_moved' not set.  no work for process_moved.sh (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: flag '/var/db/freshports/signals/new_repo_imported' not set.  no work for UpdatePackagesFromRawPackages.py (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: flag '/var/db/freshports/signals/refresh_updating' not set.  no work for process_updating.sh (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: /var/db/freshports/signals/new_repo_ready_for_import exists.  About to run import_packagesite.py (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 import_packagesite.py[54530]: Starting up
Jul  9 13:22:14 dev-ingress01 import_packagesite.py[54530]: we have 1 repos to process
Jul  9 13:22:14 dev-ingress01 import_packagesite.py[54530]: importing FreeBSD:12:i386/quarterly
Jul  9 13:22:14 dev-ingress01 import_packagesite.py[54530]: command is: /usr/local/libexec/freshports/fetch-extract-parse-import-one-abi.sh FreeBSD:12:i386 quarterly
Jul  9 13:22:14 dev-ingress01 fetch-extract-parse-import-one-abi.sh[54532]: starting /usr/local/libexec/freshports/fetch-extract-parse-import-one-abi.sh
Jul  9 13:22:17 dev-ingress01 import-via-copy-packagesite-all-raw-fields.py[54564]: Starting up
Jul  9 13:22:17 dev-ingress01 syslogd: last message repeated 1 times
Jul  9 13:22:17 dev-ingress01 import-via-copy-packagesite-all-raw-fields.py[54564]: copying in from packagesite.tsv
...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment