no new commits on dev/test/stage

1 - logs

2022.07.07 00:12:03 git-delta.sh /usr/local/libexec/freshports/git-to-freshports-xml.py --repo ports --path /var/db/ingress/repos/ports --branch main --commit-range e92af65a1220ad4e3a567f67e3ab0ff259910631..271ce919763ea8e3bad7f642f13e4cc13fbad5ce --spooling /var/db/ingress/message-queues/spooling --output /var/db/ingress/message-queues/incoming
/usr/local/libexec/freshports/git-delta.sh: /usr/local/libexec/freshports/git-to-freshports-xml.py: not found


But the file exists:

[dev-ingress01 dan /var/log/freshports] % pkg which /usr/local/libexec/freshports/git-to-freshports-xml.py                                                                                                                         19:27:27
/usr/local/libexec/freshports/git-to-freshports-xml.py was installed by package py39-freshports-git-proc-commit-0.1.1

2 - script problem

[dev-ingress01 dan /var/log/freshports] % head /usr/local/libexec/freshports/git-to-freshports-xml.py                                                                                                                              19:27:46
#!/usr/local/bin/python3.8


Yeah, I shouldn't be doing that.

3 - others

Interesting how they solved this:

[dev-ingress01 dan /usr/local/libexec/freshports] % grep python *                                                                                                                                                                  19:36:00
UpdatePackagesFromRawPackages.py:#!/usr/local/bin/python3.9
check_repos_for_new_stuff.py:#!/usr/local/bin/python3.9
get-list-of-current-categories.sh:# ports-mgmt portuguese  print python ruby rubygems russian  scheme science security shells spanish sysutils  tcl
git-to-freshports-xml.py:#!/usr/local/bin/python3.8
import-via-copy-packagesite-all-raw-fields.py:#!/usr/local/bin/python3.9
import_packagesite.py:#!/usr/local/bin/python3.9


Some already have 3.9... 

4 - latest commits

I think I have to reset the latest-commits for each repo.


2022.07.07 19:42:01 git-delta.sh has started. Will check these repos: 'doc ports src'
2022.07.07 19:42:01 git-delta.sh XML dir is /var/db/ingress/message-queues/incoming
2022.07.07 19:42:01 git-delta.sh Now processing repo: doc ---------------
2022.07.07 19:42:01 git-delta.sh REPODIR='/var/db/ingress/repos/doc' exists
2022.07.07 19:42:01 git-delta.sh Repodir is /var/db/ingress/repos/doc
2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git fetch:
2022.07.07 19:42:01 git-delta.sh fetch completed.
2022.07.07 19:42:01 git-delta.sh working on 'origin/main'
2022.07.07 19:42:01 git-delta.sh Is freshports/origin/main defined on the repo 'doc'?
2022.07.07 19:42:01 git-delta.sh running: git rev-parse -q --verify freshports/origin/main^{}
3a4370a41f988ad0b30f1f256c6ac73aa6e9b248
2022.07.07 19:42:01 git-delta.sh the latest commit we have for freshports/origin/main is:
3a4370a41f988ad0b30f1f256c6ac73aa6e9b248
2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/main..origin/main
2022.07.07 19:42:01 git-delta.sh Done.
2022.07.07 19:42:01 git-delta.sh No commits were found
2022.07.07 19:42:01 git-delta.sh Now processing repo: ports ---------------
2022.07.07 19:42:01 git-delta.sh REPODIR='/var/db/ingress/repos/ports' exists
2022.07.07 19:42:01 git-delta.sh Repodir is /var/db/ingress/repos/ports
2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git fetch:
2022.07.07 19:42:01 git-delta.sh fetch completed.
2022.07.07 19:42:01 git-delta.sh working on 'origin/2021Q2'
2022.07.07 19:42:01 git-delta.sh Is freshports/origin/2021Q2 defined on the repo 'ports'?
2022.07.07 19:42:01 git-delta.sh running: git rev-parse -q --verify freshports/origin/2021Q2^{}
d1da14bab7a800be62786aeb321b781179ea8b3f
2022.07.07 19:42:01 git-delta.sh the latest commit we have for freshports/origin/2021Q2 is:
d1da14bab7a800be62786aeb321b781179ea8b3f
2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/2021Q2..origin/2021Q2
2022.07.07 19:42:01 git-delta.sh Done.
2022.07.07 19:42:01 git-delta.sh No commits were found
2022.07.07 19:42:01 git-delta.sh working on 'origin/2021Q3'
2022.07.07 19:42:01 git-delta.sh Is freshports/origin/2021Q3 defined on the repo 'ports'?
2022.07.07 19:42:01 git-delta.sh running: git rev-parse -q --verify freshports/origin/2021Q3^{}
5d6eb9d394c16d3e3ff4816090470feb64b39239
2022.07.07 19:42:01 git-delta.sh the latest commit we have for freshports/origin/2021Q3 is:
5d6eb9d394c16d3e3ff4816090470feb64b39239
2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/2021Q3..origin/2021Q3
2022.07.07 19:42:01 git-delta.sh Done.
2022.07.07 19:42:01 git-delta.sh No commits were found
2022.07.07 19:42:01 git-delta.sh working on 'origin/main'
2022.07.07 19:42:01 git-delta.sh Is freshports/origin/main defined on the repo 'ports'?
2022.07.07 19:42:01 git-delta.sh running: git rev-parse -q --verify freshports/origin/main^{}
133d6738b973567b7450dd27687aa4ed7151efee
2022.07.07 19:42:01 git-delta.sh the latest commit we have for freshports/origin/main is:
133d6738b973567b7450dd27687aa4ed7151efee
2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/main..origin/main
2022.07.07 19:42:01 git-delta.sh Done.
2022.07.07 19:42:01 git-delta.sh No commits were found
2022.07.07 19:42:01 git-delta.sh Now processing repo: src ---------------
2022.07.07 19:42:01 git-delta.sh REPODIR='/var/db/ingress/repos/src' exists
2022.07.07 19:42:01 git-delta.sh Repodir is /var/db/ingress/repos/src
2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git fetch:
2022.07.07 19:42:02 git-delta.sh fetch completed.
2022.07.07 19:42:02 git-delta.sh working on 'origin/main'
2022.07.07 19:42:02 git-delta.sh Is freshports/origin/main defined on the repo 'src'?
2022.07.07 19:42:02 git-delta.sh running: git rev-parse -q --verify freshports/origin/main^{}
a6e734d779b3b5f5679588c1e6f66d0d1533fcbf
2022.07.07 19:42:02 git-delta.sh the latest commit we have for freshports/origin/main is:
a6e734d779b3b5f5679588c1e6f66d0d1533fcbf
2022.07.07 19:42:02 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/main..origin/main
2022.07.07 19:42:02 git-delta.sh Done.
2022.07.07 19:42:02 git-delta.sh No commits were found
2022.07.07 19:42:02 git-delta.sh Ending
[dev-ingress01 dan /var/log/freshports] % 

5 - latest commits in db

freshports.devgit=# select * from repo;
 id | name  |      description       |   repo_hostname    | path_to_repo | repository | db_root_prefix 
----+-------+------------------------+--------------------+--------------+------------+----------------
  1 | ports | The FreeBSD Ports tree | svnweb.freebsd.org | /ports       | subversion | 
  2 | doc   | The FreeBSD doc tree   | svnweb.freebsd.org | /doc         | subversion | 
  3 | src   | The FreeBSD src tree   | svnweb.freebsd.org | /base        | subversion | 
  9 | src   | The FreeBSD src tree   | cgit.freebsd.org   | /src         | git        | /base
  8 | doc   | The FreeBSD doc tree   | cgit.freebsd.org   | /doc         | git        | /doc
  7 | ports | The FreeBSD Ports tree | cgit.freebsd.org   | /ports       | git        | /ports
(6 rows)


freshports.devgit=# select id, message_id from commit_log where repo_id = 7 order by message_date desc limit 1;
   id   |                message_id                
--------+------------------------------------------
 911534 | db5eeb201b93c19c42724ec98f8ca1be9e88db15
(1 row)

freshports.devgit=# select id, message_id from commit_log where repo_id = 8 order by message_date desc limit 1;
   id   |                message_id                
--------+------------------------------------------
 911515 | 21de22b400a3970b2d3d4b2831c44702698f57e7
(1 row)

freshports.devgit=# select id, message_id from commit_log where repo_id = 9 order by message_date desc limit 1;
   id   |                message_id                
--------+------------------------------------------
 911537 | 03473e8ec8fa8d0f1ea30f85d8796ea9bf94bf29
(1 row)

freshports.devgit=# 

6 - how to update the repos?

for each of: doc ports src

src:
git tag -m "last known commit of freshports/origin/main" -f freshports/03473e8ec8fa8d0f1ea30f85d8796ea9bf94bf29 03473e8ec8fa8d0f1ea30f85d8796ea9bf94bf29

2022.07.04 20:45:04

doc:
git tag -m "last known commit of freshports/origin/main" -f freshports/21de22b400a3970b2d3d4b2831c44702698f57e7 21de22b400a3970b2d3d4b2831c44702698f57e7

2022.07.04 16:51:02

ports:
git tag -m "last known commit of freshports/origin/main" -f freshports/freshports/origin/main db5eeb201b93c19c42724ec98f8ca1be9e88db15

2022.07.04 20:30:03

[dev-ingress01 dan /usr/local/libexec/freshports] % grep python39 /var/log/messages                                                                                                                                                20:15:13
Jul  4 20:49:21 dev-ingress01 pkg[66393]: python39-3.9.13 installed

[dev-ingress01 dan ~ingress/message-queues] % sudo service freshports start                                                               13:21:17
Starting freshports.

*** /var/log/freshports/freshports-daemon.log ***
Jul  9 13:21:58 dev-ingress01 freshports[53578]: starting up!
Jul  9 13:21:58 dev-ingress01 freshports[53578]: incoming: /var/db/ingress/message-queues/incoming
Jul  9 13:21:58 dev-ingress01 freshports[53578]: recent: /var/db/freshports/message-queues/recent
Jul  9 13:21:58 dev-ingress01 freshports[53578]: retry: /var/db/freshports/message-queues/retry
Jul  9 13:21:58 dev-ingress01 freshports[53578]: ready
Jul  9 13:21:58 dev-ingress01 freshports[53578]: found stuff in /var/db/ingress/message-queues/incoming
Jul  9 13:21:58 dev-ingress01 freshports[53578]: processing /var/db/ingress/message-queues/incoming/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.xml
Jul  9 13:21:58 dev-ingress01 freshports[53578]: loading that XML into the database via load_xml_into_db.pl
Jul  9 13:21:58 dev-ingress01 freshports[53578]: /usr/local/bin/perl /usr/local/libexec/freshports/load_xml_into_db.pl /var/db/ingress/message-queues/incoming/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.xml /var/db/freshports/message-queues/recent/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.log /var/db/freshports/message-queues/recent/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.errors
Jul  9 13:22:13 dev-ingress01 freshports[53578]: XML loading finished
Jul  9 13:22:13 dev-ingress01 freshports[53578]: result=0
Jul  9 13:22:13 dev-ingress01 freshports[53578]: drwxrwxr-x  2 freshports  freshports     2 Jul  6 00:05 /var/db/freshports/message-queues/incoming/
Jul  9 13:22:13 dev-ingress01 freshports[53578]: drwxrwxr-x  2 freshports  freshports  3520 Jul  9 13:22 /var/db/freshports/message-queues/recent/
Jul  9 13:22:13 dev-ingress01 freshports[53578]: -rw-rw-r--  1 ingress     freshports   899 Jul  9 13:18 /var/db/ingress/message-queues/incoming/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.xml
Jul  9 13:22:13 dev-ingress01 freshports[53578]: removing /var/db/ingress/message-queues/incoming/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.xml
Jul  9 13:22:13 dev-ingress01 freshports[53578]: removal completed
Jul  9 13:22:13 dev-ingress01 freshports[53578]: yes, there is a job waiting

*** /var/log/freshports/freshports.log ***
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: running job-waiting.pl 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: starting ./job-waiting.pl (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: running ./job-waiting.pl as user = 'freshports' (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: checking jobs for freshports (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: flag '/var/db/freshports/signals/ports_to_refresh' not set.  no work for refresh-ports.sh (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: flag '/var/db/freshports/signals/refresh_moved' not set.  no work for process_moved.sh (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: flag '/var/db/freshports/signals/new_repo_imported' not set.  no work for UpdatePackagesFromRawPackages.py (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: flag '/var/db/freshports/signals/refresh_updating' not set.  no work for process_updating.sh (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 FreshPorts[54525]: /var/db/freshports/signals/new_repo_ready_for_import exists.  About to run import_packagesite.py (/usr/local/libexec/freshports) 
Jul  9 13:22:14 dev-ingress01 import_packagesite.py[54530]: Starting up
Jul  9 13:22:14 dev-ingress01 import_packagesite.py[54530]: we have 1 repos to process
Jul  9 13:22:14 dev-ingress01 import_packagesite.py[54530]: importing FreeBSD:12:i386/quarterly
Jul  9 13:22:14 dev-ingress01 import_packagesite.py[54530]: command is: /usr/local/libexec/freshports/fetch-extract-parse-import-one-abi.sh FreeBSD:12:i386 quarterly
Jul  9 13:22:14 dev-ingress01 fetch-extract-parse-import-one-abi.sh[54532]: starting /usr/local/libexec/freshports/fetch-extract-parse-import-one-abi.sh
Jul  9 13:22:17 dev-ingress01 import-via-copy-packagesite-all-raw-fields.py[54564]: Starting up
Jul  9 13:22:17 dev-ingress01 syslogd: last message repeated 1 times
Jul  9 13:22:17 dev-ingress01 import-via-copy-packagesite-all-raw-fields.py[54564]: copying in from packagesite.tsv
...