-
-
Save dlangille/7291b099bf75081e0bdb45965a4acf65 to your computer and use it in GitHub Desktop.
no new commits on dev/test/stage
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 2022.07.07 00:12:03 git-delta.sh /usr/local/libexec/freshports/git-to-freshports-xml.py --repo ports --path /var/db/ingress/repos/ports --branch main --commit-range e92af65a1220ad4e3a567f67e3ab0ff259910631..271ce919763ea8e3bad7f642f13e4cc13fbad5ce --spooling /var/db/ingress/message-queues/spooling --output /var/db/ingress/message-queues/incoming | |
| /usr/local/libexec/freshports/git-delta.sh: /usr/local/libexec/freshports/git-to-freshports-xml.py: not found | |
| But the file exists: | |
| [dev-ingress01 dan /var/log/freshports] % pkg which /usr/local/libexec/freshports/git-to-freshports-xml.py 19:27:27 | |
| /usr/local/libexec/freshports/git-to-freshports-xml.py was installed by package py39-freshports-git-proc-commit-0.1.1 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| [dev-ingress01 dan /var/log/freshports] % head /usr/local/libexec/freshports/git-to-freshports-xml.py 19:27:46 | |
| #!/usr/local/bin/python3.8 | |
| Yeah, I shouldn't be doing that. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Interesting how they solved this: | |
| [dev-ingress01 dan /usr/local/libexec/freshports] % grep python * 19:36:00 | |
| UpdatePackagesFromRawPackages.py:#!/usr/local/bin/python3.9 | |
| check_repos_for_new_stuff.py:#!/usr/local/bin/python3.9 | |
| get-list-of-current-categories.sh:# ports-mgmt portuguese print python ruby rubygems russian scheme science security shells spanish sysutils tcl | |
| git-to-freshports-xml.py:#!/usr/local/bin/python3.8 | |
| import-via-copy-packagesite-all-raw-fields.py:#!/usr/local/bin/python3.9 | |
| import_packagesite.py:#!/usr/local/bin/python3.9 | |
| Some already have 3.9... |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| I think I have to reset the latest-commits for each repo. | |
| 2022.07.07 19:42:01 git-delta.sh has started. Will check these repos: 'doc ports src' | |
| 2022.07.07 19:42:01 git-delta.sh XML dir is /var/db/ingress/message-queues/incoming | |
| 2022.07.07 19:42:01 git-delta.sh Now processing repo: doc --------------- | |
| 2022.07.07 19:42:01 git-delta.sh REPODIR='/var/db/ingress/repos/doc' exists | |
| 2022.07.07 19:42:01 git-delta.sh Repodir is /var/db/ingress/repos/doc | |
| 2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git fetch: | |
| 2022.07.07 19:42:01 git-delta.sh fetch completed. | |
| 2022.07.07 19:42:01 git-delta.sh working on 'origin/main' | |
| 2022.07.07 19:42:01 git-delta.sh Is freshports/origin/main defined on the repo 'doc'? | |
| 2022.07.07 19:42:01 git-delta.sh running: git rev-parse -q --verify freshports/origin/main^{} | |
| 3a4370a41f988ad0b30f1f256c6ac73aa6e9b248 | |
| 2022.07.07 19:42:01 git-delta.sh the latest commit we have for freshports/origin/main is: | |
| 3a4370a41f988ad0b30f1f256c6ac73aa6e9b248 | |
| 2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/main..origin/main | |
| 2022.07.07 19:42:01 git-delta.sh Done. | |
| 2022.07.07 19:42:01 git-delta.sh No commits were found | |
| 2022.07.07 19:42:01 git-delta.sh Now processing repo: ports --------------- | |
| 2022.07.07 19:42:01 git-delta.sh REPODIR='/var/db/ingress/repos/ports' exists | |
| 2022.07.07 19:42:01 git-delta.sh Repodir is /var/db/ingress/repos/ports | |
| 2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git fetch: | |
| 2022.07.07 19:42:01 git-delta.sh fetch completed. | |
| 2022.07.07 19:42:01 git-delta.sh working on 'origin/2021Q2' | |
| 2022.07.07 19:42:01 git-delta.sh Is freshports/origin/2021Q2 defined on the repo 'ports'? | |
| 2022.07.07 19:42:01 git-delta.sh running: git rev-parse -q --verify freshports/origin/2021Q2^{} | |
| d1da14bab7a800be62786aeb321b781179ea8b3f | |
| 2022.07.07 19:42:01 git-delta.sh the latest commit we have for freshports/origin/2021Q2 is: | |
| d1da14bab7a800be62786aeb321b781179ea8b3f | |
| 2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/2021Q2..origin/2021Q2 | |
| 2022.07.07 19:42:01 git-delta.sh Done. | |
| 2022.07.07 19:42:01 git-delta.sh No commits were found | |
| 2022.07.07 19:42:01 git-delta.sh working on 'origin/2021Q3' | |
| 2022.07.07 19:42:01 git-delta.sh Is freshports/origin/2021Q3 defined on the repo 'ports'? | |
| 2022.07.07 19:42:01 git-delta.sh running: git rev-parse -q --verify freshports/origin/2021Q3^{} | |
| 5d6eb9d394c16d3e3ff4816090470feb64b39239 | |
| 2022.07.07 19:42:01 git-delta.sh the latest commit we have for freshports/origin/2021Q3 is: | |
| 5d6eb9d394c16d3e3ff4816090470feb64b39239 | |
| 2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/2021Q3..origin/2021Q3 | |
| 2022.07.07 19:42:01 git-delta.sh Done. | |
| 2022.07.07 19:42:01 git-delta.sh No commits were found | |
| 2022.07.07 19:42:01 git-delta.sh working on 'origin/main' | |
| 2022.07.07 19:42:01 git-delta.sh Is freshports/origin/main defined on the repo 'ports'? | |
| 2022.07.07 19:42:01 git-delta.sh running: git rev-parse -q --verify freshports/origin/main^{} | |
| 133d6738b973567b7450dd27687aa4ed7151efee | |
| 2022.07.07 19:42:01 git-delta.sh the latest commit we have for freshports/origin/main is: | |
| 133d6738b973567b7450dd27687aa4ed7151efee | |
| 2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/main..origin/main | |
| 2022.07.07 19:42:01 git-delta.sh Done. | |
| 2022.07.07 19:42:01 git-delta.sh No commits were found | |
| 2022.07.07 19:42:01 git-delta.sh Now processing repo: src --------------- | |
| 2022.07.07 19:42:01 git-delta.sh REPODIR='/var/db/ingress/repos/src' exists | |
| 2022.07.07 19:42:01 git-delta.sh Repodir is /var/db/ingress/repos/src | |
| 2022.07.07 19:42:01 git-delta.sh Running: /usr/local/bin/git fetch: | |
| 2022.07.07 19:42:02 git-delta.sh fetch completed. | |
| 2022.07.07 19:42:02 git-delta.sh working on 'origin/main' | |
| 2022.07.07 19:42:02 git-delta.sh Is freshports/origin/main defined on the repo 'src'? | |
| 2022.07.07 19:42:02 git-delta.sh running: git rev-parse -q --verify freshports/origin/main^{} | |
| a6e734d779b3b5f5679588c1e6f66d0d1533fcbf | |
| 2022.07.07 19:42:02 git-delta.sh the latest commit we have for freshports/origin/main is: | |
| a6e734d779b3b5f5679588c1e6f66d0d1533fcbf | |
| 2022.07.07 19:42:02 git-delta.sh Running: /usr/local/bin/git rev-list freshports/origin/main..origin/main | |
| 2022.07.07 19:42:02 git-delta.sh Done. | |
| 2022.07.07 19:42:02 git-delta.sh No commits were found | |
| 2022.07.07 19:42:02 git-delta.sh Ending | |
| [dev-ingress01 dan /var/log/freshports] % |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| freshports.devgit=# select * from repo; | |
| id | name | description | repo_hostname | path_to_repo | repository | db_root_prefix | |
| ----+-------+------------------------+--------------------+--------------+------------+---------------- | |
| 1 | ports | The FreeBSD Ports tree | svnweb.freebsd.org | /ports | subversion | | |
| 2 | doc | The FreeBSD doc tree | svnweb.freebsd.org | /doc | subversion | | |
| 3 | src | The FreeBSD src tree | svnweb.freebsd.org | /base | subversion | | |
| 9 | src | The FreeBSD src tree | cgit.freebsd.org | /src | git | /base | |
| 8 | doc | The FreeBSD doc tree | cgit.freebsd.org | /doc | git | /doc | |
| 7 | ports | The FreeBSD Ports tree | cgit.freebsd.org | /ports | git | /ports | |
| (6 rows) | |
| freshports.devgit=# select id, message_id from commit_log where repo_id = 7 order by message_date desc limit 1; | |
| id | message_id | |
| --------+------------------------------------------ | |
| 911534 | db5eeb201b93c19c42724ec98f8ca1be9e88db15 | |
| (1 row) | |
| freshports.devgit=# select id, message_id from commit_log where repo_id = 8 order by message_date desc limit 1; | |
| id | message_id | |
| --------+------------------------------------------ | |
| 911515 | 21de22b400a3970b2d3d4b2831c44702698f57e7 | |
| (1 row) | |
| freshports.devgit=# select id, message_id from commit_log where repo_id = 9 order by message_date desc limit 1; | |
| id | message_id | |
| --------+------------------------------------------ | |
| 911537 | 03473e8ec8fa8d0f1ea30f85d8796ea9bf94bf29 | |
| (1 row) | |
| freshports.devgit=# |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| for each of: doc ports src | |
| src: | |
| git tag -m "last known commit of freshports/origin/main" -f freshports/03473e8ec8fa8d0f1ea30f85d8796ea9bf94bf29 03473e8ec8fa8d0f1ea30f85d8796ea9bf94bf29 | |
| 2022.07.04 20:45:04 | |
| doc: | |
| git tag -m "last known commit of freshports/origin/main" -f freshports/21de22b400a3970b2d3d4b2831c44702698f57e7 21de22b400a3970b2d3d4b2831c44702698f57e7 | |
| 2022.07.04 16:51:02 | |
| ports: | |
| git tag -m "last known commit of freshports/origin/main" -f freshports/freshports/origin/main db5eeb201b93c19c42724ec98f8ca1be9e88db15 | |
| 2022.07.04 20:30:03 | |
| [dev-ingress01 dan /usr/local/libexec/freshports] % grep python39 /var/log/messages 20:15:13 | |
| Jul 4 20:49:21 dev-ingress01 pkg[66393]: python39-3.9.13 installed |
We have 269 commits to catch up on:
[dev-ingress01 dan ~ingress/message-queues] % ls incoming | wc -l
269
[dev-ingress01 dan ~ingress/message-queues] % sudo service freshports start 13:21:17
Starting freshports.
*** /var/log/freshports/freshports-daemon.log ***
Jul 9 13:21:58 dev-ingress01 freshports[53578]: starting up!
Jul 9 13:21:58 dev-ingress01 freshports[53578]: incoming: /var/db/ingress/message-queues/incoming
Jul 9 13:21:58 dev-ingress01 freshports[53578]: recent: /var/db/freshports/message-queues/recent
Jul 9 13:21:58 dev-ingress01 freshports[53578]: retry: /var/db/freshports/message-queues/retry
Jul 9 13:21:58 dev-ingress01 freshports[53578]: ready
Jul 9 13:21:58 dev-ingress01 freshports[53578]: found stuff in /var/db/ingress/message-queues/incoming
Jul 9 13:21:58 dev-ingress01 freshports[53578]: processing /var/db/ingress/message-queues/incoming/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.xml
Jul 9 13:21:58 dev-ingress01 freshports[53578]: loading that XML into the database via load_xml_into_db.pl
Jul 9 13:21:58 dev-ingress01 freshports[53578]: /usr/local/bin/perl /usr/local/libexec/freshports/load_xml_into_db.pl /var/db/ingress/message-queues/incoming/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.xml /var/db/freshports/message-queues/recent/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.log /var/db/freshports/message-queues/recent/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.errors
Jul 9 13:22:13 dev-ingress01 freshports[53578]: XML loading finished
Jul 9 13:22:13 dev-ingress01 freshports[53578]: result=0
Jul 9 13:22:13 dev-ingress01 freshports[53578]: drwxrwxr-x 2 freshports freshports 2 Jul 6 00:05 /var/db/freshports/message-queues/incoming/
Jul 9 13:22:13 dev-ingress01 freshports[53578]: drwxrwxr-x 2 freshports freshports 3520 Jul 9 13:22 /var/db/freshports/message-queues/recent/
Jul 9 13:22:13 dev-ingress01 freshports[53578]: -rw-rw-r-- 1 ingress freshports 899 Jul 9 13:18 /var/db/ingress/message-queues/incoming/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.xml
Jul 9 13:22:13 dev-ingress01 freshports[53578]: removing /var/db/ingress/message-queues/incoming/2022.07.07.19.52.07.000000.838ec5ce701c7d3ae022cce30dabe92a76ea1fd9.xml
Jul 9 13:22:13 dev-ingress01 freshports[53578]: removal completed
Jul 9 13:22:13 dev-ingress01 freshports[53578]: yes, there is a job waiting
*** /var/log/freshports/freshports.log ***
Jul 9 13:22:14 dev-ingress01 FreshPorts[54525]: running job-waiting.pl
Jul 9 13:22:14 dev-ingress01 FreshPorts[54525]: starting ./job-waiting.pl (/usr/local/libexec/freshports)
Jul 9 13:22:14 dev-ingress01 FreshPorts[54525]: running ./job-waiting.pl as user = 'freshports' (/usr/local/libexec/freshports)
Jul 9 13:22:14 dev-ingress01 FreshPorts[54525]: checking jobs for freshports (/usr/local/libexec/freshports)
Jul 9 13:22:14 dev-ingress01 FreshPorts[54525]: flag '/var/db/freshports/signals/ports_to_refresh' not set. no work for refresh-ports.sh (/usr/local/libexec/freshports)
Jul 9 13:22:14 dev-ingress01 FreshPorts[54525]: flag '/var/db/freshports/signals/refresh_moved' not set. no work for process_moved.sh (/usr/local/libexec/freshports)
Jul 9 13:22:14 dev-ingress01 FreshPorts[54525]: flag '/var/db/freshports/signals/new_repo_imported' not set. no work for UpdatePackagesFromRawPackages.py (/usr/local/libexec/freshports)
Jul 9 13:22:14 dev-ingress01 FreshPorts[54525]: flag '/var/db/freshports/signals/refresh_updating' not set. no work for process_updating.sh (/usr/local/libexec/freshports)
Jul 9 13:22:14 dev-ingress01 FreshPorts[54525]: /var/db/freshports/signals/new_repo_ready_for_import exists. About to run import_packagesite.py (/usr/local/libexec/freshports)
Jul 9 13:22:14 dev-ingress01 import_packagesite.py[54530]: Starting up
Jul 9 13:22:14 dev-ingress01 import_packagesite.py[54530]: we have 1 repos to process
Jul 9 13:22:14 dev-ingress01 import_packagesite.py[54530]: importing FreeBSD:12:i386/quarterly
Jul 9 13:22:14 dev-ingress01 import_packagesite.py[54530]: command is: /usr/local/libexec/freshports/fetch-extract-parse-import-one-abi.sh FreeBSD:12:i386 quarterly
Jul 9 13:22:14 dev-ingress01 fetch-extract-parse-import-one-abi.sh[54532]: starting /usr/local/libexec/freshports/fetch-extract-parse-import-one-abi.sh
Jul 9 13:22:17 dev-ingress01 import-via-copy-packagesite-all-raw-fields.py[54564]: Starting up
Jul 9 13:22:17 dev-ingress01 syslogd: last message repeated 1 times
Jul 9 13:22:17 dev-ingress01 import-via-copy-packagesite-all-raw-fields.py[54564]: copying in from packagesite.tsv
...
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
And with the new code, we have commits to process: