Skip to content

Instantly share code, notes, and snippets.

@acozine

acozine/stdout Secret

Created July 15, 2016 19:25
Show Gist options
  • Save acozine/d82b19e0bc53a84a056cc31142a742bc to your computer and use it in GitHub Desktop.
Save acozine/d82b19e0bc53a84a056cc31142a742bc to your computer and use it in GitHub Desktop.
Download ZIP
Solr systemctl/service issue
Raw
stdout
TASK [deploy : restart solr 5.x] ***********************************************
fatal: [23.23.8.207]: FAILED! => {"changed": false, "failed": true, "msg": "Job for solr.service failed because the control process exited with error code. See \"systemctl status solr.service\" and \"journalctl -xe\" for details.\n"}
NO MORE HOSTS LEFT *************************************************************
to retry, use: --limit @demo-centos.retry
PLAY RECAP *********************************************************************
23.23.8.207 : ok=203 changed=160 unreachable=0 failed=1
54.243.63.198 : ok=0 changed=0 unreachable=1 failed=0
localhost : ok=6 changed=4 unreachable=0 failed=0
[alicia@mymble]~/dev_ops/ansible_projects/ansible-hydra$ ssh centos@23.23.8.207 -i ~/.ssh/sandbox.pem
Last login: Thu Jul 14 11:59:51 2016 from c-73-24-27-90.hsd1.mn.comcast.net
[centos@ip-10-0-0-182 ~]$ sudo service solr status
Found 1 Solr nodes:
Solr process 4924 running on port 8983
{
"solr_home":"/var/solr/data",
"version":"5.5.0 2a228b3920a07f930f7afb6a42d0d20e184a943c - mike - 2016-02-16 15:22:52",
"startTime":"2016-07-14T15:19:19.171Z",
"uptime":"0 days, 0 hours, 45 minutes, 1 seconds",
"memory":"48.5 MB (%9.9) of 490.7 MB"}
[centos@ip-10-0-0-182 ~]$ sudo systemctl status solr
● solr.service - LSB: Controls Apache Solr as a Service
Loaded: loaded (/etc/rc.d/init.d/solr)
Active: failed (Result: exit-code) since Thu 2016-07-14 11:59:51 EDT; 4min 37s ago
Docs: man:systemd-sysv-generator(8)
Process: 27722 ExecStart=/etc/rc.d/init.d/solr start (code=exited, status=1/FAILURE)
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: Starting LSB: Controls Apache Solr as a Service...
Jul 14 11:59:51 ip-10-0-0-182 su[27724]: (to solr) root on none
Jul 14 11:59:51 ip-10-0-0-182 solr[27722]: Port 8983 is already being used by another process (pid: 4924)
Jul 14 11:59:51 ip-10-0-0-182 solr[27722]: Please choose a different port using the -p option.
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: solr.service: control process exited, code=exited status=1
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: Failed to start LSB: Controls Apache Solr as a Service.
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: Unit solr.service entered failed state.
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: solr.service failed.
[centos@ip-10-0-0-182 ~]$ sudo yum install lsof
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
* base: mirror.trouble-free.net
* epel: mirror.us.leaseweb.net
* extras: mirrors.lga7.us.voxel.net
* updates: mirrors.greenmountainaccess.net
Package lsof-4.87-4.el7.x86_64 already installed and latest version
Nothing to do
[centos@ip-10-0-0-182 ~]$ ps aux | grep 8983
solr 4924 0.2 1.4 4128128 215124 ? Sl 11:19 0:06 java -server -Xms512m -Xmx512m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:gc -XX:+PrintHeapAtGC -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -jar start.jar -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs --module=http
centos 28619 0.0 0.0 112652 972 pts/0 S+ 12:04 0:00 grep --color=auto 8983
[centos@ip-10-0-0-182 ~]$ sudo service solr restart
Sending stop command to Solr running on port 8983 ... waiting 5 seconds to allow Jetty process 4924 to stop gracefully.
Waiting up to 30 seconds to see Solr running on port 8983 [/]
Started Solr server on port 8983 (pid=28848). Happy searching!
[centos@ip-10-0-0-182 ~]$ sudo systemctl status solr
● solr.service - LSB: Controls Apache Solr as a Service
Loaded: loaded (/etc/rc.d/init.d/solr)
Active: failed (Result: exit-code) since Thu 2016-07-14 11:59:51 EDT; 5min ago
Docs: man:systemd-sysv-generator(8)
Process: 27722 ExecStart=/etc/rc.d/init.d/solr start (code=exited, status=1/FAILURE)
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: Starting LSB: Controls Apache Solr as a Service...
Jul 14 11:59:51 ip-10-0-0-182 su[27724]: (to solr) root on none
Jul 14 11:59:51 ip-10-0-0-182 solr[27722]: Port 8983 is already being used by another process (pid: 4924)
Jul 14 11:59:51 ip-10-0-0-182 solr[27722]: Please choose a different port using the -p option.
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: solr.service: control process exited, code=exited status=1
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: Failed to start LSB: Controls Apache Solr as a Service.
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: Unit solr.service entered failed state.
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: solr.service failed.
[centos@ip-10-0-0-182 ~]$ ps aux | grep 8983
solr 28848 28.6 1.5 4132516 234680 ? Sl 12:05 0:06 java -server -Xms512m -Xmx512m -XX:NewRatio=3 -XX:SurvivorRatio=4 -XX:TargetSurvivorRatio=90 -XX:MaxTenuringThreshold=8 -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:ConcGCThreads=4 -XX:ParallelGCThreads=4 -XX:+CMSScavengeBeforeRemark -XX:PretenureSizeThreshold=64m -XX:+UseCMSInitiatingOccupancyOnly -XX:CMSInitiatingOccupancyFraction=50 -XX:CMSMaxAbortablePrecleanTime=6000 -XX:+CMSParallelRemarkEnabled -XX:+ParallelRefProcEnabled -verbose:gc -XX:+PrintHeapAtGC -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+PrintTenuringDistribution -XX:+PrintGCApplicationStoppedTime -Xloggc:/var/solr/logs/solr_gc.log -Djetty.port=8983 -DSTOP.PORT=7983 -DSTOP.KEY=solrrocks -Duser.timezone=UTC -Djetty.home=/opt/solr/server -Dsolr.solr.home=/var/solr/data -Dsolr.install.dir=/opt/solr -Dlog4j.configuration=file:/var/solr/log4j.properties -Xss256k -jar start.jar -XX:OnOutOfMemoryError=/opt/solr/bin/oom_solr.sh 8983 /var/solr/logs --module=http
centos 28995 0.0 0.0 112648 976 pts/0 S+ 12:05 0:00 grep --color=auto 8983
[centos@ip-10-0-0-182 ~]$ ps aux | grep 4924
centos 29007 0.0 0.0 112648 972 pts/0 S+ 12:05 0:00 grep --color=auto 4924
[centos@ip-10-0-0-182 ~]$ sudo service solr status
Found 1 Solr nodes:
Solr process 28848 running on port 8983
{
"solr_home":"/var/solr/data",
"version":"5.5.0 2a228b3920a07f930f7afb6a42d0d20e184a943c - mike - 2016-02-16 15:22:52",
"startTime":"2016-07-14T16:05:14.357Z",
"uptime":"0 days, 0 hours, 30 minutes, 4 seconds",
"memory":"57 MB (%11.6) of 490.7 MB"}
[centos@ip-10-0-0-182 ~]$ exit
logout
Connection to 23.23.8.207 closed.
[alicia@mymble]~/dev_ops/ansible_projects/ansible-hydra$ ssh centos@23.23.8.207 -i ~/.ssh/sandbox.pem
Last login: Thu Jul 14 12:04:03 2016 from c-73-24-27-90.hsd1.mn.comcast.net
[centos@ip-10-0-0-182 ~]$ sudo service solr status
Found 1 Solr nodes:
Solr process 28848 running on port 8983
{
"solr_home":"/var/solr/data",
"version":"5.5.0 2a228b3920a07f930f7afb6a42d0d20e184a943c - mike - 2016-02-16 15:22:52",
"startTime":"2016-07-14T16:05:14.357Z",
"uptime":"0 days, 3 hours, 10 minutes, 40 seconds",
"memory":"59.8 MB (%12.2) of 490.7 MB"}
[centos@ip-10-0-0-182 ~]$ sudo systemctl status solr
● solr.service - LSB: Controls Apache Solr as a Service
Loaded: loaded (/etc/rc.d/init.d/solr)
Active: failed (Result: exit-code) since Thu 2016-07-14 11:59:51 EDT; 3h 16min ago
Docs: man:systemd-sysv-generator(8)
Process: 27722 ExecStart=/etc/rc.d/init.d/solr start (code=exited, status=1/FAILURE)
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: Starting LSB: Controls Apache Solr as a Service...
Jul 14 11:59:51 ip-10-0-0-182 su[27724]: (to solr) root on none
Jul 14 11:59:51 ip-10-0-0-182 solr[27722]: Port 8983 is already being used by another process (pid: 4924)
Jul 14 11:59:51 ip-10-0-0-182 solr[27722]: Please choose a different port using the -p option.
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: solr.service: control process exited, code=exited status=1
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: Failed to start LSB: Controls Apache Solr as a Service.
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: Unit solr.service entered failed state.
Jul 14 11:59:51 ip-10-0-0-182 systemd[1]: solr.service failed.
[centos@ip-10-0-0-182 ~]$ sudo systemctl restart solr
Job for solr.service failed because the control process exited with error code. See "systemctl status solr.service" and "journalctl -xe" for details.
[centos@ip-10-0-0-182 ~]$ sudo systemctl stop solr
[centos@ip-10-0-0-182 ~]$ sudo systemctl status solr
● solr.service - LSB: Controls Apache Solr as a Service
Loaded: loaded (/etc/rc.d/init.d/solr)
Active: failed (Result: exit-code) since Thu 2016-07-14 15:16:14 EDT; 17s ago
Docs: man:systemd-sysv-generator(8)
Process: 20994 ExecStart=/etc/rc.d/init.d/solr start (code=exited, status=1/FAILURE)
Jul 14 15:16:13 ip-10-0-0-182 systemd[1]: Starting LSB: Controls Apache Solr as a Service...
Jul 14 15:16:13 ip-10-0-0-182 su[20996]: (to solr) root on none
Jul 14 15:16:14 ip-10-0-0-182 solr[20994]: Port 8983 is already being used by another process (pid: 28848)
Jul 14 15:16:14 ip-10-0-0-182 solr[20994]: Please choose a different port using the -p option.
Jul 14 15:16:14 ip-10-0-0-182 systemd[1]: solr.service: control process exited, code=exited status=1
Jul 14 15:16:14 ip-10-0-0-182 systemd[1]: Failed to start LSB: Controls Apache Solr as a Service.
Jul 14 15:16:14 ip-10-0-0-182 systemd[1]: Unit solr.service entered failed state.
Jul 14 15:16:14 ip-10-0-0-182 systemd[1]: solr.service failed.
Jul 14 15:16:26 ip-10-0-0-182 systemd[1]: Stopped LSB: Controls Apache Solr as a Service.
[centos@ip-10-0-0-182 ~]$ sudo systemctl start solr
Job for solr.service failed because the control process exited with error code. See "systemctl status solr.service" and "journalctl -xe" for details.
[centos@ip-10-0-0-182 ~]$ sudo service solr status
Found 1 Solr nodes:
Solr process 28848 running on port 8983
{
"solr_home":"/var/solr/data",
"version":"5.5.0 2a228b3920a07f930f7afb6a42d0d20e184a943c - mike - 2016-02-16 15:22:52",
"startTime":"2016-07-14T16:05:14.357Z",
"uptime":"0 days, 3 hours, 11 minutes, 36 seconds",
"memory":"59.8 MB (%12.2) of 490.7 MB"}
[centos@ip-10-0-0-182 ~]$ sudo systemctl solr stop
Unknown operation 'solr'.
[centos@ip-10-0-0-182 ~]$ sudo systemctl stop solr
[centos@ip-10-0-0-182 ~]$ sudo systemctl solr stop
Unknown operation 'solr'.
[centos@ip-10-0-0-182 ~]$ sudo service solr status
Found 1 Solr nodes:
Solr process 28848 running on port 8983
{
"solr_home":"/var/solr/data",
"version":"5.5.0 2a228b3920a07f930f7afb6a42d0d20e184a943c - mike - 2016-02-16 15:22:52",
"startTime":"2016-07-14T16:05:14.357Z",
"uptime":"0 days, 3 hours, 11 minutes, 58 seconds",
"memory":"59.8 MB (%12.2) of 490.7 MB"}
[centos@ip-10-0-0-182 ~]$ sudo service solr stop
Sending stop command to Solr running on port 8983 ... waiting 5 seconds to allow Jetty process 28848 to stop gracefully.
[centos@ip-10-0-0-182 ~]$ sudo service solr status
No Solr nodes are running.
[centos@ip-10-0-0-182 ~]$ sudo systemctl status solr
● solr.service - LSB: Controls Apache Solr as a Service
Loaded: loaded (/etc/rc.d/init.d/solr)
Active: failed (Result: exit-code) since Thu 2016-07-14 15:16:39 EDT; 57s ago
Docs: man:systemd-sysv-generator(8)
Process: 21107 ExecStart=/etc/rc.d/init.d/solr start (code=exited, status=1/FAILURE)
Jul 14 15:16:39 ip-10-0-0-182 systemd[1]: Starting LSB: Controls Apache Solr as a Service...
Jul 14 15:16:39 ip-10-0-0-182 su[21109]: (to solr) root on none
Jul 14 15:16:39 ip-10-0-0-182 solr[21107]: Port 8983 is already being used by another process (pid: 28848)
Jul 14 15:16:39 ip-10-0-0-182 solr[21107]: Please choose a different port using the -p option.
Jul 14 15:16:39 ip-10-0-0-182 systemd[1]: solr.service: control process exited, code=exited status=1
Jul 14 15:16:39 ip-10-0-0-182 systemd[1]: Failed to start LSB: Controls Apache Solr as a Service.
Jul 14 15:16:39 ip-10-0-0-182 systemd[1]: Unit solr.service entered failed state.
Jul 14 15:16:39 ip-10-0-0-182 systemd[1]: solr.service failed.
Jul 14 15:17:06 ip-10-0-0-182 systemd[1]: Stopped LSB: Controls Apache Solr as a Service.
[centos@ip-10-0-0-182 ~]$ sudo systemctl start solr
[centos@ip-10-0-0-182 ~]$ sudo systemctl status solr
● solr.service - LSB: Controls Apache Solr as a Service
Loaded: loaded (/etc/rc.d/init.d/solr)
Active: active (exited) since Thu 2016-07-14 15:17:51 EDT; 2s ago
Docs: man:systemd-sysv-generator(8)
Process: 21659 ExecStart=/etc/rc.d/init.d/solr start (code=exited, status=0/SUCCESS)
Jul 14 15:17:46 ip-10-0-0-182 systemd[1]: Starting LSB: Controls Apache Solr as a Service...
Jul 14 15:17:46 ip-10-0-0-182 su[21661]: (to solr) root on none
Jul 14 15:17:51 ip-10-0-0-182 solr[21659]: [169B blob data]
Jul 14 15:17:51 ip-10-0-0-182 solr[21659]: Started Solr server on port 8983 (pid=21731). Happy searching!
Jul 14 15:17:51 ip-10-0-0-182 solr[21659]: [14B blob data]
Jul 14 15:17:51 ip-10-0-0-182 systemd[1]: Started LSB: Controls Apache Solr as a Service.
[centos@ip-10-0-0-182 ~]$ sudo service solr status
Found 1 Solr nodes:
Solr process 21731 running on port 8983
{
"solr_home":"/var/solr/data",
"version":"5.5.0 2a228b3920a07f930f7afb6a42d0d20e184a943c - mike - 2016-02-16 15:22:52",
"startTime":"2016-07-14T19:17:46.302Z",
"uptime":"0 days, 0 hours, 0 minutes, 15 seconds",
"memory":"46.6 MB (%9.5) of 490.7 MB"}
[centos@ip-10-0-0-182 ~]$ sudo service solr restart
Sending stop command to Solr running on port 8983 ... waiting 5 seconds to allow Jetty process 21731 to stop gracefully.
Waiting up to 30 seconds to see Solr running on port 8983 [/]
Started Solr server on port 8983 (pid=22337). Happy searching!
[centos@ip-10-0-0-182 ~]$ sudo systemctl status solr
● solr.service - LSB: Controls Apache Solr as a Service
Loaded: loaded (/etc/rc.d/init.d/solr)
Active: active (exited) since Thu 2016-07-14 15:17:51 EDT; 2min 4s ago
Docs: man:systemd-sysv-generator(8)
Process: 21659 ExecStart=/etc/rc.d/init.d/solr start (code=exited, status=0/SUCCESS)
Jul 14 15:17:46 ip-10-0-0-182 systemd[1]: Starting LSB: Controls Apache Solr as a Service...
Jul 14 15:17:46 ip-10-0-0-182 su[21661]: (to solr) root on none
Jul 14 15:17:51 ip-10-0-0-182 solr[21659]: [169B blob data]
Jul 14 15:17:51 ip-10-0-0-182 solr[21659]: Started Solr server on port 8983 (pid=21731). Happy searching!
Jul 14 15:17:51 ip-10-0-0-182 solr[21659]: [14B blob data]
Jul 14 15:17:51 ip-10-0-0-182 systemd[1]: Started LSB: Controls Apache Solr as a Service.
[centos@ip-10-0-0-182 ~]$ sudo systemctl restart solr
[centos@ip-10-0-0-182 ~]$ sudo systemctl status solr
● solr.service - LSB: Controls Apache Solr as a Service
Loaded: loaded (/etc/rc.d/init.d/solr)
Active: active (exited) since Thu 2016-07-14 15:20:33 EDT; 2s ago
Docs: man:systemd-sysv-generator(8)
Process: 22524 ExecStop=/etc/rc.d/init.d/solr stop (code=exited, status=0/SUCCESS)
Process: 22665 ExecStart=/etc/rc.d/init.d/solr start (code=exited, status=0/SUCCESS)
Jul 14 15:20:27 ip-10-0-0-182 systemd[1]: Starting LSB: Controls Apache Solr as a Service...
Jul 14 15:20:27 ip-10-0-0-182 su[22668]: (to solr) root on none
Jul 14 15:20:32 ip-10-0-0-182 solr[22665]: [169B blob data]
Jul 14 15:20:32 ip-10-0-0-182 solr[22665]: Started Solr server on port 8983 (pid=22738). Happy searching!
Jul 14 15:20:33 ip-10-0-0-182 solr[22665]: [14B blob data]
Jul 14 15:20:33 ip-10-0-0-182 systemd[1]: Started LSB: Controls Apache Solr as a Service.
[centos@ip-10-0-0-182 ~]$ sudo service solr status
Found 1 Solr nodes:
Solr process 22738 running on port 8983
{
"solr_home":"/var/solr/data",
"version":"5.5.0 2a228b3920a07f930f7afb6a42d0d20e184a943c - mike - 2016-02-16 15:22:52",
"startTime":"2016-07-14T19:20:27.982Z",
"uptime":"0 days, 0 hours, 0 minutes, 16 seconds",
"memory":"46.3 MB (%9.4) of 490.7 MB"}
[centos@ip-10-0-0-182 ~]$ exit
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment