Skip to content

Instantly share code, notes, and snippets.

@dos65

dos65/docker mist debug

Created August 25, 2017 20:31
Show Gist options
  • Save dos65/b0c7ad2238971c4f524ffd3ea48d4ef3 to your computer and use it in GitHub Desktop.
Save dos65/b0c7ad2238971c4f524ffd3ea48d4ef3 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
docker mist debug
<---- - ищи вот это как комментарии к кускам логов
1 -----------
запуск мастера:
dos65@holy-excalibur:~/projects/mist$ docker run --net=host hydrosphere/mist:0.13.1-1.5.2 mist
17-08-25 20:24:14 [mist-akka.actor.default-dispatcher-4] INFO akka.event.slf4j.Slf4jLogger:80 Slf4jLogger started
17-08-25 20:24:14 [mist-akka.actor.default-dispatcher-4] INFO Remoting:74 Starting remoting
17-08-25 20:24:14 [mist-akka.actor.default-dispatcher-4] INFO Remoting:74 Remoting started; listening on addresses :[akka.tcp://mist@192.168.1.196:2551] <---- вот тут должен быть правильный публичный адрес мастера - не 0.0.0.0
17-08-25 20:24:14 [mist-akka.actor.default-dispatcher-4] INFO Remoting:74 Remoting now listens on addresses: [akka.tcp://mist@192.168.1.196:2551]
17-08-25 20:24:14 [main] INFO e.internal.util.VersionPrinter:44 Flyway 4.1.1 by Boxfuse
17-08-25 20:24:15 [main] INFO nal.dbsupport.DbSupportFactory:44 Database: jdbc:h2:file:/usr/share/mist/recovery.db (H2 1.4)
17-08-25 20:24:15 [main] INFO re.internal.command.DbValidate:44 Successfully validated 1 migration (execution time 00:00.015s)
17-08-25 20:24:15 [main] INFO etadatatable.MetaDataTableImpl:44 Creating Metadata table: "PUBLIC"."schema_version"
17-08-25 20:24:15 [main] INFO ore.internal.command.DbMigrate:44 Current version of schema "PUBLIC": << Empty Schema >>
17-08-25 20:24:15 [main] INFO ore.internal.command.DbMigrate:44 Migrating schema "PUBLIC" to version 1 - Create job details table
17-08-25 20:24:15 [main] INFO ore.internal.command.DbMigrate:44 Successfully applied 1 migration to schema "PUBLIC" (execution time 00:00.057s).
2 ------------
запуск воркера : правильно указываем бинд-адресс в в параметрах
--bind-address 172.17.0.1:9999 - порт должен быть тот что проксируется, адрес по которому можно достучаться
(у меня это docker network interface, можно просто адрес тачки использовать)
dos65@holy-excalibur:~/projects/mist$ docker run --net=host -p 9999:9999 hydrosphere/mist:0.13.1-1.5.2 bin/mist-worker --name foo --context foo --mode shared --master 192.168.1.196:2551 --bind-address 172.17.0.1:9999
17-08-25 20:26:56 [main] INFO ydrosphere.mist.worker.Worker$:86 Try starting on spark: 1.5.2
17-08-25 20:26:57 [mist-akka.actor.default-dispatcher-3] INFO akka.event.slf4j.Slf4jLogger:80 Slf4jLogger started
17-08-25 20:26:57 [mist-akka.actor.default-dispatcher-3] INFO Remoting:74 Starting remoting
17-08-25 20:26:57 [mist-akka.actor.default-dispatcher-3] INFO Remoting:74 Remoting started; listening on addresses :[akka.tcp://mist@172.17.0.1:9999] <----- смотри что тут тоже правильно забиндилось
17-08-25 20:26:57 [mist-akka.actor.default-dispatcher-3] INFO Remoting:74 Remoting now listens on addresses: [akka.tcp://mist@172.17.0.1:9999]
17-08-25 20:26:58 [main] INFO ydrosphere.mist.worker.Worker$:106 Worker foo is started, context , mode = Shared
17-08-25 20:26:59 [mist-akka.actor.default-dispatcher-3] INFO here.mist.worker.ClusterWorker:74 Joined to cluster. Master akka.tcp://mist@192.168.1.196:2551
17-08-25 20:26:59 [mist-akka.actor.default-dispatcher-14] INFO here.mist.worker.ClusterWorker:74 Received init info WorkerInitInfo(Map(spark.master -> local[*]),20,Duration.Inf,1 second,localhost:2005)
17-08-25 20:27:00 [mist-akka.actor.default-dispatcher-17] WARN e.hadoop.util.NativeCodeLoader:62 Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
17-08-25 20:27:00 [mist-akka.actor.default-dispatcher-17] WARN org.apache.spark.util.Utils:71 Your hostname, holy-excalibur resolves to a loopback address: 127.0.1.1; using 192.168.1.196 instead (on interface wlan0)
17-08-25 20:27:00 [mist-akka.actor.default-dispatcher-17] WARN org.apache.spark.util.Utils:71 Set SPARK_LOCAL_IP if you need to bind to another address
17-08-25 20:27:00 [sparkDriver-akka.actor.default-dispatcher-4] INFO akka.event.slf4j.Slf4jLogger:80 Slf4jLogger started
17-08-25 20:27:00 [sparkDriver-akka.actor.default-dispatcher-5] INFO Remoting:74 Starting remoting
3 -----
если все ок - воркер пойдет регистрироваться в мастер(но он его исключит из кластера и увидим вот такой лог на мастере)
17-08-25 20:27:02 [mist-akka.actor.default-dispatcher-18] INFO ere.mist.master.WorkersManager:74 Received worker registration - WorkerRegistration(foo,akka.tcp://mist@172.17.0.1:9999,Some(http://192.168.1.196:4040))
17-08-25 20:27:02 [mist-akka.actor.default-dispatcher-37] INFO ere.mist.master.WorkersManager:74 Worker resolved - WorkerResolved(foo,akka.tcp://mist@172.17.0.1:9999,Actor[akka.tcp://mist@172.17.0.1:9999/user/worker-foo#-102919873],Some(http://192.168.1.196:4040))
17-08-25 20:27:02 [mist-akka.actor.default-dispatcher-18] WARN ere.mist.master.WorkersManager:71 Received memberResolve from unknown worker foo
17-08-25 20:27:03 [mist-akka.actor.default-dispatcher-2] ERROR akka.remote.EndpointWriter:65 AssociationError [akka.tcp://mist@192.168.1.196:2551] <- [akka.tcp://mist@172.17.0.1:9999]: Error [Shut down address: akka.tcp://mist@172.17.0.1:9999] [
akka.remote.ShutDownAssociation: Shut down address: akka.tcp://mist@172.17.0.1:9999
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment