Skip to content

Instantly share code, notes, and snippets.

@iandow
Created February 22, 2019 21:50
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save iandow/8236b9789d17c6788a572e04369f28f1 to your computer and use it in GitHub Desktop.
Save iandow/8236b9789d17c6788a572e04369f28f1 to your computer and use it in GitHub Desktop.
[Feb 22, 2019 1:49:45 PM]: Integration test for 'Connection' started.
[Feb 22, 2019 1:49:45 PM]: Using Radoop version 9.1.0.
[Feb 22, 2019 1:49:45 PM]: Running 8 tests: [Fetch dynamic settings, NameNode networking, DataNode networking, YARN services networking, MapReduce, HDFS upload, Radoop jar upload, Import job]
[Feb 22, 2019 1:49:45 PM]: Running test 1/8: Fetch dynamic settings
[Feb 22, 2019 1:49:45 PM]: Retrieving required configuration properties...
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: hive.execution.engine
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: yarn.resourcemanager.scheduler.address
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: yarn.resourcemanager.resource-tracker.address
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: yarn.resourcemanager.admin.address
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: yarn.app.mapreduce.am.staging-dir
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: mapreduce.jobhistory.done-dir
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: mapreduce.jobhistory.intermediate-done-dir
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: yarn.scheduler.maximum-allocation-mb
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: yarn.scheduler.maximum-allocation-vcores
[Feb 22, 2019 1:49:45 PM]: Could not fetch property dfs.user.home.dir.prefix
[Feb 22, 2019 1:49:45 PM]: Could not fetch property mapreduce.application.classpath
[Feb 22, 2019 1:49:45 PM]: Could not fetch property dfs.replication
[Feb 22, 2019 1:49:45 PM]: Could not fetch property dfs.client.use.datanode.hostname
[Feb 22, 2019 1:49:45 PM]: Could not fetch property dfs.encryption.key.provider.uri
[Feb 22, 2019 1:49:45 PM]: Could not fetch property spark.executor.memory
[Feb 22, 2019 1:49:45 PM]: Could not fetch property spark.executor.cores
[Feb 22, 2019 1:49:45 PM]: Could not fetch property spark.driver.memory
[Feb 22, 2019 1:49:45 PM]: Could not fetch property spark.driver.cores
[Feb 22, 2019 1:49:45 PM]: Could not fetch property spark.yarn.executor.memoryOverhead
[Feb 22, 2019 1:49:45 PM]: Could not fetch property spark.yarn.driver.memoryOverhead
[Feb 22, 2019 1:49:45 PM]: Could not fetch property spark.dynamicAllocation.enabled
[Feb 22, 2019 1:49:45 PM]: Could not fetch property spark.dynamicAllocation.initialExecutors
[Feb 22, 2019 1:49:45 PM]: Could not fetch property spark.dynamicAllocation.minExecutors
[Feb 22, 2019 1:49:45 PM]: Could not fetch property spark.dynamicAllocation.maxExecutors
[Feb 22, 2019 1:49:45 PM]: Could not fetch property spark.executor.instances
[Feb 22, 2019 1:49:45 PM]: Could not fetch property tez.am.container.reuse.enabled
[Feb 22, 2019 1:49:45 PM]: Could not fetch property tez.am.resource.cpu.vcores
[Feb 22, 2019 1:49:45 PM]: Could not fetch property tez.am.resource.memory.mb
[Feb 22, 2019 1:49:45 PM]: Could not fetch property tez.task.resource.cpu.vcores
[Feb 22, 2019 1:49:45 PM]: Could not fetch property tez.task.resource.memory.mb
[Feb 22, 2019 1:49:45 PM]: Could not fetch property tez.am.session.min.held-containers
[Feb 22, 2019 1:49:45 PM]: Could not fetch property tez.session.am.dag.submit.timeout.secs
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: hive.tez.container.size
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: hive.tez.cpu.vcores
[Feb 22, 2019 1:49:45 PM]: Could not fetch property hive.server2.tez.default.queues
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: hive.server2.tez.sessions.per.default.queue
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: hive.prewarm.enabled
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: hive.prewarm.numcontainers
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: mapreduce.map.cpu.vcores
[Feb 22, 2019 1:49:45 PM]: Successfully fetched property: mapreduce.map.memory.mb
[Feb 22, 2019 1:49:45 PM]: Test succeeded: Fetch dynamic settings (0.144s)
[Feb 22, 2019 1:49:45 PM]: Running test 2/8: NameNode networking
[Feb 22, 2019 1:49:45 PM]: Test succeeded: NameNode networking (0.037s)
[Feb 22, 2019 1:49:45 PM]: Running test 3/8: DataNode networking
[Feb 22, 2019 1:49:45 PM]: Test succeeded: DataNode networking (0.004s)
[Feb 22, 2019 1:49:45 PM]: Running test 4/8: YARN services networking
[Feb 22, 2019 1:49:45 PM] WARNING: Retrieving Resource Manager addresses failed. Please check the Advanced Hadoop Parameters in your connection entry. Resource Manager network test skipped.
[Feb 22, 2019 1:49:45 PM] WARNING: JobHistoryServer address cannot be determined. Please check the mapreduce.jobhistory.address property in your cluster configuration.
[Feb 22, 2019 1:49:45 PM] WARNING: Test finished with warnings: YARN services networking (0.001s)
[Feb 22, 2019 1:49:45 PM]: Running test 5/8: MapReduce
[Feb 22, 2019 1:50:15 PM] SEVERE: Test failed: MapReduce
[Feb 22, 2019 1:50:15 PM]: Cleaning after test: MapReduce
[Feb 22, 2019 1:50:15 PM]: Cleaning after test: YARN services networking
[Feb 22, 2019 1:50:15 PM]: Cleaning after test: DataNode networking
[Feb 22, 2019 1:50:15 PM]: Cleaning after test: NameNode networking
[Feb 22, 2019 1:50:15 PM]: Cleaning after test: Fetch dynamic settings
[Feb 22, 2019 1:50:15 PM]: Total time: 30.204s
[Feb 22, 2019 1:50:15 PM] SEVERE: java.util.concurrent.TimeoutException
[Feb 22, 2019 1:50:15 PM] SEVERE: MapReduce test timed out. Please check that the ResourceManager is accessible on the address and port you specified.
[Feb 22, 2019 1:50:15 PM] SEVERE: Test failed: MapReduce
[Feb 22, 2019 1:50:15 PM] SEVERE: Integration test for 'Connection' failed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment