I have some question on spark.
I'm running an example using this command:
./bin/run-example org.apache.spart.examples.SparkPi local[3]
Spark Command: /usr/lib/jvm/java-7-openjdk-amd64/bin/java -cp /usr/local/spark/spark-1.6.2-bin-hadoop2.6/conf/:/usr/local/spark/spark-1.6.2-bin-hadoop2.6/lib/spark-assembly-1.6.2-hadoop2.6.0.jar:/usr/local/spark/spark-1.6.2-bin-hadoop2.6/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/spark-1.6.2-bin-hadoop2.6/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/spark-1.6.2-bin-hadoop2.6/lib/datanucleus-core-3.2.10.jar:/usr/local/hadoop-2.6.0/etc/hadoop/ -Xms1g -Xmx1g -XX:MaxPermSize=256m org.apache.spark.deploy.master.Master --ip Kirai --port 7077 --webui-port 8080
========================================
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
16/07/11 17:54:12 INFO Master: Registered signal handlers for [TERM, HUP, INT]
16/07/11 17:54:13 WARN Utils: Your hostname, Kirai resolves to a loopback address: 127.0.1.1; using 172.18.5.42 instead (on interface wlan0)
16/07/11 17:54:13 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address
16/07/11 17:54:14 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
16/07/11 17:54:14 INFO SecurityManager: Changing view acls to: kirai
16/07/11 17:54:14 INFO SecurityManager: Changing modify acls to: kirai
16/07/11 17:54:14 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(kirai); users with modify permissions: Set(kirai)
16/07/11 17:54:15 INFO Utils: Successfully started service 'sparkMaster' on port 7077.
16/07/11 17:54:16 INFO Master: Starting Spark master at spark://Kirai:7077
16/07/11 17:54:16 INFO Master: Running Spark version 1.6.2
16/07/11 17:54:16 INFO Utils: Successfully started service 'MasterUI' on port 8080.
16/07/11 17:54:16 INFO MasterWebUI: Started MasterWebUI at http://172.18.5.42:8080
16/07/11 17:54:16 INFO Utils: Successfully started service on port 6066.
16/07/11 17:54:16 INFO StandaloneRestServer: Started REST server for submitting applications on port 6066
16/07/11 17:54:16 INFO Master: I have been elected leader! New state: ALIVE
16/07/11 17:54:16 INFO Master: Registering worker 172.18.5.42:40967 with 2 cores, 1024.0 MB RAM
16/07/11 17:59:13 INFO Master: localhost:53223 got disassociated, removing it.
16/07/11 17:59:15 INFO Master: localhost:53222 got disassociated, removing it.
16/07/11 18:25:02 ERROR Master: RECEIVED SIGNAL 15: SIGTERM
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
so,What's your question?