lalyos

UJJERO

Decemberi nyitva tartás:

• dec. 20. - zárva
• dec. 21. - zárva
• dec. 22. - 12-22
• dec. 23. - 15-23
• dec. 24. - zárva
• dec. 25. - zárva

lalyos

Ambari uses a local postgres db by default.This page describes how to use ambari-server with remote postgres server.

Install

Ambari is installed on centos 6.4 with the following command:

curl -so /etc/yum.repos.d/ambari.repo http://public-repo-1.hortonworks.com/ambari/centos6/1.x/GA/ambari.repo
yum repolist
yum -y install ambari-server

lalyos

<ivysettings>
  <settings defaultResolver="downloadGrapes"/>
  <resolvers>
    <chain name="downloadGrapes">
      <filesystem name="cachedGrapes">
        <ivy pattern="${user.home}/.groovy/grapes/[organisation]/[module]/ivy-[revision].xml"/>
        <artifact pattern="${user.home}/.groovy/grapes/[organisation]/[module]/[type]s/[artifact]-[revision].[ext]"/>
      </filesystem>
      <!-- todo add 'endorsed groovy extensions' resolver here -->
      <ibiblio name="codehaus" root="http://repository.codehaus.org/" m2compatible="true"/>

lalyos

Putting wings on the Elephant

[operating-hadoop]

HBase is used widely at Facebook and one of the biggest usecase is Facebook Messages. With a billion users there are a lot of reliability and performance challenges on both HBase and HDFS. HDFS was originally designed for a batch processing system like MapReduce/Hive. A realtime usecase like Facebook Messages where the p99 latency can`t be more than a couple hundreds of milliseconds poses a lot of challenges for HDFS. In this talk we will share the work the HDFS team at Facebook has done to support a realtime usecase like Facebook Messages : (1) Using system calls to tune performance; (2) Inline checksums to reduce iops by 40%; (3) Reducing the p99 for read and write latencies by about 10x; (4) Tools used to determine root cause of outliers. We will discuss the details of each technique, the challenges we faced, lessons learned and results showing the impact of each improvement.

speaker: Pritam Damania

Real-Time Market Basket Analysis for Retail with

lalyos

[
  {
    "description": "HBase is used widely at Facebook and one of the biggest usecase is Facebook Messages. With a billion users there are a lot of reliability and performance challenges on both HBase and HDFS. HDFS was originally designed for a batch processing system like MapReduce/Hive. A realtime usecase like Facebook Messages where the p99 latency can`t be more than a couple hundreds of milliseconds poses a lot of challenges for HDFS. In this talk we will share the work the HDFS team at Facebook has done to support a realtime usecase like Facebook Messages : (1) Using system calls to tune performance; (2) Inline checksums to reduce iops by 40%; (3) Reducing the p99 for read and write latencies by about 10x; (4) Tools used to determine root cause of outliers. We will discuss the details of each technique, the challenges we faced, lessons learned and results showing the impact of each improvement.",
    "speaker": "Pritam Damania",
    "title": "Putting wings on the Elephant",
    "type": "operating-ha

lalyos

cp /etc/hosts /tmp/hosts
#vi /tmp/hosts
mkdir -p -- /lib-override && cp /lib64/libnss_files.so.2 /lib-override

sed -i.bak 's:/etc/hosts:/tmp/hosts:g' /lib-override/libnss_files.so.2
export LD_LIBRARY_PATH=/lib-override

lalyos

INFO 2014-03-14 09:38:52,505 main.py:83 - loglevel=logging.INFO
INFO 2014-03-14 09:38:52,505 DataCleaner.py:36 - Data cleanup thread started
INFO 2014-03-14 09:38:52,506 DataCleaner.py:71 - Data cleanup started
INFO 2014-03-14 09:38:52,507 DataCleaner.py:73 - Data cleanup finished
INFO 2014-03-14 09:38:52,508 PingPortListener.py:48 - Ping port listener started on port: 8670
INFO 2014-03-14 09:38:52,508 main.py:218 - Connecting to the server at: https://ambari.vmati.com:8440
INFO 2014-03-14 09:38:52,508 NetUtil.py:65 - DEBUG: Trying to connect to the server at https://ambari.vmati.com:8440
INFO 2014-03-14 09:38:52,508 NetUtil.py:41 - Connecting to the following url https://ambari.vmati.com:8440/cert/ca
INFO 2014-03-14 09:38:52,579 NetUtil.py:48 - Calling url received 200
INFO 2014-03-14 09:38:54,694 HostCheckReportFileHandler.py:43 - Host check report at /var/lib/ambari-agent/data/hostcheck.result

lalyos

netstat -na|grep LISTE|grep -v "127.0.0.1"|sed -n "/0.0.0.0\|:::/  {s/^[^:]*:*//; s/ .*//p}"|xargs echo

lalyos

FROM tianon/centos
MAINTAINER SequenceIQ

# install dev tools
RUN yum install -y openssh-server openssh-clients 

# passwordless ssh
RUN ssh-keygen -q -N "" -t dsa -f /etc/ssh/ssh_host_dsa_key
RUN ssh-keygen -q -N "" -t rsa -f /etc/ssh/ssh_host_rsa_key
RUN ssh-keygen -q -N "" -t rsa -f /root/.ssh/id_rsa

lalyos

[defaults]
hostfile = ~/.ansible.hosts

[ssh_connection]
#ssh_args =