mlongob

%7|1585687171.363|MEMBERID|my-consumer#consumer-1| [thrd:app]: Group "mygroup": updating member id "(not-set)" -> ""
%7|1585687171.363|BROKER|my-consumer#consumer-1| [thrd:app]: GroupCoordinator: Added new broker with NodeId -1
%7|1585687171.363|BRKMAIN|my-consumer#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator: Enter main broker thread
%7|1585687171.363|BRKMAIN|my-consumer#consumer-1| [thrd::0/internal]: :0/internal: Enter main broker thread
%7|1585687171.364|BROKER|my-consumer#consumer-1| [thrd:app]: mybroker:9092/bootstrap: Added new broker with NodeId -1
%7|1585687171.364|BRKMAIN|my-consumer#consumer-1| [thrd:mybroker:9092/boots]: mybroker:9092/bootstrap: Enter main broker thread
%7|1585687171.364|INIT|my-consumer#consumer-1| [thrd:app]: librdkafka v1.3.0 (0x10300ff) my-consumer#consumer-1 initialized (builtin.features gzip,snappy,ssl,sasl,regex,lz4,sasl_plain,sasl_scram,plugins,zstd,sasl_oauthbearer, CC CXX INSTALL GNULD LDS LIBDL PLUGINS ZLIB SSL ZSTD HDRHISTOGRAM LZ4_EXT SNAPPY SOCKEM SASL_SCRAM

mlongob

Introduction

This is a proposed procedure for Hbase table backups in a secure Hbase cluster. Requirements:

• Live backups (cannot disable table or take hbase offline)
• Automated procedure (oozie controlled)
• On secure cluster
• On cluster with no world-readable /hbase folder
• Off cluster backups
• Off cluster backup location might not have an installed instance of Hbase, just HDFS
• Off cluster backup location does not have credentials for hbase user

mlongob

Strata Hadoop NYC 2015

Schedule

Keynotes

The next generation - Kudu:

• Kudu
• Kudu fills the gap between HDFS and Hbase for live analytics (time series, high ingest)

What 0-50 million users in 7 days can teach us about big data:

• Microsoft's Joseph Sirosh