Thrift

The key was to piece together steps from the following two pages:

Thrift API and Hbase.thrift file can be found here
http://wiki.apache.org/hadoop/Hbase/ThriftApi

Download the latest thrift*.tar.gz from http://thrift.apache.org/download/

sudo apt-get install libboost-dev

tar -zxvf thrift*.tar.gz

cd thrift*

./configure

make

cd compiler/cpp

./thrift -gen erl Hbase.thrift

Take all the files in the gen-erl directory and copy them to your application’s /src.
Copy the thrift erlang client files from thrift*/lib/erl to your application or copy/symlink to $ERL_LIB

Can connect using either approach:

{ok, TFactory} = thrift_socket_transport:new_transport_factory("localhost", 9090, []).

{ok, PFactory} = thrift_binary_protocol:new_protocol_factory(TFactory, []).

{ok, Protocol} = PFactory().

{ok, C0} = thrift_client:new(Protocol, hbase_thrift).

Or by using the utility, need to investigate the difference

1	`{ok,` `C0} =` `thrift_client_util:new("localhost", 9090, hbase_thrift, []).`

Basic CRUD commands

% Load records into the shell

rr(hbase_types).

% Get a list of tables

{C1, Tables} = thrift_client:call(C0, getTableNames, []).

% Create a table

{C2, _Result} = thrift_client:call(C1, createTable, ["test", [#columnDescriptor{name="test_col:"}]]).

% Insert a column value

% TODO: Investigate the attributes dictionary's purpose

{C3, _Result} = thrift_client:call(C2, mutateRow, ["test", "key1", [#mutation{isDelete=false,column="test_col:", value="wooo"}], dict:new()]).

% Delete

{C4, _Result} = thrift_client:call(C3, mutateRow, ["test", "key1", [#mutation{isDelete=true}], dict:new()]).

% Get data

% TODO: Investigate the attributes dictionary's purpose

thrift_client:call(C4, getRow, ["test", "key1", dict:new()]).

Due to my newest project I built a php client to access the HBase and Hive services within a hadoop cluster.

Those services are accessible via thrift a high performance protocol for back end services.

As building a client with thrift is not that easy I decided to put my HBase and Hive php thrift client packages online for others.

Links:
Hadoop
Hive
HBase
Thrift

How it works

Start the HBase and Hive Thrift server via shell:

1 2	hive—service hiveserver /usr/lib/hbase/bin/hbase–daemon.shstart thrift

Download HBase and Thrift php client package and write your own client:

//thrift php

$GLOBALS[‘THRIFT_ROOT’]=dirname(__FILE__).‘/thrift/src’;

require_once($GLOBALS[‘THRIFT_ROOT’].‘/Thrift.php’);

require_once($GLOBALS[‘THRIFT_ROOT’].‘/transport/TSocket.php’);

require_once($GLOBALS[‘THRIFT_ROOT’].‘/transport/TBufferedTransport.php’);

require_once($GLOBALS[‘THRIFT_ROOT’].‘/protocol/TBinaryProtocol.php’);

//hbase thrift

require_oncedirname(__FILE__).‘/thrift/Hbase.php’;

//hive thrift

require_oncedirname(__FILE__).‘/thrift/ThriftHive.php’;

HBase php thrift client

//open connection

$socket=newTSocket(‘localhost’,9090);

$transport=newTBufferedTransport($socket);

$protocol=newTBinaryProtocol($transport);

$client=newHbaseClient($protocol);

$transport->open();

//show all tables

$tables=$client->getTableNames();

foreach($tablesas$name){

echo(” found: {$name}\n”);

}

//Create a table

try{

$columns=array(newColumnDescriptor(array(

‘name’=>;‘colFamily:’,

‘maxVersions’=>10)));

$client->createTable(“tableName”,$columns);

}catch(AlreadyExists$ae){

echo(“WARN: {$ae->;message}\n”);

}

//insert data to table

$mutations=array(

newMutation(array(

‘column’=>‘colFamily:Col’,

‘value’=>‘value123’

)),

);

$client->mutateRow(“tableName”,“ID_1237846634624”,$mutations);

//get table data

$row=$client->getRow(“tableName”,“ID_1237846634624”);

Hive php thrift client

//open connection

$transport=newTSocket(“localhost”,10000);

$protocol=newTBinaryProtocol($transport);

$client=newThriftHiveClient($protocol);

$transport->open();

//show tables

$client->execute(‘SHOW TABLES’);

$tables=$client->fetchAll();

foreach($tablesas$name){

echo(” found: {$name}\n”);

}

//Create Hive table with Hbase table mapping

$mapping=‘CREATE EXTERNAL TABLE tableName(Col String, Col1 String)

STORED BY \’org.apache.hadoop.hive.hbase.HBaseStorageHandler\’

WITH SERDEPROPERTIES (“hbase.columns.mapping” = “colFamily:Col, colFamily:Col”)

TBLPROPERTIES(“hbase.table.name” = “tableName”)’;

$client->execute($mapping);

//Query table

$client->execute(‘SELECT * FROM tableName Limit 10’);

var_dump($client->fetchAll());

Thrift

Connecting to HBase from Erlang using Thrift

HBase and Hive Thrift PHP Client