Skip to content

Instantly share code, notes, and snippets.

View xunzhang's full-sized avatar
🗝️
勋章

Hong Wu xunzhang

🗝️
勋章
View GitHub Profile

External Storage Usage: from users' perspective

I. External Tables in HAWQ

  • Gpfdist: parallel http implementation of http transmitting | readable or writable

    • Usage

        # start gpfist service in external storage server
        gpfdist -p 8081 -d /var/data/staging -l /home/gpadmin/log &
      

hdfs_fdw,

# install the extension
CREATE EXTENSION hdfs_fdw;

# create a foreign server
CREATE SERVER foreign_server
FOREIGN DATA WRAPPER postgres_fdw

OPTIONS (host='192.83.123.89', port='5432', dbname='foreign_db');

g++ foo.cc -fprofile-arcs -ftest-coverage -lgcov
lcov --directory . --capture --output-file CodeCoverage.info
#include <iostream>
void foo() {
std::cout << "hello world" << std::endl;
}
int main(int argc, char *argv[])
./src/test/feature/parallel-run-feature-test.sh $(sysctl -n hw.ncpu) ./src/test/feature/feature-test
wuhong@pivotal-2:~$ source ~/Desktop/local/greenplum_path.sh
wuhong@pivotal-2:~$ ipython
In [1]: from pygresql import pg
In [2]: from gppylib.db import dbconn
In [3]: url = dbconn.DbURL(dbname='postgres')
In [4]: conn = pg.connect(dbname=url.pgdb, host=url.pghost, port=url.pgport, user=url.pguser, passwd=url.pgpass, opt='-c gp_session_role=utility')
Let’s use this doc to record all the issues found by test cases and the fixing process for it.
Hawq register issues list.
[HAWQ-main-FeatureTest-opt-interconnect](http://pulse-cloud.gopivotal.com/browse/projects/HAWQ-main-FeatureTest-opt-interconnect/builds/468/)
`
2016-11-15 08:17:34.776870 PST,"gpadmin","gpadmin",p26978,th-834582240,"[local]",,2016-11-15 08:17:34 PST,2313,con288,cmd1,seg-10000,,,x2313,sx1,"ERROR","42704","unrecognized configuration parameter ""gp_udpic_fault_inject_percent""",,,,,,"show gp_udpic_fault_inject_percent",0,,"guc.c",11331,
`
`
2016-11-15 08:15:59.878945 PST,"gpadmin","gpadmin",p25560,th-834582240,"[local]",,2016-11-15 06:15:59 PST,2293,con282,cmd3,seg-1,,,x2293,sx1,"ERROR","58M01","Query Executor Error in seg1 test2:5100 pid=40627: server closed the connection unexpectedly","
This probably means the server terminated abnormally
@xunzhang
xunzhang / curand_multi_gpu.c
Created March 14, 2018 16:06
multiple GPU support for curand usage
/* This program uses the host CURAND API to generate 100
* pseudorandom floats.
*/
#include <stdio.h>
#include <stdlib.h>
#include <cuda.h>
#include <curand.h>
#define CUDA_CALL(x) do { if((x) != cudaSuccess) { \
printf("Error at %s:%d\n",__FILE__,__LINE__); \
return EXIT_FAILURE;}} while(0)