Robin Moffatt rmoff

## docker-compose.yml
---
version: '2'
services:
  zookeeper:
    image: confluentinc/cp-zookeeper:latest
    environment:
      ZOOKEEPER_CLIENT_PORT: 2181
      ZOOKEEPER_TICK_TIME: 2000

  kafka:

## flink-rmoff-sql-client-asgard08.log
2024-04-15 11:25:36,164 INFO  org.apache.flink.client.program.rest.RestClusterClient       [] - Successfully submitted job 'collect' (926ca3f6cfa9f0a4b5bc7f215b4681eb) to 'http://localhost:8081'.
2024-04-15 11:25:36,256 ERROR org.apache.flink.table.gateway.service.operation.OperationManager [] - Failed to execute the operation a2f854a9-938c-4c57-a484-4abe9d8eeb78.
org.apache.flink.table.api.TableException: Failed to execute sql
	at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeQueryOperation(TableEnvironmentImpl.java:1084) ~[flink-table-api-java-uber-1.18.1.jar:1.18.1]
	at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:1120) ~[flink-table-api-java-uber-1.18.1.jar:1.18.1]
	at org.apache.flink.table.gateway.service.operation.OperationExecutor.executeOperation(OperationExecutor.java:435) ~[flink-sql-gateway-1.18.1.jar:1.18.1]
	at org.apache.flink.table.gateway.service.operation.OperationExecutor.executeStatement(OperationExecutor.java:207) ~[f

## List all available Kafka Connect plugins.md

      
              1 file
            
          
              0 forks
            
          
              4 comments
            
          
              4 stars
            
          
                rmoff
                / List all available Kafka Connect plugins.md
            
            
              Created
              May 18, 2018 14:29
            
              
                List all available Kafka Connect plugins
              
          
    $ curl -s -XGET http://localhost:8083/connector-plugins|jq '.[].class'

"io.confluent.connect.activemq.ActiveMQSourceConnector"
"io.confluent.connect.elasticsearch.ElasticsearchSinkConnector"
"io.confluent.connect.hdfs.HdfsSinkConnector"
"io.confluent.connect.hdfs.tools.SchemaSourceConnector"
"io.confluent.connect.ibm.mq.IbmMQSourceConnector"
"io.confluent.connect.jdbc.JdbcSinkConnector"
"io.confluent.connect.jdbc.JdbcSourceConnector"

"io.confluent.connect.jms.JmsSourceConnector"

  
## docker-compose.yml
---
version: '3.8'
services:
  zookeeper-1:
    image: confluentinc/cp-zookeeper:5.5.1
    ports:
      - '32181:32181'
    environment:
      ZOOKEEPER_CLIENT_PORT: 32181
      ZOOKEEPER_TICK_TIME: 2000

## 0_README.adoc

      
              2 files
            
          
              0 forks
            
          
              0 comments
            
          
              0 stars
            
          
                rmoff
                / 0_README.adoc
            
            
              Last active
              March 8, 2024 15:56
            
          
This is a collection for Postman to access the Apache Flink SQL Gateway. It’s based on the yaml published for version 1.18.1.


I’ve added Tests to set Session and Operation handles, and amended the collection to use these variables.


You need to set a Global Variable for baseURL to your Flink SQL Gateway.


If you launch the gateway locally with:


## iceberg.log
[0.004s][info][class,load] opened: /Users/rmoff/.sdkman/candidates/java/11.0.21-tem/lib/modules
[0.006s][info][class,load] java.lang.Object source: jrt:/java.base
[0.006s][info][class,load] java.io.Serializable source: jrt:/java.base
[0.006s][info][class,load] java.lang.Comparable source: jrt:/java.base
[0.006s][info][class,load] java.lang.CharSequence source: jrt:/java.base
[0.006s][info][class,load] java.lang.String source: jrt:/java.base
[0.006s][info][class,load] java.lang.reflect.AnnotatedElement source: jrt:/java.base
[0.006s][info][class,load] java.lang.reflect.GenericDeclaration source: jrt:/java.base
[0.006s][info][class,load] java.lang.reflect.Type source: jrt:/java.base
[0.006s][info][class,load] java.lang.Class source: jrt:/java.base

## iceberg.log
[0.004s][info][class,load] opened: /Users/rmoff/.sdkman/candidates/java/11.0.21-tem/lib/modules
[0.006s][info][class,load] java.lang.Object source: jrt:/java.base
[0.006s][info][class,load] java.io.Serializable source: jrt:/java.base
[0.006s][info][class,load] java.lang.Comparable source: jrt:/java.base
[0.006s][info][class,load] java.lang.CharSequence source: jrt:/java.base
[0.006s][info][class,load] java.lang.String source: jrt:/java.base
[0.006s][info][class,load] java.lang.reflect.AnnotatedElement source: jrt:/java.base
[0.006s][info][class,load] java.lang.reflect.GenericDeclaration source: jrt:/java.base
[0.006s][info][class,load] java.lang.reflect.Type source: jrt:/java.base
[0.007s][info][class,load] java.lang.Class source: jrt:/java.base

## kafkacat.adoc

      
              1 file
            
          
              3 forks
            
          
              0 comments
            
          
              9 stars
            
          
                rmoff
                / kafkacat.adoc
            
            
              Last active
              January 5, 2024 19:59
            
              
                Show last three messages from a Kafka topic with kafkacat
              
          
kafkacat -b localhost:9092 \
         -t _kafka-connect-group-01-status \
         -C \
         -o-3 \
         -c3 \
         -f 'Topic %t / Partition %p / Offset: %o / Timestamp: %T\nHeaders: %h\nKey (%K bytes): %k\nPayload (%S bytes): %s\n--\n'


## foo.md

      
              1 file
            
          
              7 forks
            
          
              12 comments
            
          
              20 stars
            
          
                rmoff
                / foo.md
            
            
              Last active
              January 5, 2024 17:17
            
              
                cx_Oracle install on MacOS
              
          
Download Instant Client:


instantclient-basic-macos.x64-11.2.0.4.0.zip
instantclient-sdk-macos.x64-11.2.0.4.0.zip
instantclient-sqlplus-macos.x64-11.2.0.4.0.zip


Unzip and move to /opt


Create symlink


## contexts.ipynb

      
              1 file
            
          
              0 forks
            
          
              1 comment
            
          
              1 star
            
          
                rmoff
                / contexts.ipynb
            
            
              Created
              April 5, 2023 18:59
            
              
                SparkContext & SparkSession
              
          
      Sorry, something went wrong. Reload?
      Sorry, we cannot display this file.
      Sorry, this file is invalid so it cannot be displayed.
      
          Viewer requires iframe.
	---
	version: '2'
	services:
	zookeeper:
	image: confluentinc/cp-zookeeper:latest
	environment:
	ZOOKEEPER_CLIENT_PORT: 2181
	ZOOKEEPER_TICK_TIME: 2000

	kafka:
	2024-04-15 11:25:36,164 INFO org.apache.flink.client.program.rest.RestClusterClient [] - Successfully submitted job 'collect' (926ca3f6cfa9f0a4b5bc7f215b4681eb) to 'http://localhost:8081'.
	2024-04-15 11:25:36,256 ERROR org.apache.flink.table.gateway.service.operation.OperationManager [] - Failed to execute the operation a2f854a9-938c-4c57-a484-4abe9d8eeb78.
	org.apache.flink.table.api.TableException: Failed to execute sql
	at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeQueryOperation(TableEnvironmentImpl.java:1084) ~[flink-table-api-java-uber-1.18.1.jar:1.18.1]
	at org.apache.flink.table.api.internal.TableEnvironmentImpl.executeInternal(TableEnvironmentImpl.java:1120) ~[flink-table-api-java-uber-1.18.1.jar:1.18.1]
	at org.apache.flink.table.gateway.service.operation.OperationExecutor.executeOperation(OperationExecutor.java:435) ~[flink-sql-gateway-1.18.1.jar:1.18.1]
	at org.apache.flink.table.gateway.service.operation.OperationExecutor.executeStatement(OperationExecutor.java:207) ~[f
	---
	version: '3.8'
	services:
	zookeeper-1:
	image: confluentinc/cp-zookeeper:5.5.1
	ports:
	- '32181:32181'
	environment:
	ZOOKEEPER_CLIENT_PORT: 32181
	ZOOKEEPER_TICK_TIME: 2000
	[0.004s][info][class,load] opened: /Users/rmoff/.sdkman/candidates/java/11.0.21-tem/lib/modules
	[0.006s][info][class,load] java.lang.Object source: jrt:/java.base
	[0.006s][info][class,load] java.io.Serializable source: jrt:/java.base
	[0.006s][info][class,load] java.lang.Comparable source: jrt:/java.base
	[0.006s][info][class,load] java.lang.CharSequence source: jrt:/java.base
	[0.006s][info][class,load] java.lang.String source: jrt:/java.base
	[0.006s][info][class,load] java.lang.reflect.AnnotatedElement source: jrt:/java.base
	[0.006s][info][class,load] java.lang.reflect.GenericDeclaration source: jrt:/java.base
	[0.006s][info][class,load] java.lang.reflect.Type source: jrt:/java.base
	[0.006s][info][class,load] java.lang.Class source: jrt:/java.base