Skip to content

Instantly share code, notes, and snippets.

View yuwtennis's full-sized avatar

Yu Watanabe yuwtennis

View GitHub Profile
@yuwtennis
yuwtennis / log
Created August 17, 2022 10:00
No expansion service for ElasticsearchIO
[ywatanabe@laptop-archlinux beam]$ ./gradlew :sdks:java:io:expansion-service:runExpansionService -PconstructionService.port=18089
Configuration on demand is an incubating feature.
> Task :sdks:java:io:expansion-service:runExpansionService
Starting expansion service at localhost:18089
Aug 17, 2022 6:49:19 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms
beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@663c9e7a
INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1]
beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@19e4653c
beam:transform:org.apache.beam:kafka_w
package elasticsearchio
import (
"fmt"
"github.com/apache/beam/sdks/v2/go/pkg/beam"
"github.com/apache/beam/sdks/v2/go/pkg/beam/core/typex"
"github.com/apache/beam/sdks/v2/go/pkg/beam/core/util/reflectx"
)
const (
SUBSCRIPTION_ID: str = os.environ.get("SUBSCRIPTION_ID", None)
SCOPE: str =f'/subscriptions/{SUBSCRIPTION_ID}'
logging.basicConfig(filename='./az-sdk-consumption-api-8-0-0-b1.log', level=logging.DEBUG, force=True)
current_timestamp = datetime.datetime.now(datetime.timezone.utc).strftime("%c %")
print(f"Querying Microsoft REST API. Started on {current_timestamp}")
consumption_client = ConsumptionManagementClient(
credential=DefaultAzureCredential(),
subscription_id=SUBSCRIPTION_ID