conniey

Schema Registry Json Serializer Investigation and Samples

• Schema Registry Json Serializer Investigation and Samples
  • Overview and Motivation
    • Obstacles
  • Proposed Designs
    • Design 1: Create a separate azure-data-schemaregistry-jsonschema package
    • Design 2: Create a generalised azure-data-schemaregistry-serialization package
  • Design 1: Samples
• Serialization

conniey

Automatic Checkpointing

• Automatic Checkpointing
  • Default strategies: Interval and number of events
  • Custom checkpointing strategy
  • Error handling
  • API additions
  • Other things considered

Default strategies: Interval and number of events

conniey

Streaming Producer in Java

Table of Contents

• Streaming Producer in Java
  • Table of Contents
  • General Proposal
  • Snippets
    • Creating the client with default options
    • Creating the client with custom options

conniey

Closing objects asynchronously

Classes such as AMQP connections, sessions, and links require a response from a network resource to understand when it is in a good close state. Currently, there is no way to express this async operation without blocking.

Other languages have the concept of async closeable such as .NET's IAsyncDisposable.

Why not Mono.using or Flux.using?

conniey

Updating Service Bus entities

In our ServiceBusManagementAsyncClient, we expose Mono<QueueDescription> updateQueue(QueueDescription queue).

• ATOM API is old; unsure if they are actively developing it.
• The underlying REST call performs a replace. Any unpopulated properties in the QueueDescription are replaced with service default values.
• Only a subset of properties can be updated.
  • Only 5/23 properties can be updated.
  • The rest are read-only after Queue creation.
• There is no PATCH support.

conniey

Batched send with EventHubProducerClient

General changes

• Add an API, send that takes an Iterable<EventData>. Events passed in are grouped into batches and sent to the service.
  • SendOptions can be passed in to configure the size of the batch, partition key, or partition id.
  • If in the middle of the send operation, a batch fails to send (and all of its retries are exhausted), we complete the Mono with an exception. The SendException contains all the events in that batch. No more events are taken from the Iterable.

conniey

// To view the default settings, hold "alt" while clicking on the "Settings" button.
// For documentation on these settings, see: https://aka.ms/terminal-documentation

{
  "$schema": "https://aka.ms/terminal-profiles-schema",
  "defaultProfile": "{61c54bbd-c2c6-5271-96e7-009a87ff44bf}",
  "profiles": [
    {
      // Make changes here to the powershell.exe profile

conniey

September Preview: Synchronous APIs

Event Hubs Track 1 library contains synchronous and asynchronous APIs. Initially shipped with only async APIs, but found developers had troubles with CompletableFuture. Consequently sync APIs were added.

As per the Java guidelines, we will also have a sync API to lessen the mental burden when devs initially use our APIs. If they are concerned about performance, they can shift to using the async APIs.

Notable changes

conniey

SET @@InternalDebug = "FileSetV2:on";

DECLARE @Year string = "2017";
DECLARE @Month string = "01";
DECLARE @Day string = "26";

DECLARE @InputFiles string = "/AnalyzeRequests/" + @Year + "/" + @Month + "/"+ @Day + "/{id}.json";

CREATE DATABASE IF NOT EXISTS apiport;
USE apiport;

conniey

Rei Gemwater

Standing at 5'10" and 120 lbs, Rei Gemwater is a noble Sun elf of the Western Heartlands. 110 years ago, she was born into the House of Gemwater led by her father Alwyn and mother Merissa.

Her first 75 years of childhood and young adulthood was a carefree time where she spent much of her time helping her parents man their vast tome collection in the famous Baldur's Gate