Skip to content

Instantly share code, notes, and snippets.

@masonlr

masonlr/.env

Created July 30, 2020 12:20
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save masonlr/3bcef050985ff2297c2a99d82de08d5d to your computer and use it in GitHub Desktop.
Save masonlr/3bcef050985ff2297c2a99d82de08d5d to your computer and use it in GitHub Desktop.
Download ZIP
Raw
.env
# General
COMPOSE_PROJECT_NAME=feast
FEAST_VERSION=latest
FEAST_REPOSITORY_VERSION=v0.6-branch
# Feast Core
FEAST_CORE_IMAGE=gcr.io/kf-feast/feast-core
FEAST_CORE_CONFIG=core.yml
FEAST_CORE_GCP_SERVICE_ACCOUNT_KEY=key.json
# Feast Serving
FEAST_SERVING_IMAGE=gcr.io/kf-feast/feast-serving
# Feast Serving - Batch (BigQuery)
FEAST_BATCH_SERVING_CONFIG=batch-serving.yml
FEAST_BATCH_SERVING_GCP_SERVICE_ACCOUNT_KEY=key.json
# Feast Serving - Online (Redis)
FEAST_ONLINE_SERVING_CONFIG=online-serving.yml
# Jupyter
FEAST_JUPYTER_GCP_SERVICE_ACCOUNT_KEY=key.json
Raw
batch-serving.yml
feast:
core-host: core
active-store: historical
stores:
- name: historical
type: BIGQUERY
# Changes required for batch serving to work
# Please see https://api.docs.feast.dev/grpc/feast.core.pb.html#Store for configuration options
config:
project_id: project-feast-test
dataset_id: dataset
staging_location: gs://feast-storage-bucket/another
initial_retry_delay_seconds: 1
total_timeout_seconds: 21600
write_triggering_frequency_seconds: 1
subscriptions:
- name: "*"
project: "*"
job_store:
redis_host: redis
redis_port: 6379
grpc:
port: 6567
Raw
feast_core_1.log
WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance.
███████╗███████╗ █████╗ ███████╗████████╗
██╔════╝██╔════╝██╔══██╗██╔════╝╚══██╔══╝
█████╗ █████╗ ███████║███████╗ ██║
██╔══╝ ██╔══╝ ██╔══██║╚════██║ ██║
██║ ███████╗██║ ██║███████║ ██║
╚═╝ ╚══════╝╚═╝ ╚═╝╚══════╝ ╚═╝
██████╗ ██████╗ ██████╗ ███████╗
██╔════╝██╔═══██╗██╔══██╗██╔════╝
██║ ██║ ██║██████╔╝█████╗
██║ ██║ ██║██╔══██╗██╔══╝
╚██████╗╚██████╔╝██║ ██║███████╗
╚═════╝ ╚═════╝ ╚═╝ ╚═╝╚══════╝
2020-07-30 12:16:42.367 INFO 42bdddc42c7e --- [ main] f.c.CoreApplication : Starting CoreApplication on 42bdddc42c7e with PID 1 (/opt/feast/feast-core.jar started by root in /)
2020-07-30 12:16:42.387 DEBUG 42bdddc42c7e --- [ main] f.c.CoreApplication : Running with Spring Boot v2.0.9.RELEASE, Spring v5.0.13.RELEASE
2020-07-30 12:16:42.402 INFO 42bdddc42c7e --- [ main] f.c.CoreApplication : No active profile set, falling back to default profiles: default
2020-07-30 12:16:42.600 INFO 42bdddc42c7e --- [ main] ConfigServletWebServerApplicationContext : Refreshing org.springframework.boot.web.servlet.context.AnnotationConfigServletWebServerApplicationContext@20d7d6fb: startup date [Thu Jul 30 12:16:42 UTC 2020]; root of context hierarchy
2020-07-30 12:16:46.669 INFO 42bdddc42c7e --- [ main] f.a.AutowiredAnnotationBeanPostProcessor : JSR-330 'javax.inject.Inject' annotation found and supported for autowiring
2020-07-30 12:16:47.053 INFO 42bdddc42c7e --- [ main] trationDelegate$BeanPostProcessorChecker : Bean 'org.springframework.kafka.annotation.KafkaBootstrapConfiguration' of type [org.springframework.kafka.annotation.KafkaBootstrapConfiguration$$EnhancerBySpringCGLIB$$808ae05e] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying)
2020-07-30 12:16:47.170 INFO 42bdddc42c7e --- [ main] trationDelegate$BeanPostProcessorChecker : Bean 'org.springframework.transaction.annotation.ProxyTransactionManagementConfiguration' of type [org.springframework.transaction.annotation.ProxyTransactionManagementConfiguration$$EnhancerBySpringCGLIB$$acd8cedb] is not eligible for getting processed by all BeanPostProcessors (for example: not eligible for auto-proxying)
2020-07-30 12:16:48.047 INFO 42bdddc42c7e --- [ main] o.s.b.w.e.t.TomcatWebServer : Tomcat initialized with port(s): 8080 (http)
2020-07-30 12:16:48.077 INFO 42bdddc42c7e --- [ main] o.a.c.h.Http11NioProtocol : Initializing ProtocolHandler ["http-nio-8080"]
2020-07-30 12:16:48.123 INFO 42bdddc42c7e --- [ main] o.a.c.c.StandardService : Starting service [Tomcat]
2020-07-30 12:16:48.126 INFO 42bdddc42c7e --- [ main] o.a.c.c.StandardEngine : Starting Servlet Engine: Apache Tomcat/8.5.39
2020-07-30 12:16:48.155 INFO 42bdddc42c7e --- [ost-startStop-1] o.a.c.c.AprLifecycleListener : The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: [/usr/java/packages/lib:/usr/lib64:/lib64:/lib:/usr/lib]
2020-07-30 12:16:48.255 INFO 42bdddc42c7e --- [ost-startStop-1] o.a.c.c.C.[.[.[/] : Initializing Spring embedded WebApplicationContext
2020-07-30 12:16:48.256 INFO 42bdddc42c7e --- [ost-startStop-1] o.s.w.c.ContextLoader : Root WebApplicationContext: initialization completed in 5666 ms
2020-07-30 12:16:49.058 WARN 42bdddc42c7e --- [ost-startStop-1] o.f.c.Flyway : Direct configuration of the Flyway object has been deprecated and will be removed in Flyway 6.0. Use Flyway.configure() instead.
2020-07-30 12:16:49.059 WARN 42bdddc42c7e --- [ost-startStop-1] o.f.c.Flyway : Direct configuration retrieval from the Flyway object has been deprecated and will be removed in Flyway 6.0. Use Flyway.getConfiguration() instead.
2020-07-30 12:16:49.060 WARN 42bdddc42c7e --- [ost-startStop-1] o.f.c.Flyway : Direct configuration retrieval from the Flyway object has been deprecated and will be removed in Flyway 6.0. Use Flyway.getConfiguration() instead.
2020-07-30 12:16:49.060 WARN 42bdddc42c7e --- [ost-startStop-1] o.f.c.Flyway : Direct configuration of the Flyway object has been deprecated and will be removed in Flyway 6.0. Use Flyway.configure() instead.
2020-07-30 12:16:49.080 WARN 42bdddc42c7e --- [ost-startStop-1] o.f.c.Flyway : Direct configuration of the Flyway object has been deprecated and will be removed in Flyway 6.0. Use Flyway.configure() instead.
2020-07-30 12:16:49.102 INFO 42bdddc42c7e --- [ost-startStop-1] o.f.c.i.l.VersionPrinter : Flyway Community Edition 5.2.4 by Boxfuse
2020-07-30 12:16:49.129 INFO 42bdddc42c7e --- [ost-startStop-1] c.z.h.HikariDataSource : HikariPool-1 - Starting...
2020-07-30 12:16:49.268 INFO 42bdddc42c7e --- [ost-startStop-1] c.z.h.HikariDataSource : HikariPool-1 - Start completed.
2020-07-30 12:16:49.278 INFO 42bdddc42c7e --- [ost-startStop-1] o.f.c.i.d.DatabaseFactory : Database: jdbc:postgresql://db:5432/postgres (PostgreSQL 12.3)
2020-07-30 12:16:49.291 WARN 42bdddc42c7e --- [ost-startStop-1] o.f.c.i.d.b.Database : Flyway upgrade recommended: PostgreSQL 12.3 is newer than this version of Flyway and support has not been tested.
2020-07-30 12:16:49.396 INFO 42bdddc42c7e --- [ost-startStop-1] o.f.c.i.c.DbValidate : Successfully validated 7 migrations (execution time 00:00.046s)
2020-07-30 12:16:49.420 INFO 42bdddc42c7e --- [ost-startStop-1] o.f.c.i.s.JdbcTableSchemaHistory : Creating Schema History table: "public"."flyway_schema_history"
2020-07-30 12:16:49.458 INFO 42bdddc42c7e --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Current version of schema "public": << Empty Schema >>
2020-07-30 12:16:49.460 INFO 42bdddc42c7e --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Migrating schema "public" to version 1 - Baseline
2020-07-30 12:16:49.537 INFO 42bdddc42c7e --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Migrating schema "public" to version 2 - RELEASE 0.6 Generalizing Source AND Extending FeatureSetJobStatus AND Feature Statistics
2020-07-30 12:16:49.578 INFO 42bdddc42c7e --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Migrating schema "public" to version 2.1 - Many Stores Per Job
2020-07-30 12:16:49.604 INFO 42bdddc42c7e --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Migrating schema "public" to version 2.2 - Subscription Migration
2020-07-30 12:16:49.615 INFO 42bdddc42c7e --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Migrating schema "public" to version 2.3 - Fix Primary Keys
2020-07-30 12:16:49.628 INFO 42bdddc42c7e --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Migrating schema "public" to version 2.4 - Store proto
2020-07-30 12:16:49.640 INFO 42bdddc42c7e --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Migrating schema "public" to version 2.5 - Fix Subscription MIgration
2020-07-30 12:16:49.649 INFO 42bdddc42c7e --- [ost-startStop-1] o.f.c.i.c.DbMigrate : Successfully applied 7 migrations to schema "public" (execution time 00:00.230s)
2020-07-30 12:16:50.144 INFO 42bdddc42c7e --- [ost-startStop-1] j.LocalContainerEntityManagerFactoryBean : Building JPA container EntityManagerFactory for persistence unit 'default'
2020-07-30 12:16:50.180 INFO 42bdddc42c7e --- [ost-startStop-1] o.h.j.i.u.LogHelper : HHH000204: Processing PersistenceUnitInfo [
name: default
...]
2020-07-30 12:16:50.331 INFO 42bdddc42c7e --- [ost-startStop-1] o.h.Version : HHH000412: Hibernate Core {5.3.6.Final}
2020-07-30 12:16:50.334 INFO 42bdddc42c7e --- [ost-startStop-1] o.h.c.Environment : HHH000206: hibernate.properties not found
2020-07-30 12:16:50.618 INFO 42bdddc42c7e --- [ost-startStop-1] o.h.a.c.Version : HCANN000001: Hibernate Commons Annotations {5.0.4.Final}
2020-07-30 12:16:51.255 INFO 42bdddc42c7e --- [ost-startStop-1] o.h.d.Dialect : HHH000400: Using dialect: org.hibernate.dialect.PostgreSQL95Dialect
2020-07-30 12:16:51.428 INFO 42bdddc42c7e --- [ost-startStop-1] o.h.e.j.e.i.LobCreatorBuilderImpl : HHH000424: Disabling contextual LOB creation as createClob() method threw error : java.lang.reflect.InvocationTargetException
2020-07-30 12:16:51.445 INFO 42bdddc42c7e --- [ost-startStop-1] o.h.t.BasicTypeRegistry : HHH000270: Type registration [java.util.UUID] overrides previous : org.hibernate.type.UUIDBinaryType@712cca9
2020-07-30 12:16:53.211 INFO 42bdddc42c7e --- [ost-startStop-1] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default'
2020-07-30 12:16:54.456 INFO 42bdddc42c7e --- [ost-startStop-1] o.h.h.i.QueryTranslatorFactoryInitiator : HHH000397: Using ASTQueryTranslatorFactory
2020-07-30 12:16:55.782 INFO 42bdddc42c7e --- [ost-startStop-1] o.s.b.w.s.FilterRegistrationBean : Mapping filter: 'characterEncodingFilter' to: [/*]
2020-07-30 12:16:55.783 INFO 42bdddc42c7e --- [ost-startStop-1] o.s.b.w.s.FilterRegistrationBean : Mapping filter: 'webMvcMetricsFilter' to: [/*]
2020-07-30 12:16:55.783 INFO 42bdddc42c7e --- [ost-startStop-1] o.s.b.w.s.FilterRegistrationBean : Mapping filter: 'hiddenHttpMethodFilter' to: [/*]
2020-07-30 12:16:55.783 INFO 42bdddc42c7e --- [ost-startStop-1] o.s.b.w.s.FilterRegistrationBean : Mapping filter: 'httpPutFormContentFilter' to: [/*]
2020-07-30 12:16:55.783 INFO 42bdddc42c7e --- [ost-startStop-1] o.s.b.w.s.FilterRegistrationBean : Mapping filter: 'requestContextFilter' to: [/*]
2020-07-30 12:16:55.784 INFO 42bdddc42c7e --- [ost-startStop-1] .s.DelegatingFilterProxyRegistrationBean : Mapping filter: 'springSecurityFilterChain' to: [/*]
2020-07-30 12:16:55.784 INFO 42bdddc42c7e --- [ost-startStop-1] o.s.b.w.s.FilterRegistrationBean : Mapping filter: 'httpTraceFilter' to: [/*]
2020-07-30 12:16:55.785 INFO 42bdddc42c7e --- [ost-startStop-1] o.s.b.w.s.ServletRegistrationBean : Servlet metricsServlet mapped to [/metrics]
2020-07-30 12:16:55.790 INFO 42bdddc42c7e --- [ost-startStop-1] o.s.b.w.s.ServletRegistrationBean : Servlet dispatcherServlet mapped to [/]
2020-07-30 12:16:56.259 INFO 42bdddc42c7e --- [ main] .s.s.UserDetailsServiceAutoConfiguration :
Using generated security password: d7afdeae-7161-490b-a8cc-61f67e2474d8
2020-07-30 12:16:56.545 INFO 42bdddc42c7e --- [ main] o.s.s.w.DefaultSecurityFilterChain : Creating filter chain: any request, [org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter@2f66f0d0, org.springframework.security.web.context.SecurityContextPersistenceFilter@140d1230, org.springframework.security.web.header.HeaderWriterFilter@44c13103, org.springframework.security.web.authentication.logout.LogoutFilter@19382338, org.springframework.security.web.savedrequest.RequestCacheAwareFilter@7e2c64, org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter@4cb40e3b, org.springframework.security.web.authentication.AnonymousAuthenticationFilter@4d62f4c6, org.springframework.security.web.session.SessionManagementFilter@6631cb64, org.springframework.security.web.access.ExceptionTranslationFilter@1a6cf771, org.springframework.security.web.access.intercept.FilterSecurityInterceptor@70c0a3d5]
2020-07-30 12:16:56.716 INFO 42bdddc42c7e --- [ main] o.s.w.s.h.SimpleUrlHandlerMapping : Mapped URL path [/**/favicon.ico] onto handler of type [class org.springframework.web.servlet.resource.ResourceHttpRequestHandler]
2020-07-30 12:16:56.979 INFO 42bdddc42c7e --- [ main] s.w.s.m.m.a.RequestMappingHandlerAdapter : Looking for @ControllerAdvice: org.springframework.boot.web.servlet.context.AnnotationConfigServletWebServerApplicationContext@20d7d6fb: startup date [Thu Jul 30 12:16:42 UTC 2020]; root of context hierarchy
2020-07-30 12:16:57.041 WARN 42bdddc42c7e --- [ main] aWebConfiguration$JpaWebMvcConfiguration : spring.jpa.open-in-view is enabled by default. Therefore, database queries may be performed during view rendering. Explicitly configure spring.jpa.open-in-view to disable this warning
2020-07-30 12:16:57.085 INFO 42bdddc42c7e --- [ main] s.w.s.m.m.a.RequestMappingHandlerMapping : Mapped "{[/error]}" onto public org.springframework.http.ResponseEntity<java.util.Map<java.lang.String, java.lang.Object>> org.springframework.boot.autoconfigure.web.servlet.error.BasicErrorController.error(javax.servlet.http.HttpServletRequest)
2020-07-30 12:16:57.088 INFO 42bdddc42c7e --- [ main] s.w.s.m.m.a.RequestMappingHandlerMapping : Mapped "{[/error],produces=[text/html]}" onto public org.springframework.web.servlet.ModelAndView org.springframework.boot.autoconfigure.web.servlet.error.BasicErrorController.errorHtml(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse)
2020-07-30 12:16:57.126 INFO 42bdddc42c7e --- [ main] o.s.w.s.h.SimpleUrlHandlerMapping : Mapped URL path [/webjars/**] onto handler of type [class org.springframework.web.servlet.resource.ResourceHttpRequestHandler]
2020-07-30 12:16:57.126 INFO 42bdddc42c7e --- [ main] o.s.w.s.h.SimpleUrlHandlerMapping : Mapped URL path [/**] onto handler of type [class org.springframework.web.servlet.resource.ResourceHttpRequestHandler]
2020-07-30 12:16:58.007 INFO 42bdddc42c7e --- [ main] o.s.b.a.e.w.EndpointLinksResolver : Exposing 2 endpoint(s) beneath base path '/actuator'
2020-07-30 12:16:58.044 INFO 42bdddc42c7e --- [ main] s.b.a.e.w.s.WebMvcEndpointHandlerMapping : Mapped "{[/actuator/health],methods=[GET],produces=[application/vnd.spring-boot.actuator.v2+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.web.servlet.AbstractWebMvcEndpointHandlerMapping$OperationHandler.handle(javax.servlet.http.HttpServletRequest,java.util.Map<java.lang.String, java.lang.String>)
2020-07-30 12:16:58.047 INFO 42bdddc42c7e --- [ main] s.b.a.e.w.s.WebMvcEndpointHandlerMapping : Mapped "{[/actuator/info],methods=[GET],produces=[application/vnd.spring-boot.actuator.v2+json || application/json]}" onto public java.lang.Object org.springframework.boot.actuate.endpoint.web.servlet.AbstractWebMvcEndpointHandlerMapping$OperationHandler.handle(javax.servlet.http.HttpServletRequest,java.util.Map<java.lang.String, java.lang.String>)
2020-07-30 12:16:58.049 INFO 42bdddc42c7e --- [ main] s.b.a.e.w.s.WebMvcEndpointHandlerMapping : Mapped "{[/actuator],methods=[GET],produces=[application/vnd.spring-boot.actuator.v2+json || application/json]}" onto protected java.util.Map<java.lang.String, java.util.Map<java.lang.String, org.springframework.boot.actuate.endpoint.web.Link>> org.springframework.boot.actuate.endpoint.web.servlet.WebMvcEndpointHandlerMapping.links(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse)
2020-07-30 12:16:58.269 INFO 42bdddc42c7e --- [ main] o.a.k.c.a.AdminClientConfig : AdminClientConfig values:
bootstrap.servers = [kafka:9092, localhost:9094]
client.dns.lookup = default
client.id =
connections.max.idle.ms = 300000
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
receive.buffer.bytes = 65536
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 15000
retries = 5
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
2020-07-30 12:16:58.356 INFO 42bdddc42c7e --- [ main] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:16:58.356 INFO 42bdddc42c7e --- [ main] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:16:58.357 INFO 42bdddc42c7e --- [ main] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111418354
2020-07-30 12:16:58.793 ERROR 42bdddc42c7e --- [ main] o.s.k.c.KafkaAdmin : Failed to create topics
org.apache.kafka.common.errors.InvalidReplicationFactorException: Replication factor: 3 larger than available brokers: 1.
2020-07-30 12:16:58.804 INFO 42bdddc42c7e --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Registering beans for JMX exposure on startup
2020-07-30 12:16:58.810 INFO 42bdddc42c7e --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Bean with name 'dataSource' has been autodetected for JMX exposure
2020-07-30 12:16:58.821 INFO 42bdddc42c7e --- [ main] o.s.j.e.a.AnnotationMBeanExporter : Located MBean 'dataSource': registering with JMX server as MBean [com.zaxxer.hikari:name=dataSource,type=HikariDataSource]
2020-07-30 12:16:58.879 INFO 42bdddc42c7e --- [ main] o.s.c.s.DefaultLifecycleProcessor : Starting beans in phase 2147483547
2020-07-30 12:16:58.902 INFO 42bdddc42c7e --- [ main] o.a.k.c.c.ConsumerConfig : ConsumerConfig values:
allow.auto.create.topics = true
auto.commit.interval.ms = 5000
auto.offset.reset = latest
bootstrap.servers = [kafka:9092, localhost:9094]
check.crcs = true
client.dns.lookup = default
client.id =
client.rack =
connections.max.idle.ms = 540000
default.api.timeout.ms = 60000
enable.auto.commit = true
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = core-service-null
group.instance.id = null
heartbeat.interval.ms = 3000
interceptor.classes = []
internal.leave.group.on.close = true
isolation.level = read_uncommitted
key.deserializer = class org.apache.kafka.common.serialization.StringDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 65536
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class feast.core.util.KafkaSerialization$ProtoDeserializer
2020-07-30 12:16:58.978 INFO 42bdddc42c7e --- [ main] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:16:58.978 INFO 42bdddc42c7e --- [ main] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:16:58.978 INFO 42bdddc42c7e --- [ main] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111418978
2020-07-30 12:16:58.983 INFO 42bdddc42c7e --- [ main] o.a.k.c.c.KafkaConsumer : [Consumer clientId=consumer-1, groupId=core-service-null] Subscribed to topic(s): feast-specs-ack
2020-07-30 12:16:58.990 INFO 42bdddc42c7e --- [ main] o.s.s.c.ThreadPoolTaskScheduler : Initializing ExecutorService
2020-07-30 12:16:58.999 INFO 42bdddc42c7e --- [ main] o.s.c.s.DefaultLifecycleProcessor : Starting beans in phase 2147483647
2020-07-30 12:16:59.009 WARN 42bdddc42c7e --- [ntainer#0-0-C-1] o.a.k.c.NetworkClient : [Consumer clientId=consumer-1, groupId=core-service-null] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-07-30 12:16:59.030 INFO 42bdddc42c7e --- [ntainer#0-0-C-1] o.a.k.c.Metadata : [Consumer clientId=consumer-1, groupId=core-service-null] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:16:59.047 INFO 42bdddc42c7e --- [ main] n.d.b.g.s.s.AbstractGrpcServerFactory : Registered gRPC service: feast.core.CoreService, bean: coreServiceImpl, class: feast.core.grpc.CoreServiceImpl
2020-07-30 12:16:59.051 INFO 42bdddc42c7e --- [ main] n.d.b.g.s.s.AbstractGrpcServerFactory : Registered gRPC service: grpc.health.v1.Health, bean: healthServiceImpl, class: feast.core.grpc.HealthServiceImpl
2020-07-30 12:16:59.461 INFO 42bdddc42c7e --- [ main] n.d.b.g.s.s.GrpcServerLifecycle : gRPC Server started, listening on address: *, port: 6565
2020-07-30 12:16:59.502 INFO 42bdddc42c7e --- [ main] s.a.ScheduledAnnotationBeanPostProcessor : No TaskScheduler/ScheduledExecutorService bean found for scheduled processing
2020-07-30 12:16:59.519 INFO 42bdddc42c7e --- [ main] o.a.c.h.Http11NioProtocol : Starting ProtocolHandler ["http-nio-8080"]
2020-07-30 12:16:59.521 INFO 42bdddc42c7e --- [ main] o.a.t.u.n.NioSelectorPool : Using a shared selector for servlet write/read
2020-07-30 12:16:59.521 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:16:59.647 INFO 42bdddc42c7e --- [ main] o.s.b.w.e.t.TomcatWebServer : Tomcat started on port(s): 8080 (http) with context path ''
2020-07-30 12:16:59.647 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found.
2020-07-30 12:16:59.653 INFO 42bdddc42c7e --- [ main] f.c.CoreApplication : Started CoreApplication in 18.273 seconds (JVM running for 20.368)
2020-07-30 12:17:00.087 INFO 42bdddc42c7e --- [ntainer#0-0-C-1] o.a.k.c.c.i.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=core-service-null] Discovered group coordinator kafka:9092 (id: 2147482646 rack: null)
2020-07-30 12:17:00.091 INFO 42bdddc42c7e --- [ntainer#0-0-C-1] o.a.k.c.c.i.ConsumerCoordinator : [Consumer clientId=consumer-1, groupId=core-service-null] Revoking previously assigned partitions []
2020-07-30 12:17:00.092 INFO 42bdddc42c7e --- [ntainer#0-0-C-1] o.s.k.l.KafkaMessageListenerContainer : partitions revoked: []
2020-07-30 12:17:00.092 INFO 42bdddc42c7e --- [ntainer#0-0-C-1] o.a.k.c.c.i.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=core-service-null] (Re-)joining group
2020-07-30 12:17:00.120 INFO 42bdddc42c7e --- [ntainer#0-0-C-1] o.a.k.c.c.i.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=core-service-null] (Re-)joining group
2020-07-30 12:17:03.203 INFO 42bdddc42c7e --- [ntainer#0-0-C-1] o.a.k.c.c.i.AbstractCoordinator : [Consumer clientId=consumer-1, groupId=core-service-null] Successfully joined group with generation 1
2020-07-30 12:17:03.209 INFO 42bdddc42c7e --- [ntainer#0-0-C-1] o.a.k.c.c.i.ConsumerCoordinator : [Consumer clientId=consumer-1, groupId=core-service-null] Setting newly assigned partitions: feast-specs-ack-0
2020-07-30 12:17:03.225 INFO 42bdddc42c7e --- [ntainer#0-0-C-1] o.a.k.c.c.i.ConsumerCoordinator : [Consumer clientId=consumer-1, groupId=core-service-null] Found no committed offset for partition feast-specs-ack-0
2020-07-30 12:17:03.245 INFO 42bdddc42c7e --- [ntainer#0-0-C-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-1, groupId=core-service-null] Resetting offset for partition feast-specs-ack-0 to offset 0.
2020-07-30 12:17:03.247 INFO 42bdddc42c7e --- [ntainer#0-0-C-1] o.s.k.l.KafkaMessageListenerContainer : partitions assigned: [feast-specs-ack-0]
2020-07-30 12:17:04.649 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:17:04.670 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found.
2020-07-30 12:17:09.673 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:17:09.684 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found.
2020-07-30 12:17:14.687 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:17:14.695 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found.
2020-07-30 12:17:19.697 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:17:19.705 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found.
2020-07-30 12:17:24.707 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:17:24.714 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found.
2020-07-30 12:17:29.717 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:17:29.723 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found.
2020-07-30 12:17:34.725 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:17:34.732 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found.
2020-07-30 12:17:39.734 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:17:39.742 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found.
2020-07-30 12:17:44.745 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:17:44.752 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found.
2020-07-30 12:17:49.755 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:17:49.761 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found.
2020-07-30 12:17:54.763 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:17:54.772 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found.
2020-07-30 12:17:59.775 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:17:59.785 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found.
2020-07-30 12:18:04.787 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:18:04.798 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : No jobs found.
2020-07-30 12:18:09.801 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:18:09.848 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs...
2020-07-30 12:18:09.852 AUDIT 42bdddc42c7e --- [pool-4-thread-2] f.c.l.AuditLogger : {action=SUBMIT, detail=Building graph and submitting to DirectRunner, id=kafka-2111741832-to-historical-1596111489844, resource=JOB, timestamp=Thu Jul 30 12:18:09 UTC 2020}
2020-07-30 12:18:09.852 AUDIT 42bdddc42c7e --- [pool-4-thread-1] f.c.l.AuditLogger : {action=SUBMIT, detail=Building graph and submitting to DirectRunner, id=kafka-2111741832-to-online-1596111489838, resource=JOB, timestamp=Thu Jul 30 12:18:09 UTC 2020}
2020-07-30 12:18:10.646 INFO 42bdddc42c7e --- [pool-4-thread-2] f.i.ImportJob : Starting import job with settings:
Current Settings:
appName: DirectRunnerJobManager
blockOnRun: false
defaultFeastProject: default
enforceEncodability: true
enforceImmutability: true
gcsPerformanceMetrics: false
jobName: kafka-2111741832-to-historical-1596111489844
optionsId: 0
project:
runner: class org.apache.beam.runners.direct.DirectRunner
sourceJson: {
"type": "KAFKA",
"kafkaSourceConfig": {
"bootstrapServers": "kafka:9092,localhost:9094",
"topic": "feast-features"
}
}
specsStreamingUpdateConfigJson: {
"source": {
"bootstrapServers": "kafka:9092,localhost:9094",
"topic": "feast-specs"
},
"ack": {
"bootstrapServers": "kafka:9092,localhost:9094",
"topic": "feast-specs-ack"
}
}
stableUniqueNames: WARNING
storesJson: [{
"name": "historical",
"type": "BIGQUERY",
"subscriptions": [{
"name": "*",
"project": "*"
}],
"bigqueryConfig": {
"projectId": "project-feast-test",
"datasetId": "dataset",
"stagingLocation": "gs://feast-storage-bucket/another",
"initialRetryDelaySeconds": 1,
"totalTimeoutSeconds": 21600,
"writeTriggeringFrequencySeconds": 1
}
}]
2020-07-30 12:18:10.646 INFO 42bdddc42c7e --- [pool-4-thread-1] f.i.ImportJob : Starting import job with settings:
Current Settings:
appName: DirectRunnerJobManager
blockOnRun: false
defaultFeastProject: default
enforceEncodability: true
enforceImmutability: true
gcsPerformanceMetrics: false
jobName: kafka-2111741832-to-online-1596111489838
optionsId: 1
project:
runner: class org.apache.beam.runners.direct.DirectRunner
sourceJson: {
"type": "KAFKA",
"kafkaSourceConfig": {
"bootstrapServers": "kafka:9092,localhost:9094",
"topic": "feast-features"
}
}
specsStreamingUpdateConfigJson: {
"source": {
"bootstrapServers": "kafka:9092,localhost:9094",
"topic": "feast-specs"
},
"ack": {
"bootstrapServers": "kafka:9092,localhost:9094",
"topic": "feast-specs-ack"
}
}
stableUniqueNames: WARNING
storesJson: [{
"name": "online",
"type": "REDIS",
"subscriptions": [{
"name": "*",
"project": "*"
}],
"redisConfig": {
"host": "redis",
"port": 6379
}
}]
2020-07-30 12:18:11.130 ERROR 42bdddc42c7e --- [pool-4-thread-1] f.c.j.d.DirectRunnerJobManager : Error submitting job
java.util.ConcurrentModificationException
at java.base/java.util.HashMap.computeIfAbsent(Unknown Source)
at org.apache.beam.sdk.schemas.utils.ReflectUtils.getMethods(ReflectUtils.java:77)
at org.apache.beam.sdk.schemas.AutoValueSchema$AbstractGetterTypeSupplier.get(AutoValueSchema.java:46)
at org.apache.beam.sdk.schemas.utils.StaticSchemaInference.schemaFromClass(StaticSchemaInference.java:83)
at org.apache.beam.sdk.schemas.utils.JavaBeanUtils.schemaFromJavaBeanClass(JavaBeanUtils.java:63)
at org.apache.beam.sdk.schemas.AutoValueSchema.schemaFor(AutoValueSchema.java:114)
at org.apache.beam.sdk.schemas.annotations.DefaultSchema$DefaultSchemaProvider.schemaFor(DefaultSchema.java:131)
at org.apache.beam.sdk.schemas.SchemaRegistry.lambda$getSchema$0(SchemaRegistry.java:256)
at org.apache.beam.sdk.schemas.SchemaRegistry.getProviderResult(SchemaRegistry.java:239)
at org.apache.beam.sdk.schemas.SchemaRegistry.getSchema(SchemaRegistry.java:256)
at org.apache.beam.sdk.values.PCollection.inferCoderOrFail(PCollection.java:159)
at org.apache.beam.sdk.values.PCollection.finishSpecifyingOutput(PCollection.java:94)
at org.apache.beam.sdk.runners.TransformHierarchy.setOutput(TransformHierarchy.java:210)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:540)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:490)
at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:368)
at feast.ingestion.transform.ReadFromSource.expand(ReadFromSource.java:91)
at feast.ingestion.transform.ReadFromSource.expand(ReadFromSource.java:37)
at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:539)
at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:490)
at org.apache.beam.sdk.values.PBegin.apply(PBegin.java:56)
at org.apache.beam.sdk.Pipeline.apply(Pipeline.java:184)
at feast.ingestion.ImportJob.runPipeline(ImportJob.java:117)
at feast.core.job.direct.DirectRunnerJobManager.runPipeline(DirectRunnerJobManager.java:164)
at feast.core.job.direct.DirectRunnerJobManager.startJob(DirectRunnerJobManager.java:83)
at feast.core.job.CreateJobTask.call(CreateJobTask.java:48)
at feast.core.job.CreateJobTask.call(CreateJobTask.java:29)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)
2020-07-30 12:18:11.130 ERROR 42bdddc42c7e --- [pool-4-thread-1] f.c.j.CreateJobTask : Error running ingestion job: java.util.ConcurrentModificationException
2020-07-30 12:18:11.130 AUDIT 42bdddc42c7e --- [pool-4-thread-1] f.c.l.AuditLogger : {action=STATUS_CHANGE, detail=Job failed to be submitted to runner DirectRunner. Job status changed to ERROR., id=kafka-2111741832-to-online-1596111489838, resource=JOB, timestamp=Thu Jul 30 12:18:11 UTC 2020}
2020-07-30 12:18:12.056 INFO 42bdddc42c7e --- [pool-4-thread-2] o.a.k.c.c.ConsumerConfig : ConsumerConfig values:
allow.auto.create.topics = true
auto.commit.interval.ms = 5000
auto.offset.reset = latest
bootstrap.servers = [kafka:9092, localhost:9094]
check.crcs = true
client.dns.lookup = default
client.id =
client.rack =
connections.max.idle.ms = 540000
default.api.timeout.ms = 60000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = feast_import_job_kafka-2111741832-to-historical
group.instance.id = null
heartbeat.interval.ms = 3000
interceptor.classes = []
internal.leave.group.on.close = true
isolation.level = read_committed
key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 524288
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
2020-07-30 12:18:12.061 INFO 42bdddc42c7e --- [pool-4-thread-2] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:12.061 INFO 42bdddc42c7e --- [pool-4-thread-2] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:12.062 INFO 42bdddc42c7e --- [pool-4-thread-2] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111492061
2020-07-30 12:18:12.064 WARN 42bdddc42c7e --- [pool-4-thread-2] o.a.k.c.NetworkClient : [Consumer clientId=consumer-2, groupId=feast_import_job_kafka-2111741832-to-historical] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-07-30 12:18:12.168 WARN 42bdddc42c7e --- [pool-4-thread-2] o.a.k.c.NetworkClient : [Consumer clientId=consumer-2, groupId=feast_import_job_kafka-2111741832-to-historical] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-07-30 12:18:12.291 INFO 42bdddc42c7e --- [pool-4-thread-2] o.a.k.c.Metadata : [Consumer clientId=consumer-2, groupId=feast_import_job_kafka-2111741832-to-historical] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:18:12.296 INFO 42bdddc42c7e --- [pool-4-thread-2] o.a.b.s.i.k.KafkaUnboundedSource : Partitions assigned to split 0 (total 1): feast-features-0
2020-07-30 12:18:12.300 INFO 42bdddc42c7e --- [pool-4-thread-2] o.a.k.c.c.ConsumerConfig : ConsumerConfig values:
allow.auto.create.topics = true
auto.commit.interval.ms = 5000
auto.offset.reset = earliest
bootstrap.servers = [kafka:9092, localhost:9094]
check.crcs = true
client.dns.lookup = default
client.id =
client.rack =
connections.max.idle.ms = 540000
default.api.timeout.ms = 60000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = null
group.instance.id = null
heartbeat.interval.ms = 3000
interceptor.classes = []
internal.leave.group.on.close = true
isolation.level = read_uncommitted
key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 524288
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
2020-07-30 12:18:12.304 INFO 42bdddc42c7e --- [pool-4-thread-2] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:12.304 INFO 42bdddc42c7e --- [pool-4-thread-2] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:12.304 INFO 42bdddc42c7e --- [pool-4-thread-2] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111492304
2020-07-30 12:18:12.420 INFO 42bdddc42c7e --- [pool-4-thread-2] o.a.k.c.Metadata : [Consumer clientId=consumer-3, groupId=null] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:18:12.423 INFO 42bdddc42c7e --- [pool-4-thread-2] o.a.b.s.i.k.KafkaUnboundedSource : Partitions assigned to split 0 (total 1): feast-specs-0
2020-07-30 12:18:12.428 AUDIT 42bdddc42c7e --- [pool-4-thread-2] f.c.l.AuditLogger : {action=STATUS_CHANGE, detail=Job submitted to runner DirectRunner with ext id kafka-2111741832-to-historical-1596111489844., id=kafka-2111741832-to-historical-1596111489844, resource=JOB, timestamp=Thu Jul 30 12:18:12 UTC 2020}
2020-07-30 12:18:12.517 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.ConsumerConfig : ConsumerConfig values:
allow.auto.create.topics = true
auto.commit.interval.ms = 5000
auto.offset.reset = earliest
bootstrap.servers = [kafka:9092, localhost:9094]
check.crcs = true
client.dns.lookup = default
client.id =
client.rack =
connections.max.idle.ms = 540000
default.api.timeout.ms = 60000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = null
group.instance.id = null
heartbeat.interval.ms = 3000
interceptor.classes = []
internal.leave.group.on.close = true
isolation.level = read_uncommitted
key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 524288
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
2020-07-30 12:18:12.518 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.ConsumerConfig : ConsumerConfig values:
allow.auto.create.topics = true
auto.commit.interval.ms = 5000
auto.offset.reset = latest
bootstrap.servers = [kafka:9092, localhost:9094]
check.crcs = true
client.dns.lookup = default
client.id =
client.rack =
connections.max.idle.ms = 540000
default.api.timeout.ms = 60000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = feast_import_job_kafka-2111741832-to-historical
group.instance.id = null
heartbeat.interval.ms = 3000
interceptor.classes = []
internal.leave.group.on.close = true
isolation.level = read_committed
key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 524288
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
2020-07-30 12:18:12.526 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:12.527 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:12.527 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111492526
2020-07-30 12:18:12.528 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:12.528 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:12.528 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111492527
2020-07-30 12:18:12.541 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Sending new FeatureSet default/customer_transactions to Ingestion
2020-07-30 12:18:12.551 INFO 42bdddc42c7e --- [pool-3-thread-1] o.a.k.c.p.ProducerConfig : ProducerConfig values:
acks = 1
batch.size = 16384
bootstrap.servers = [kafka:9092, localhost:9094]
buffer.memory = 33554432
client.dns.lookup = default
client.id =
compression.type = none
connections.max.idle.ms = 540000
delivery.timeout.ms = 120000
enable.idempotence = false
interceptor.classes = []
key.serializer = class org.apache.kafka.common.serialization.StringSerializer
linger.ms = 0
max.block.ms = 60000
max.in.flight.requests.per.connection = 5
max.request.size = 1048576
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner
receive.buffer.bytes = 32768
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retries = 2147483647
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
transaction.timeout.ms = 60000
transactional.id = null
value.serializer = class feast.core.util.KafkaSerialization$ProtoSerializer
2020-07-30 12:18:12.583 INFO 42bdddc42c7e --- [pool-3-thread-1] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:12.583 INFO 42bdddc42c7e --- [pool-3-thread-1] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:12.583 INFO 42bdddc42c7e --- [pool-3-thread-1] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111492583
2020-07-30 12:18:12.591 WARN 42bdddc42c7e --- [ad | producer-1] o.a.k.c.NetworkClient : [Producer clientId=producer-1] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-07-30 12:18:12.596 INFO 42bdddc42c7e --- [ad | producer-1] o.a.k.c.Metadata : [Producer clientId=producer-1] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:18:12.613 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.KafkaConsumer : [Consumer clientId=consumer-4, groupId=null] Subscribed to partition(s): feast-specs-0
2020-07-30 12:18:12.613 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.KafkaConsumer : [Consumer clientId=consumer-5, groupId=feast_import_job_kafka-2111741832-to-historical] Subscribed to partition(s): feast-features-0
2020-07-30 12:18:12.620 WARN 42bdddc42c7e --- [pool-9-thread-1] o.a.k.c.NetworkClient : [Consumer clientId=consumer-4, groupId=null] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-07-30 12:18:12.636 INFO 42bdddc42c7e --- [ool-10-thread-1] o.a.k.c.Metadata : [Consumer clientId=consumer-5, groupId=feast_import_job_kafka-2111741832-to-historical] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:18:12.640 INFO 42bdddc42c7e --- [pool-9-thread-1] o.a.k.c.Metadata : [Consumer clientId=consumer-4, groupId=null] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:18:12.642 INFO 42bdddc42c7e --- [ool-10-thread-1] o.a.k.c.c.i.AbstractCoordinator : [Consumer clientId=consumer-5, groupId=feast_import_job_kafka-2111741832-to-historical] Discovered group coordinator kafka:9092 (id: 2147482646 rack: null)
2020-07-30 12:18:12.647 INFO 42bdddc42c7e --- [ool-10-thread-1] o.a.k.c.c.i.ConsumerCoordinator : [Consumer clientId=consumer-5, groupId=feast_import_job_kafka-2111741832-to-historical] Found no committed offset for partition feast-features-0
2020-07-30 12:18:12.649 INFO 42bdddc42c7e --- [pool-9-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-4, groupId=null] Resetting offset for partition feast-specs-0 to offset 0.
2020-07-30 12:18:12.650 INFO 42bdddc42c7e --- [t-runner-worker] o.a.b.s.i.k.KafkaUnboundedSource : Reader-0: reading from feast-specs-0 starting at offset 0
2020-07-30 12:18:12.651 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.ConsumerConfig : ConsumerConfig values:
allow.auto.create.topics = true
auto.commit.interval.ms = 5000
auto.offset.reset = earliest
bootstrap.servers = [kafka:9092, localhost:9094]
check.crcs = true
client.dns.lookup = default
client.id =
client.rack =
connections.max.idle.ms = 540000
default.api.timeout.ms = 60000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = Reader-0_offset_consumer_1701034568_none
group.instance.id = null
heartbeat.interval.ms = 3000
interceptor.classes = []
internal.leave.group.on.close = true
isolation.level = read_uncommitted
key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 524288
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
2020-07-30 12:18:12.654 INFO 42bdddc42c7e --- [ool-10-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-5, groupId=feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:12.655 INFO 42bdddc42c7e --- [t-runner-worker] o.a.b.s.i.k.KafkaUnboundedSource : Reader-0: reading from feast-features-0 starting at offset 0
2020-07-30 12:18:12.656 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.ConsumerConfig : ConsumerConfig values:
allow.auto.create.topics = true
auto.commit.interval.ms = 5000
auto.offset.reset = latest
bootstrap.servers = [kafka:9092, localhost:9094]
check.crcs = true
client.dns.lookup = default
client.id =
client.rack =
connections.max.idle.ms = 540000
default.api.timeout.ms = 60000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical
group.instance.id = null
heartbeat.interval.ms = 3000
interceptor.classes = []
internal.leave.group.on.close = true
isolation.level = read_uncommitted
key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 524288
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
2020-07-30 12:18:12.657 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:12.657 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:12.657 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111492657
2020-07-30 12:18:12.659 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.KafkaConsumer : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Subscribed to partition(s): feast-specs-0
2020-07-30 12:18:12.661 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:12.664 WARN 42bdddc42c7e --- [t-runner-worker] o.a.k.c.NetworkClient : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-07-30 12:18:12.665 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:12.666 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:12.666 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111492665
2020-07-30 12:18:12.667 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.KafkaConsumer : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Subscribed to partition(s): feast-features-0
2020-07-30 12:18:12.668 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:12.673 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.Metadata : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:18:12.676 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.Metadata : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:18:12.678 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 1.
2020-07-30 12:18:12.680 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:12.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:12.686 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:12.690 INFO 42bdddc42c7e --- [t-runner-worker] o.a.b.s.i.k.KafkaUnboundedSource : Reader-0: first record offset 0
2020-07-30 12:18:12.691 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:12.704 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 1.
2020-07-30 12:18:13.681 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:13.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:13.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 1.
2020-07-30 12:18:13.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:14.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:14.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:14.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 1.
2020-07-30 12:18:14.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:15.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:15.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:15.683 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:15.683 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 1.
2020-07-30 12:18:16.683 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:16.683 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:16.685 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:16.686 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 1.
2020-07-30 12:18:17.466 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:18:17.487 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs...
2020-07-30 12:18:17.487 AUDIT 42bdddc42c7e --- [ool-13-thread-1] f.c.l.AuditLogger : {action=SUBMIT, detail=Building graph and submitting to DirectRunner, id=kafka-2111741832-to-online-1596111497478, resource=JOB, timestamp=Thu Jul 30 12:18:17 UTC 2020}
2020-07-30 12:18:17.491 INFO 42bdddc42c7e --- [ool-13-thread-1] f.i.ImportJob : Starting import job with settings:
Current Settings:
appName: DirectRunnerJobManager
blockOnRun: false
defaultFeastProject: default
enforceEncodability: true
enforceImmutability: true
gcsPerformanceMetrics: false
jobName: kafka-2111741832-to-online-1596111497478
optionsId: 6
project:
runner: class org.apache.beam.runners.direct.DirectRunner
sourceJson: {
"type": "KAFKA",
"kafkaSourceConfig": {
"bootstrapServers": "kafka:9092,localhost:9094",
"topic": "feast-features"
}
}
specsStreamingUpdateConfigJson: {
"source": {
"bootstrapServers": "kafka:9092,localhost:9094",
"topic": "feast-specs"
},
"ack": {
"bootstrapServers": "kafka:9092,localhost:9094",
"topic": "feast-specs-ack"
}
}
stableUniqueNames: WARNING
storesJson: [{
"name": "online",
"type": "REDIS",
"subscriptions": [{
"name": "*",
"project": "*"
}],
"redisConfig": {
"host": "redis",
"port": 6379
}
}]
2020-07-30 12:18:17.681 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:17.681 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:17.683 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:17.683 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 1.
2020-07-30 12:18:17.732 INFO 42bdddc42c7e --- [ool-13-thread-1] i.l.c.EpollProvider : Starting without optional epoll library
2020-07-30 12:18:17.734 INFO 42bdddc42c7e --- [ool-13-thread-1] i.l.c.KqueueProvider : Starting without optional kqueue library
2020-07-30 12:18:17.960 INFO 42bdddc42c7e --- [ool-13-thread-1] o.a.k.c.c.ConsumerConfig : ConsumerConfig values:
allow.auto.create.topics = true
auto.commit.interval.ms = 5000
auto.offset.reset = earliest
bootstrap.servers = [kafka:9092, localhost:9094]
check.crcs = true
client.dns.lookup = default
client.id =
client.rack =
connections.max.idle.ms = 540000
default.api.timeout.ms = 60000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = null
group.instance.id = null
heartbeat.interval.ms = 3000
interceptor.classes = []
internal.leave.group.on.close = true
isolation.level = read_uncommitted
key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 524288
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
2020-07-30 12:18:17.962 INFO 42bdddc42c7e --- [ool-13-thread-1] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:17.962 INFO 42bdddc42c7e --- [ool-13-thread-1] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:17.962 INFO 42bdddc42c7e --- [ool-13-thread-1] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111497962
2020-07-30 12:18:17.967 INFO 42bdddc42c7e --- [ool-13-thread-1] o.a.b.s.i.k.KafkaUnboundedSource : Partitions assigned to split 0 (total 1): feast-specs-0
2020-07-30 12:18:17.970 INFO 42bdddc42c7e --- [ool-13-thread-1] o.a.k.c.c.ConsumerConfig : ConsumerConfig values:
allow.auto.create.topics = true
auto.commit.interval.ms = 5000
auto.offset.reset = latest
bootstrap.servers = [kafka:9092, localhost:9094]
check.crcs = true
client.dns.lookup = default
client.id =
client.rack =
connections.max.idle.ms = 540000
default.api.timeout.ms = 60000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = feast_import_job_kafka-2111741832-to-online
group.instance.id = null
heartbeat.interval.ms = 3000
interceptor.classes = []
internal.leave.group.on.close = true
isolation.level = read_committed
key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 524288
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
2020-07-30 12:18:17.974 INFO 42bdddc42c7e --- [ool-13-thread-1] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:17.974 INFO 42bdddc42c7e --- [ool-13-thread-1] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:17.974 INFO 42bdddc42c7e --- [ool-13-thread-1] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111497974
2020-07-30 12:18:17.975 WARN 42bdddc42c7e --- [ool-13-thread-1] o.a.k.c.NetworkClient : [Consumer clientId=consumer-9, groupId=feast_import_job_kafka-2111741832-to-online] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-07-30 12:18:18.077 WARN 42bdddc42c7e --- [ool-13-thread-1] o.a.k.c.NetworkClient : [Consumer clientId=consumer-9, groupId=feast_import_job_kafka-2111741832-to-online] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-07-30 12:18:18.179 WARN 42bdddc42c7e --- [ool-13-thread-1] o.a.k.c.NetworkClient : [Consumer clientId=consumer-9, groupId=feast_import_job_kafka-2111741832-to-online] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-07-30 12:18:18.284 INFO 42bdddc42c7e --- [ool-13-thread-1] o.a.k.c.Metadata : [Consumer clientId=consumer-9, groupId=feast_import_job_kafka-2111741832-to-online] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:18:18.287 INFO 42bdddc42c7e --- [ool-13-thread-1] o.a.b.s.i.k.KafkaUnboundedSource : Partitions assigned to split 0 (total 1): feast-features-0
2020-07-30 12:18:18.287 AUDIT 42bdddc42c7e --- [ool-13-thread-1] f.c.l.AuditLogger : {action=STATUS_CHANGE, detail=Job submitted to runner DirectRunner with ext id kafka-2111741832-to-online-1596111497478., id=kafka-2111741832-to-online-1596111497478, resource=JOB, timestamp=Thu Jul 30 12:18:18 UTC 2020}
2020-07-30 12:18:18.293 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.ConsumerConfig : ConsumerConfig values:
allow.auto.create.topics = true
auto.commit.interval.ms = 5000
auto.offset.reset = earliest
bootstrap.servers = [kafka:9092, localhost:9094]
check.crcs = true
client.dns.lookup = default
client.id =
client.rack =
connections.max.idle.ms = 540000
default.api.timeout.ms = 60000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = null
group.instance.id = null
heartbeat.interval.ms = 3000
interceptor.classes = []
internal.leave.group.on.close = true
isolation.level = read_uncommitted
key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 524288
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
2020-07-30 12:18:18.294 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.ConsumerConfig : ConsumerConfig values:
allow.auto.create.topics = true
auto.commit.interval.ms = 5000
auto.offset.reset = latest
bootstrap.servers = [kafka:9092, localhost:9094]
check.crcs = true
client.dns.lookup = default
client.id =
client.rack =
connections.max.idle.ms = 540000
default.api.timeout.ms = 60000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = feast_import_job_kafka-2111741832-to-online
group.instance.id = null
heartbeat.interval.ms = 3000
interceptor.classes = []
internal.leave.group.on.close = true
isolation.level = read_committed
key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 524288
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
2020-07-30 12:18:18.298 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:18.298 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:18.298 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111498298
2020-07-30 12:18:18.300 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.KafkaConsumer : [Consumer clientId=consumer-10, groupId=null] Subscribed to partition(s): feast-specs-0
2020-07-30 12:18:18.305 WARN 42bdddc42c7e --- [ool-18-thread-1] o.a.k.c.NetworkClient : [Consumer clientId=consumer-10, groupId=null] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-07-30 12:18:18.306 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:18.306 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:18.306 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111498306
2020-07-30 12:18:18.307 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.KafkaConsumer : [Consumer clientId=consumer-11, groupId=feast_import_job_kafka-2111741832-to-online] Subscribed to partition(s): feast-features-0
2020-07-30 12:18:18.313 INFO 42bdddc42c7e --- [ool-18-thread-1] o.a.k.c.Metadata : [Consumer clientId=consumer-10, groupId=null] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:18:18.315 INFO 42bdddc42c7e --- [ool-20-thread-1] o.a.k.c.Metadata : [Consumer clientId=consumer-11, groupId=feast_import_job_kafka-2111741832-to-online] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:18:18.316 INFO 42bdddc42c7e --- [ool-20-thread-1] o.a.k.c.c.i.AbstractCoordinator : [Consumer clientId=consumer-11, groupId=feast_import_job_kafka-2111741832-to-online] Discovered group coordinator kafka:9092 (id: 2147482646 rack: null)
2020-07-30 12:18:18.317 INFO 42bdddc42c7e --- [ool-18-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-10, groupId=null] Resetting offset for partition feast-specs-0 to offset 0.
2020-07-30 12:18:18.318 INFO 42bdddc42c7e --- [t-runner-worker] o.a.b.s.i.k.KafkaUnboundedSource : Reader-0: reading from feast-specs-0 starting at offset 0
2020-07-30 12:18:18.319 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.ConsumerConfig : ConsumerConfig values:
allow.auto.create.topics = true
auto.commit.interval.ms = 5000
auto.offset.reset = earliest
bootstrap.servers = [kafka:9092, localhost:9094]
check.crcs = true
client.dns.lookup = default
client.id =
client.rack =
connections.max.idle.ms = 540000
default.api.timeout.ms = 60000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = Reader-0_offset_consumer_1879908525_none
group.instance.id = null
heartbeat.interval.ms = 3000
interceptor.classes = []
internal.leave.group.on.close = true
isolation.level = read_uncommitted
key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 524288
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
2020-07-30 12:18:18.322 INFO 42bdddc42c7e --- [ool-20-thread-1] o.a.k.c.c.i.ConsumerCoordinator : [Consumer clientId=consumer-11, groupId=feast_import_job_kafka-2111741832-to-online] Found no committed offset for partition feast-features-0
2020-07-30 12:18:18.327 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:18.327 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:18.328 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111498326
2020-07-30 12:18:18.329 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.KafkaConsumer : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Subscribed to partition(s): feast-specs-0
2020-07-30 12:18:18.329 INFO 42bdddc42c7e --- [ool-20-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-11, groupId=feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:18.330 INFO 42bdddc42c7e --- [t-runner-worker] o.a.b.s.i.k.KafkaUnboundedSource : Reader-0: reading from feast-features-0 starting at offset 0
2020-07-30 12:18:18.331 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:18.331 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.ConsumerConfig : ConsumerConfig values:
allow.auto.create.topics = true
auto.commit.interval.ms = 5000
auto.offset.reset = latest
bootstrap.servers = [kafka:9092, localhost:9094]
check.crcs = true
client.dns.lookup = default
client.id =
client.rack =
connections.max.idle.ms = 540000
default.api.timeout.ms = 60000
enable.auto.commit = false
exclude.internal.topics = true
fetch.max.bytes = 52428800
fetch.max.wait.ms = 500
fetch.min.bytes = 1
group.id = Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online
group.instance.id = null
heartbeat.interval.ms = 3000
interceptor.classes = []
internal.leave.group.on.close = true
isolation.level = read_uncommitted
key.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
max.partition.fetch.bytes = 1048576
max.poll.interval.ms = 300000
max.poll.records = 500
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partition.assignment.strategy = [class org.apache.kafka.clients.consumer.RangeAssignor]
receive.buffer.bytes = 524288
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
session.timeout.ms = 10000
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
value.deserializer = class org.apache.kafka.common.serialization.ByteArrayDeserializer
2020-07-30 12:18:18.335 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:18.335 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:18.335 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111498335
2020-07-30 12:18:18.337 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.KafkaConsumer : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Subscribed to partition(s): feast-features-0
2020-07-30 12:18:18.338 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.Metadata : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:18:18.340 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:18.341 WARN 42bdddc42c7e --- [t-runner-worker] o.a.k.c.NetworkClient : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-07-30 12:18:18.344 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 1.
2020-07-30 12:18:18.345 INFO 42bdddc42c7e --- [t-runner-worker] o.a.b.s.i.k.KafkaUnboundedSource : Reader-0: first record offset 0
2020-07-30 12:18:18.346 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.Metadata : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:18:18.349 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:18.353 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Sending new FeatureSet default/customer_transactions to Ingestion
2020-07-30 12:18:18.354 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 1.
2020-07-30 12:18:18.355 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:18.370 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:18.378 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:18.588 WARN 42bdddc42c7e --- [t-runner-worker] o.a.b.s.u.MutationDetectors : Coder of type class org.apache.beam.sdk.io.kafka.ProducerRecordCoder has a #structuralValue method which does not return true when the encoding of the elements is equal. Element ProducerRecord(topic=feast-specs-ack, partition=null, headers=RecordHeaders(headers = [], isReadOnly = false), key=default/customer_transactions, value=[B@5b3b664b, timestamp=null)
2020-07-30 12:18:18.598 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.p.ProducerConfig : ProducerConfig values:
acks = 1
batch.size = 16384
bootstrap.servers = [kafka:9092, localhost:9094]
buffer.memory = 33554432
client.dns.lookup = default
client.id =
compression.type = none
connections.max.idle.ms = 540000
delivery.timeout.ms = 120000
enable.idempotence = false
interceptor.classes = []
key.serializer = class org.apache.kafka.common.serialization.StringSerializer
linger.ms = 0
max.block.ms = 60000
max.in.flight.requests.per.connection = 5
max.request.size = 1048576
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner
receive.buffer.bytes = 32768
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retries = 3
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
transaction.timeout.ms = 60000
transactional.id = null
value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer
2020-07-30 12:18:18.602 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:18.602 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:18.602 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111498602
2020-07-30 12:18:18.605 WARN 42bdddc42c7e --- [ad | producer-2] o.a.k.c.NetworkClient : [Producer clientId=producer-2] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-07-30 12:18:18.609 INFO 42bdddc42c7e --- [ad | producer-2] o.a.k.c.Metadata : [Producer clientId=producer-2] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:18:18.611 WARN 42bdddc42c7e --- [t-runner-worker] o.a.b.s.u.MutationDetectors : Coder of type class org.apache.beam.sdk.io.kafka.ProducerRecordCoder has a #structuralValue method which does not return true when the encoding of the elements is equal. Element ProducerRecord(topic=feast-specs-ack, partition=null, headers=RecordHeaders(headers = [], isReadOnly = false), key=default/customer_transactions, value=[B@7d886547, timestamp=null)
2020-07-30 12:18:18.617 WARN 42bdddc42c7e --- [t-runner-worker] o.a.b.s.u.MutationDetectors : Coder of type class org.apache.beam.sdk.io.kafka.ProducerRecordCoder has a #structuralValue method which does not return true when the encoding of the elements is equal. Element ProducerRecord(topic=feast-specs-ack, partition=null, headers=RecordHeaders(headers = [], isReadOnly = false), key=default/customer_transactions, value=[B@7d886547, timestamp=null)
2020-07-30 12:18:18.628 INFO 42bdddc42c7e --- [ntainer#0-0-C-1] f.c.s.JobCoordinatorService : Updating featureSet default/customer_transactions delivery statuses.
2020-07-30 12:18:18.681 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:18.681 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:18.683 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:18.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:18.690 WARN 42bdddc42c7e --- [t-runner-worker] o.a.b.s.u.MutationDetectors : Coder of type class org.apache.beam.sdk.io.kafka.ProducerRecordCoder has a #structuralValue method which does not return true when the encoding of the elements is equal. Element ProducerRecord(topic=feast-specs-ack, partition=null, headers=RecordHeaders(headers = [], isReadOnly = false), key=default/customer_transactions, value=[B@5512bef, timestamp=null)
2020-07-30 12:18:18.693 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.p.ProducerConfig : ProducerConfig values:
acks = 1
batch.size = 16384
bootstrap.servers = [kafka:9092, localhost:9094]
buffer.memory = 33554432
client.dns.lookup = default
client.id =
compression.type = none
connections.max.idle.ms = 540000
delivery.timeout.ms = 120000
enable.idempotence = false
interceptor.classes = []
key.serializer = class org.apache.kafka.common.serialization.StringSerializer
linger.ms = 0
max.block.ms = 60000
max.in.flight.requests.per.connection = 5
max.request.size = 1048576
metadata.max.age.ms = 300000
metric.reporters = []
metrics.num.samples = 2
metrics.recording.level = INFO
metrics.sample.window.ms = 30000
partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner
receive.buffer.bytes = 32768
reconnect.backoff.max.ms = 1000
reconnect.backoff.ms = 50
request.timeout.ms = 30000
retries = 3
retry.backoff.ms = 100
sasl.client.callback.handler.class = null
sasl.jaas.config = null
sasl.kerberos.kinit.cmd = /usr/bin/kinit
sasl.kerberos.min.time.before.relogin = 60000
sasl.kerberos.service.name = null
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.ticket.renew.window.factor = 0.8
sasl.login.callback.handler.class = null
sasl.login.class = null
sasl.login.refresh.buffer.seconds = 300
sasl.login.refresh.min.period.seconds = 60
sasl.login.refresh.window.factor = 0.8
sasl.login.refresh.window.jitter = 0.05
sasl.mechanism = GSSAPI
security.protocol = PLAINTEXT
send.buffer.bytes = 131072
ssl.cipher.suites = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
ssl.endpoint.identification.algorithm = https
ssl.key.password = null
ssl.keymanager.algorithm = SunX509
ssl.keystore.location = null
ssl.keystore.password = null
ssl.keystore.type = JKS
ssl.protocol = TLS
ssl.provider = null
ssl.secure.random.implementation = null
ssl.trustmanager.algorithm = PKIX
ssl.truststore.location = null
ssl.truststore.password = null
ssl.truststore.type = JKS
transaction.timeout.ms = 60000
transactional.id = null
value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer
2020-07-30 12:18:18.697 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka version: 2.3.0
2020-07-30 12:18:18.697 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka commitId: fc1aaa116b661c8a
2020-07-30 12:18:18.697 INFO 42bdddc42c7e --- [t-runner-worker] o.a.k.c.u.AppInfoParser : Kafka startTimeMs: 1596111498695
2020-07-30 12:18:18.699 WARN 42bdddc42c7e --- [ad | producer-3] o.a.k.c.NetworkClient : [Producer clientId=producer-3] Connection to node -2 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-07-30 12:18:18.702 INFO 42bdddc42c7e --- [ad | producer-3] o.a.k.c.Metadata : [Producer clientId=producer-3] Cluster ID: 8ETcn4-iQc-GADAvTZmi-Q
2020-07-30 12:18:18.703 WARN 42bdddc42c7e --- [t-runner-worker] o.a.b.s.u.MutationDetectors : Coder of type class org.apache.beam.sdk.io.kafka.ProducerRecordCoder has a #structuralValue method which does not return true when the encoding of the elements is equal. Element ProducerRecord(topic=feast-specs-ack, partition=null, headers=RecordHeaders(headers = [], isReadOnly = false), key=default/customer_transactions, value=[B@6889f524, timestamp=null)
2020-07-30 12:18:18.711 WARN 42bdddc42c7e --- [t-runner-worker] o.a.b.s.u.MutationDetectors : Coder of type class org.apache.beam.sdk.io.kafka.ProducerRecordCoder has a #structuralValue method which does not return true when the encoding of the elements is equal. Element ProducerRecord(topic=feast-specs-ack, partition=null, headers=RecordHeaders(headers = [], isReadOnly = false), key=default/customer_transactions, value=[B@6889f524, timestamp=null)
2020-07-30 12:18:18.717 INFO 42bdddc42c7e --- [ntainer#0-0-C-1] f.c.s.JobCoordinatorService : Updating featureSet default/customer_transactions delivery statuses.
2020-07-30 12:18:19.344 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:19.346 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:19.356 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:19.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:19.681 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:19.681 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:19.683 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:19.683 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:20.349 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:20.351 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:20.356 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:20.359 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:20.681 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:20.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:20.683 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:20.683 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:21.344 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:21.346 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:21.356 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:21.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:21.698 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:21.698 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:21.700 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:21.701 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:22.344 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:22.346 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:22.356 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:22.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:22.681 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:22.681 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:22.683 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:22.683 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:23.308 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:18:23.319 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs...
2020-07-30 12:18:23.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:23.346 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:23.356 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:23.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:23.681 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:23.681 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:23.683 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:23.683 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:24.344 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:24.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:24.356 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:24.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:24.681 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:24.681 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:24.683 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:24.683 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:25.344 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:25.346 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:25.356 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:25.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:25.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:25.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:25.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:25.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:26.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:26.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:26.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:26.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:26.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:26.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:26.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:26.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:27.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:27.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:27.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:27.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:27.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:27.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:27.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:27.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:28.326 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:18:28.339 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs...
2020-07-30 12:18:28.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:28.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:28.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:28.359 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:28.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:28.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:28.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:28.687 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:29.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:29.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:29.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:29.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:29.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:29.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:29.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:29.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:30.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:30.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:30.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:30.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:30.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:30.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:30.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:30.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:31.346 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:31.348 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:31.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:31.361 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:31.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:31.683 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:31.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:31.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:32.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:32.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:32.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:32.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:32.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:32.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:32.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:32.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:33.344 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:18:33.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:33.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:33.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:33.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:33.358 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs...
2020-07-30 12:18:33.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:33.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:33.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:33.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:34.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:34.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:34.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:34.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:34.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:34.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:34.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:34.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:35.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:35.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:35.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:35.359 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:35.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:35.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:35.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:35.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:36.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:36.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:36.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:36.360 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:36.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:36.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:36.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:36.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:37.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:37.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:37.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:37.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:37.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:37.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:37.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:37.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:38.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:38.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:38.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:38.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:38.361 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:18:38.373 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs...
2020-07-30 12:18:38.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:38.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:38.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:38.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:39.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:39.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:39.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:39.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:39.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:39.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:39.683 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:39.683 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:40.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:40.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:40.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:40.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:40.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:40.683 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:40.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:40.685 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:41.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:41.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:41.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:41.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:41.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:41.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:41.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:41.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:42.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:42.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:42.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:42.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:42.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:42.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:42.683 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:42.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:43.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:43.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:43.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:43.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:43.377 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:18:43.392 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs...
2020-07-30 12:18:43.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:43.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:43.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:43.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:44.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:44.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:44.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:44.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:44.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:44.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:44.683 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:44.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:45.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:45.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:45.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:45.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:45.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:45.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:45.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:45.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:46.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:46.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:46.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:46.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:46.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:46.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:46.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:46.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:47.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:47.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:47.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:47.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:47.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:47.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:47.683 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:47.683 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:48.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:48.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:48.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:48.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:48.396 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Polling for new jobs...
2020-07-30 12:18:48.408 INFO 42bdddc42c7e --- [pool-3-thread-1] f.c.s.JobCoordinatorService : Creating/Updating 2 jobs...
2020-07-30 12:18:48.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:48.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:48.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:48.684 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:49.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:49.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:49.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:49.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:49.682 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:49.682 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:49.684 INFO 42bdddc42c7e --- [ool-12-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-7, groupId=Reader-0_offset_consumer_184267040_feast_import_job_kafka-2111741832-to-historical] Resetting offset for partition feast-features-0 to offset 0.
2020-07-30 12:18:49.687 INFO 42bdddc42c7e --- [ool-11-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-6, groupId=Reader-0_offset_consumer_1701034568_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:50.345 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Seeking to LATEST offset of partition feast-specs-0
2020-07-30 12:18:50.347 INFO 42bdddc42c7e --- [ool-19-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-12, groupId=Reader-0_offset_consumer_1879908525_none] Resetting offset for partition feast-specs-0 to offset 2.
2020-07-30 12:18:50.357 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Seeking to LATEST offset of partition feast-features-0
2020-07-30 12:18:50.358 INFO 42bdddc42c7e --- [ool-21-thread-1] o.a.k.c.c.i.SubscriptionState : [Consumer clientId=consumer-13, groupId=Reader-0_offset_consumer_1016689630_feast_import_job_kafka-2111741832-to-online] Resetting offset for partition feast-features-0 to offset 0.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment