Skip to content

Instantly share code, notes, and snippets.

View msmyers's full-sized avatar

Michael Smyers msmyers

64 followers · 275 following
View GitHub Profile
@msmyers
msmyers / how_to_reset_kafka_consumer_group_offset.md
Created March 25, 2022 23:32 — forked from marwei/how_to_reset_kafka_consumer_group_offset.md
How to Reset Kafka Consumer Group Offset

Kafka 0.11.0.0 (Confluent 3.3.0) added support to manipulate offsets for a consumer group via cli kafka-consumer-groups command.

  1. List the topics to which the group is subscribed
kafka-consumer-groups --bootstrap-server <kafkahost:port> --group <group_id> --describe

Note the values under "CURRENT-OFFSET" and "LOG-END-OFFSET". "CURRENT-OFFSET" is the offset where this consumer group is currently at in each of the partitions.

  1. Reset the consumer offset for a topic (preview)



  


  




    


          
    

      

        
        

          

              @msmyers
          

          

            
                msmyers
                / README.md
            
            

              Created
              May 29, 2021 05:17
                — forked from RichardBronosky/README.md
            

              
                Using cloud-init for cloudless provisioning of Raspberry Pi
              
          

        

      

        

  

      

    
Installing cloud-init on a fresh Raspbian Lite image


This is a work in Progress!


Purpose


This mainly demonstrates my goal of preparing a Raspberry Pi to be provisioned prior to its first boot. To do this I have chosen to use the same cloud-init that is the standard for provisioning servers at Amazon EC2, Microsoft Azure, OpenStack, etc.


I found this to be quite challenging because there is little information available for using cloud-init without a cloud. So, this project also servers as a demonstration for anyone on any version of Linux who may want to install from source, and/or use without a cloud. If you fall into that later group, you probably just want to read the code. It's bash so everything I do, you could also do at the command line. (Even the for loop.)



  


  




    


          
    

      

        
        

          

              @msmyers
          

          

            
                msmyers
                / ntp.conf
            
            

              Created
              February 4, 2021 06:37
                — forked from phillipuniverse/ntp.conf
            

              
                Set up NTP with Ansible, dedicating one as a timelord
              
          

        

      

        

  

    
    


        



  


  

        

          
          # /etc/ntp.conf, configuration for ntpd; see ntp.conf(5) for help
        

        

          
          

        

        

          
          driftfile /var/lib/ntp/ntp.drift
        

        

          
          

        

        

          
          

        

        

          
          # Enable this if you want statistics to be logged.
        

        

          
          #statsdir /var/log/ntpstats/
        

        

          
          

        

        

          
          statistics loopstats peerstats clockstats
        

        

          
          filegen loopstats file loopstats type day enable