Sandeep Dwivedi

Pinned

Automatically restarting failed Kafka Connectors and Connect Tasks

Here’s a way to automatically restart Kafka Connect connectors if they fail. Restarting automatically only makes sense if it’s a transient failure; if there’s a problem with your pipeline (e.g. bad records or a mis-configured server) then you don’t gain anything from this. …

Kafka

2 min read

Pinned

GitHub Enterprise backup using Kubernetes Jobs and upload to AWS S3

We have a Enterprise GitHub environment, where the ask was to take hourly backup and send that to S3 bucket. We have moved it form traditional process to microservice, Here I am going to demonstrate how I have transferred this load to AWS EKS (Amazon Elastic Kubernetes Service). I have…

Aws Ecr

2 min read