So, I had to make sure that even if producer is not producing any new messaging, the consumer should be able to reprocess the existing messages to remain fuller when it comes to data. There are two things which could…
Author: pallavy.com
There are lots of questions that pops up my mind regarding any message broker. One of which is what happens to the message once it is consumed. Here is where the offset management comes in. Actually, kafka tracks the position…
As a part of the series of designing a market data feed handler system, this is the best usecase I found on internet. A High-Frequency Trading (HFT) firm needs to implement a robust market data feed handler system to support…
Lately I have been attracted to trading and risk management domain, have always found the financial sector interesting. This is specially interesting because I am trying to capture live data live, no database involved. The flow is quite simple. There…
So, I created a bad request at aroung 5 am today and one good request now, and I wanted to check how many failed attempts have been made. This might sound naive here but in real time there would be…
24th July was all about Kafka, and here now its 25th July. I started at 10.00 pm night and wrappd this up now. So, I thought of inculcating Kafka as the message broker for logging the logs onto the database….
Decorating the methods with enhancements can be cumbersome. Recording transactions was the next stuff I wanted to do. It took me a day to do that stuff however. Its 3 am at night or morning whatever, I am feeling sleepy…
This is all about Retry Logics! This is part2 where I am testing the starter boiler code for the payment flow. I was specifically looking forward to make this system robust as I suspect there could be times when there…
So, I was working on a mock project of mine. This is my brainchild project in which I intend to explore various components of python and programming in general. I just thought of documenting the same. So, here I am……….
This is going to be really comprehensive. Recently, I integrated shopify with django and react and created a public with a simple login and registration page. I spent two days trying to figure out the tech stack to be used…