Input plugin with periodic record flush to filter

[rkhapre]

Hi

I have written a input plugin to read the data from Amazon Redshift, i am able to read the whole data and used this example input plugin and its working successfully.

Now let's say have i have 10,000 records, then the plugin waits to read the 10 K record from database. How can i make it to flush to filter periodically like after every 50 records.

I see in all input architecture first we need to consume all the records then only it goes to filter.

With what code we can achieve this flushing of record periodically?

[rkhapre]

@jsvd , i am not sure if anyone will look into this as i see this is inactive. I see you are the major contributor, so seeking help from you. Thanks