List View with infinite scroll and "Exclude current user" doesn't work as expected

I have a ListView where I get all users based on some conditions.

List view works fine when I have either of them enabled. But if I have both "infinite scroll" and "Exclude current user" enabled, I see the current user data is included. Maybe the button is not working as expected when Infinite scroll is enabled.