Duplicate IP addresses keep getting overwritten when using contexts

I have two two cisco 93180YC setup in a vPC and running vxlan. I have fabric forwarding mode anycast-gateway enabled. they have the same svi and identical ip addresses.

I enabled vrf contexts to see about getting ip addresses populated for the interface.

when I discover one device the ip address shows up with a new ipv4_address_id.

Here is a pic for what I am seeing. This is for every ip address that is duplicate between the two systems. At full scale this same IP address can exist on every top of rack vPC switch where I need the anycast gateway.