I needed to add a border to the arrow in the Popover component from radix-ui.
The HTML that is generated looks something like this:
<svg style="display: block;" width="10" height="5" viewBox="0 0 30 10" preserveAspectRatio="none">
<polygon points="0,0 30,0 15,10"></polygon>
</svg>


