I just tried with an empty panel and I can’t reproduce it. This is a panel that used a font installed on Windows. Once you added embedded fonts, I imported the font in the panel and uninstalled the font from Windows to avoid conflicts between both fonts (I renamed the imported font but it seems Ctrlr picks the name from inside the .ttf file, so renaming does nothing and both fonts have the same internal name).
But even uninstalling the font from Windows it seems that the panel still try to get the font from the system, and as it’s not there, it replace it with the default font.
I’ve searched in the panel and I can’t find anywhere any difference in the font selected for every component, as the route for this font is not visible. Every modulator I pick to check it’s font has assigned the imported font, so I can’t really know what to do, I think the best solution will be to use any other font.