You're right, these tracks play in the region of Fontaine, which is based on 19th century France. Please react to the new "Natlan Live Symphony Performance"! It released a week ago, and is the first piece of music we got from the upcoming region of Natlan, which draws inspiration from a vastly different area of the world than we have previously seen in Genshin! (I won't spoil it just yet for you!) ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-TyCB25oXUA4.html
I think the sound you're hearing at the beginning is probably a Neapolitan Mandolin from Italy/South Italy, which is in the lute family and specifically a tiny version of one; giving it it's characteristic higher pitch. :) Navia in the video, is Italian coded. She's the Boss of a group called Spina de Rosula.