According to tradition, Castelfidardo derives its name from the castle of Count Giscardo, destroyed in the middle of the 13th century. The town lies on a hill, at the level of a detour of the road connecting Osimo with Loreto.