People say they're Catholic because they were baptized Catholic, and maybe went to catechism, etc. The Church still runs the Birth, Marriages, and Deaths rituals, so people use the Church on those occasions. It's not dissimilar to British attitudes to the Anglican Church. (I'm talking about attitudes, not institutional issues of Church and State).

France is kinda Catholic, but secularism permeates society deeply.