I'd be surprised if basic arithmetic - certainly addition, possibly subtraction, probably not anything more advanced - wasn't similarly rooted in experience.
But the basic point was that arithmetic is rooted in experience, and doesn't exist independently of it. Trying to prove it using formal logic makes for an interesting scenic trip, but eventually you end up standing over a hole which logic can't fill for you.