I remember going here many moons ago and having no trouble, but have heard some tales since.
http://www.geocities.com/Athens/Parthenon/6197/hordtop.htm
Several other net based reports say that it is on 'private land with no public access ... permission must be obtained'.
The CA right to roam map also shows no access.
Sometimes you just have to jump that fence and run!!