Large samples of field horizontal branch (FHB) stars make excellent tracers of the Galactic halo; by studying their kinematics, one can infer important physical properties of our Galaxy. Here we present the results of a medium-resolution spectroscopic survey of 530 FHB stars selected from the Hamburg/ESO survey. The stars have a mean distance of ~7 kpc and thus probe the inner parts of the Milky Way halo. We measure radial velocities from the spectra in order to test the model of Sommer-Larsen et al., who suggested that the velocity ellipsoid of the halo changes from radially dominated orbits to tangentially dominated orbits as one proceeds from the inner to the outer halo. We find that the present data are unable to discriminate between this model and a more simple isothermal ellipsoid; we suggest that additional observations towards the Galactic Centre might help to differentiate them.