Can I take away someone's easement right on my property?

No, unfortunately you cannot take away his easement. An easement is essentially a property right in many ways; like other property rights, it cannot be taken away because someone is a bad neighbor.

Of course, if he injuries anyone or damages anything, he can be held liable.

You may also take steps such as the installation of speed bumps, or changing the shape of any ingress or egress to the lot, or putting down certain concrete barriers or islands, to slow him down. You have to provide him access--but since you still own the land, you may take reasonable steps to control traffic.