Do I have to let the father of my son see him?

Is there a court order?  If not, then no.  The father of the child can file a parentage action and petition the court for custody and visitation, which he may or may not be awarded.  Until there is any court order, you have no obligation to have your son see his father.