You may not have any rights to property in your father's estate. Do you know if he left a Last Will? He could have written you OUT of a property bequest, so you'll need to see the Will.
If he didn't leave a will, then YES you can walk away from any property that he owned at his death. You'll need to give the estate administrator a form called "Election" showing that you are freely and voluntarily waiving your right to any inheritance from your father's estate. You should have an attorney write that waiver for you.