If a friend let me drive his car while he was in it and I hit a deer, am I legally responsible to pay for the damages?

Yes you are. The laws of the state where it happen may well dictate a different answer so you would have to constult an attorney in the state where it happened. In the State of Florida you would be responsible for the damages because you were in possesion of the vehicle when it was damaged.