To properly answer this question it is important to know if any legal proceedings occurred, any paperwork was signed, or if you just dropped off your child with his grandparents.
If you just allowed the grandparents of your son to take care of him and there were no legal proceedings or paperwork signed regarding this, then you may pick up your son.
However, even if you are legally able to do this without any ramifications, you should be aware that changing a child's environment can be traumatic for the child. So, it is best to work delicately to accomplish this or you may see your child acting out.
I would recommend that you speak with a child psychologist regarding the length of time your child has been with his grandparents and in his school and the best method to extricate him from that situation without having negative ramifications for him. For example, waiting until after the end of the school year would be less disruptive to your son. Additionally, if the grandparents have been caring for him full time and you have had limited contact with your son, you should phase in contact and not isolate him from the stable, loving environment he was in. Figure out ways to include the grandparents in his life and you will likely have a much smoother transition.
Good luck with your situation.
Sincerely
Leah Mayersohn
954-765-1900