I am NO expert (obviously) but I personally think it's obvious that he is begging for your attention....have you considered having him live with you for a while? Maybe he asked to live with him dad but actually wanted you to make him stay....
dunno - just a thought....I will def say a prayer asking the Lord to guide your hand in this.....
Good luck to you and your family