It surprises me a bit that a parent would bite a child in order to teach the child not to bite others. This is a little bit like spanking a child for hitting his brother. Rather than helping him change an inappropriate behavior, you are reinforcing it and sending him the message that it's okay to treat others this way. This is "dark ages" parenting at its worst. And as you've discovered, it does not work.
There is so much I would like to share with you about this, but first, read my parenting book, Keepers of the Children to discover how to overcome the negative aspects of your upbringing, so you do not pass them on to your children.
Also you may want to read an article that I wrote previously in response to a parent's question about child biting.
I applaud you for asking this question in the first place and for being concerned about your child's behavior and the well-being of other kids.