Am I Allowed to Bring My Child On Home Visits?

I am a LVN that does house visits to patients and takess my 6 year old son with me. These patients have diseases, wounds to bandage, and pets and sometimes some of the patients live in terrible conditions. Is this ok to do to bring him along for safety and health reasons? Could I get in trouble? What happens if he injures himself at the patient's house? Is it my company's fault or homeowner's fault??