Services working with children need to look beyond the children's problems to spot neglect, inspectors say.