[math-fun] Stupid number theory Q re quadratic residues

The following question occurred to me on a long bike ride (?!?) yesterday: Suppose I know the quadratic character of a wrt N for lots of different N's. Under what conditions can I reconstruct N ? I.e., is there a "Chinese Remainder Theorem" for quadratic residues?