Difference between Come down on someone and Come down to someone

come down on someone—

1. demand smth. firmly from a person:

• Things looked good until the State came down on me for sales tax.

2. reprimand or criticize a person severely:

• Many people came down on me for publishing my book.

come down to someone—be passed on to smb.:

• This photo, which came down to me from my uncle, shows Benjamin Rollings outside his house.

See also: come up to something / go up to something.