My ex said this to me and I am depressed and hurt over it?

Get full custody of your kid. Ignore him. If this man has no respect for you, in which he insults your only family member who passed away, just cut him from your life. As hard as it may be, with the fact you have a child, your kid would be better off without someone like that to pretty much disrespect their uncle's death.