I'm pretty sure there's no such thing as white culture and heritage, and there's definitely no such thing as white language.

I mean, as a white person, I have an inheritance of language and culture that I value, but I'd bet it's different from yours.  

Different white people have different backgrounds, just like different black or Asian or aboriginal people have different languages, cultures, and heritage.

If you want to celebrate your culture and heritage and language, go ahead, nobody is stopping you.  

Unless of course you consider racism as part of your heritage, in which case, good people will step up to stop you.