It doesn't matter whether the program comes to you as an embedded applet on a web page, or come as a. Especially if you don't even know you're doing it.
It is insane to go around running every application you come across on the internet. Java is just as safe as any other programming language. It's safe to delete Java as long as you aren't using it.