sudo apt-get install trash-cli
Just that easy. Isn't Ubuntu wonderful?
trash — Throw that file away.
list-trash — Show what's in the trash directory.
restore-trash — Take something out of the trash directory.
empty-trash — Finally toss that stuff away.
As a suspicion, I guess I will never really use the last three, the graphical equivalent being enough for me, but killing files? That's always been a command-line thing for me.