Working hard or hardly working?

"You sure are working hard sitting there," he said to me, jokingly. "I'll see about getting you a raise."

-Lima Bean