Brahms had little sense of humor 
Brahms was a very funny guy, read the letters he wrote to his friends!
Brahms had little sense of self-irony compared to the other ones
In other words he would often take himself too seriously (see the biographic meetings with the other composers, collegues playing his pieces and the controversies with the more romantic elite Tchaikovsky & Co.)