have a brick in one's hat

Seated at the same table with our Mr.—, was a gentleman, who, to use the current phrase, ‘had a brick in his hat.’