The curious House of Perkunas was built in red brick in the 16th century as trade offices on the site of a former temple to the Lithuanian thunder god, Perkunas.