Tick params get bigger as I make fig smaller

I am displaying a seaborn plot but it shows up too big. I am reducing the size with figsize and the plot does get smaller but the tick labels and axes get bigger.
image