@Chad_Mitchell, fantastic answer, thank you so much! I had to adapt the CSS a bit to make it look like the new button design (guess streamlit changed it slightly since your original solution), maybe you can update this in your answer:
#{button_id} {{
display: inline-flex;
align-items: center;
justify-content: center;
background-color: rgb(255, 255, 255);
color: rgb(38, 39, 48);
padding: .25rem .75rem;
position: relative;
text-decoration: none;
border-radius: 4px;
border-width: 1px;
border-style: solid;
border-color: rgb(230, 234, 241);
border-image: initial;
}}