I give up for now with Alpine. Annoying but there are some recommendations against using it… The best Docker base image for your Python application (June 2023). Maybe there are some prebuilt images with pyarrow that would work.
As for the security issues in Debian (FROM python:3.12-slim), the only High vulnerability I found was with the cryptography library. You can unload that in your Docker build with
RUN apt-get remove -y python3-cryptography
and then manually install the latest one with
RUN pip3 install cryptography
Optionally remove a medium vulnerabilitie with
RUN pip3 install --upgrade pip
Docker Scout is a great way to drill into security vulnerabilities.