It looks like you are trying to do SSL offload with HAProxy.
What approach did you use to create your PEM file for HAProxy? The PEM file typically contains multiple certificates including the intermediate CA and root CA certificates.
ca-file is used to verify client certificates, so you can probably remove that.
Keep the CA certs here /etc/haproxy/certs/ as well.