Pin transformers version in pyproject.toml to prevent observability issues

[kosmalapg]

It may be beneficial to pin the transformers dependency in pyproject.toml:

AutoEmbeddings = [
    "transformers>=4.25, <4.53",

The latest versions of transformers register a global TracerProvider, which can break the observability stack for some Arize users.

See the relevant code in the transformers repository.

[arizedatngo]

@fjcasti1 could you take a look here

[kosmalapg]

They fixed it on main but it's not released as of now huggingface/transformers#39422