[BUG] Token count displaying as 0 when using Langchain auto-instrumentor with Vertex

[millers1389]

Describe the bug
The token count will only display as 0 when using Langchain autoinstrumentor with Vertex
The proper token counts are shown in the output but not where we show the token count in the UI

To Reproduce
Steps to reproduce the behavior:

1. Add langchain autoinstrumentor to your langchain application that uses Vertex as the LLM provider
2. Run a sample query
3. Observe the token count for the trace in Phoenix is 0

Expected behavior
The proper token count for each trace should be displayed

Screenshots
See comments below

Additional context
Colab for reproducing

[trevor-laviale-arize]

When using the langchain autoinstrumentor in a langchain application w/ Vertex, the token counts show as 0. I think it's because the tokens are logged in a different way than the openinference semantic conventions.

[axiomofjoy]

Thanks for reporting @millers1389! Looks like that Colab is private, I have requested access.

[millers1389]

Just granted access! Let me know if you have any other questions!

[axiomofjoy]

Thanks @millers1389 !

[nate-mar]

HI @millers1389 -- Can you grant me access to the notebook as well? Thanks!

[nate-mar]

Can you also print out the package versions of your dependencies?

[nate-mar]

Accidentally closed this.