0.4.4 by teocns · Pull Request #848 · AgentOps-AI/agentops

teocns · 2025-03-14T23:50:33Z

Develop on dev and regular/squash merge INTO 0.4.4

Rebase and Merge 0.4.4 to main

Changelog

Reduce the delay of span export from five seconds to one second to avoid orphaned spans during unexpected system exits (not necessarily exceptions but explicit exits from other applications). Expose this configuration parameter as an environment variable
Fixes URL doesn't print in terminal when running with only agentops.init #838 @the-praxs
Fixes Error in CLI output using CrewAI #710 @tcdent
Restores support for Python 3.9 which has not yet reached EOL
Crew released version 105 which interacts with the legacy public API in a different manner. AgentOps is now integrated as a separate [module] (https://github.com/crewAIInc/crewAI/blob/main/src/crewai/utilities/events/third_party/agentops_listener.py) and we have included support for this refactor here.
Versions less than 105 were mostly covered by the existing implementation is also supported in this PR.
Tested with openai-agents to verify span export

Tests

Implements tests/unit/test_session_legacy.py to verify full backwards compatibility with CrewAI's and other libs
Removes deprecated failing tests:
- test_insturmentation.py
- test_instrumentation_errors.py
- test_core.py
Favors test_decorators.py
Adds an implementation of crew AI testing in test/unit/test_session_legacy.py

Notes

Type-checking errors are superficial. These can be resolved later in a different PR as it concerns developers more than the users. We might need to tweak the existing config to include more robust checks

% uv run mypy agentops
Bytecode compiled 18506 files in 786ms
agentops/helpers/system.py:7: error: Library stubs not installed for "psutil"  [import-untyped]
agentops/helpers/system.py:7: note: Hint: "python3 -m pip install types-psutil"
agentops/helpers/system.py:7: note: (or run "mypy --install-types" to install all missing stub packages)
agentops/helpers/system.py:7: note: See https://mypy.readthedocs.io/en/stable/running_mypy.html#missing-imports
agentops/sdk/decorators/factory.py:6: error: Skipping analyzing "wrapt": module is installed, but missing library stubs or py.typed marker  [import-untyped]
Found 2 errors in 2 files (checked 50 source files)

Refactored Agents SDK is a WIP and will be handled in a later release
90% test coverage to also be handled in the next release

Signed-off-by: Teo <teocns@gmail.com>

…rating processors) Signed-off-by: Teo <teocns@gmail.com>

Signed-off-by: Teo <teocns@gmail.com>

dot-agi

Minor change required.

tests/unit/conftest.py

dot-agi · 2025-03-15T17:25:31Z

Testing is required with crewAI.

Signed-off-by: Teo <teocns@gmail.com>

* show session url on init * fix: pass tags to start_session when auto-starting sessions Co-Authored-By: Constantin-Doru Teodorescu <teo@agentops.ai> * backwards compat: track_agent, end_all_sessions (#847) Signed-off-by: Teo <teocns@gmail.com> * Client.init() | auto_start_session | forward tags Signed-off-by: Teo <teocns@gmail.com> * client: recreate Config on init() Signed-off-by: Teo <teocns@gmail.com> * mock_req: /v3/auth/token to return { project_id, token, api_key } Signed-off-by: Teo <teocns@gmail.com> * cleanup dirty files Signed-off-by: Teo <teocns@gmail.com> * Isolate telemetry setup (`setup_telemetry`) Signed-off-by: Teo <teocns@gmail.com> * core shutdown: remove redundant initialized check Signed-off-by: Teo <teocns@gmail.com> * Simplify core shutdown (flush SynchronousSpanProcessor instead of iterating processors) Signed-off-by: Teo <teocns@gmail.com> * Improved TracingCore Config Signed-off-by: Teo <teocns@gmail.com> * tests: couple instrumentation tester with TracingCore's lifecycle Signed-off-by: Teo <teocns@gmail.com> * Base for test_session_legacy Signed-off-by: Teo <teocns@gmail.com> * uv lock Signed-off-by: Teo <teocns@gmail.com> * tests/benchmark/benchmark_init.py Signed-off-by: Teo <teocns@gmail.com> * Remove deprecated SDK tests - favor test_decorators Signed-off-by: Teo <teocns@gmail.com> * update `openai` dep and `uv.lock` file * fix: pass tags to start_session when auto-starting sessions Co-Authored-By: Constantin-Doru Teodorescu <teo@agentops.ai> * forgot `{` in `start_session` * remove `getattr` * fix for recursion and passing `default_tags` * client: recreate Config on init() Signed-off-by: Teo <teocns@gmail.com> * cleanup dirty files Signed-off-by: Teo <teocns@gmail.com> * Simplify core shutdown (flush SynchronousSpanProcessor instead of iterating processors) Signed-off-by: Teo <teocns@gmail.com> --------- Signed-off-by: Teo <teocns@gmail.com> Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com> Co-authored-by: Constantin-Doru Teodorescu <teo@agentops.ai> Co-authored-by: teocns <59549574+teocns@users.noreply.github.com> Co-authored-by: Teo <teocns@gmail.com>

…` event.

codecov · 2025-03-16T22:54:37Z

Codecov Report

Attention: Patch coverage is 68.61314% with 43 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
agentops/sdk/core.py	46.66%	16 Missing ⚠️
agentops/legacy/__init__.py	80.28%	14 Missing ⚠️
agentops/config.py	36.36%	7 Missing ⚠️
agentops/legacy/event.py	0.00%	3 Missing ⚠️
agentops/logging/config.py	75.00%	2 Missing ⚠️
agentops/client/client.py	83.33%	1 Missing ⚠️

📢 Thoughts on this report? Let us know!

compatibility for Crew 105 and Crew < 105.

…figuration parameter.

Signed-off-by: Teo <teocns@gmail.com>

dot-agi

❤️❤️

0.4.4

5bcd062

Signed-off-by: Teo <teocns@gmail.com>

teocns enabled auto-merge (squash) March 14, 2025 23:50

teocns and others added 13 commits March 15, 2025 01:51

Merge branch 'main' into 0.4.4

ad76782

Client.init() | auto_start_session | forward tags

bfa20ef

Signed-off-by: Teo <teocns@gmail.com>

client: recreate Config on init()

7f0c932

Signed-off-by: Teo <teocns@gmail.com>

mock_req: /v3/auth/token to return { project_id, token, api_key }

e1ce7a5

Signed-off-by: Teo <teocns@gmail.com>

cleanup dirty files

dc465d0

Signed-off-by: Teo <teocns@gmail.com>

Isolate telemetry setup (setup_telemetry)

693205b

Signed-off-by: Teo <teocns@gmail.com>

core shutdown: remove redundant initialized check

aaefaba

Signed-off-by: Teo <teocns@gmail.com>

Simplify core shutdown (flush SynchronousSpanProcessor instead of ite…

f1ece39

…rating processors) Signed-off-by: Teo <teocns@gmail.com>

Improved TracingCore Config

c656613

Signed-off-by: Teo <teocns@gmail.com>

tests: couple instrumentation tester with TracingCore's lifecycle

d5ed7cb

Signed-off-by: Teo <teocns@gmail.com>

Base for test_session_legacy

3b55098

Signed-off-by: Teo <teocns@gmail.com>

uv lock

2eec70c

Signed-off-by: Teo <teocns@gmail.com>

tests/benchmark/benchmark_init.py

3eba3f3

Signed-off-by: Teo <teocns@gmail.com>

teocns marked this pull request as draft March 15, 2025 17:16

auto-merge was automatically disabled March 15, 2025 17:16
Pull request was converted to draft

Merge branch 'dev' into 0.4.4

1449e9b

teocns requested review from dot-agi and tcdent March 15, 2025 17:17

dot-agi requested changes Mar 15, 2025

View reviewed changes

tests/unit/conftest.py Show resolved Hide resolved

Remove deprecated SDK tests - favor test_decorators

78bc6bd

Signed-off-by: Teo <teocns@gmail.com>

teocns changed the title ~~pyproject.toml: bump 0.4.4~~ 0.4.4 Mar 15, 2025

teocns and others added 6 commits March 15, 2025 19:29

Merge branch 'dev' into 0.4.4

d03a3c2

update openai dep and uv.lock file

7125039

Merge branch 'dev' into 0.4.4

c024b7d

auto_start_session must be False by default

b45e096

Merge branch 'dev' into 0.4.4

ab39c96

dot-agi and others added 3 commits March 16, 2025 10:57

Merge branch 'main' into 0.4.4

c920575

Legacy session support on end_session. Backwards-compatible `record…

f0d74b8

…` event.

CrewAI compat tests. track_tool decorator for compat.

9915d29

dot-agi marked this pull request as ready for review March 16, 2025 22:55

tcdent and others added 11 commits March 16, 2025 16:06

Use valid type.

60661e4

I don't think Event ever passed type checks.

02338e3

Type checking runs clean. Fix import.

e3cf1ad

Auto start sessions.

078afee

track_agent noop should be a decorator

5038a1e

Handle trace lifecycle in legacy with backwards

df3f269

compatibility for Crew 105 and Crew < 105.

drop session export delay to one second and expose it as a public con…

f6fa7d4

…figuration parameter.

Clean up docstrings in legacy

9511139

type checking

dfdec66

agentops.config: dataclass -slots | compat 3.9

ecd2c4f

Signed-off-by: Teo <teocns@gmail.com>

deps: py3.9 backward compat | constraints | resolver

0890462

Signed-off-by: Teo <teocns@gmail.com>

teocns force-pushed the 0.4.4 branch from 8b3bec4 to 0890462 Compare March 17, 2025 20:50

dot-agi self-requested a review March 17, 2025 20:55

tcdent approved these changes Mar 17, 2025

View reviewed changes

dot-agi approved these changes Mar 17, 2025

View reviewed changes

teocns merged commit c9faca8 into main Mar 17, 2025
8 of 10 checks passed

teocns deleted the 0.4.4 branch March 17, 2025 21:05

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Comments

0.4.4#848

0.4.4#848
teocns merged 36 commits intomainfrom
0.4.4

teocns commented Mar 14, 2025 •

edited by dot-agi

Loading

Uh oh!

dot-agi left a comment

Uh oh!

Uh oh!

dot-agi commented Mar 15, 2025

Uh oh!

codecov bot commented Mar 16, 2025 •

edited

Loading

Uh oh!

dot-agi left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Comments

Conversation

teocns commented Mar 14, 2025 • edited by dot-agi Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changelog

Tests

Notes

Uh oh!

dot-agi left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

dot-agi commented Mar 15, 2025

Uh oh!

codecov bot commented Mar 16, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

dot-agi left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

teocns commented Mar 14, 2025 •

edited by dot-agi

Loading

codecov bot commented Mar 16, 2025 •

edited

Loading