Skip to content

ci: Add periodic AI integration tests #5313

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
alexander-alderman-webb wants to merge 7 commits into
base: master
Choose a base branch
from
+44 −0
Open

ci: Add periodic AI integration tests #5313

Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
8186c4a
ci: Add periodic AI integration tests
alexander-alderman-webb Jan 14, 2026
b967795
remove PR permission
alexander-alderman-webb Jan 14, 2026
82a6b12
set environment name
alexander-alderman-webb Jan 14, 2026
8fa1f50
update testing-ai-sdk-integrations commit
alexander-alderman-webb Jan 14, 2026
239016f
fix token reference
alexander-alderman-webb Jan 14, 2026
064d1e6
rename job
alexander-alderman-webb Jan 14, 2026
f8f14ff
grant write permissions for issues
alexander-alderman-webb Jan 14, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
44 changes: 44 additions & 0 deletions .github/workflows/ai-integration-test.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
name: AI integration tests

on:
workflow_dispatch:
schedule:
# every weekday
- cron: '23 3 * * 1-5'

jobs:
ai-integration-tests:
name: AI integration tests
runs-on: ubuntu-latest
environment: "AI Integrations Tests"
timeout-minutes: 10

permissions:
contents: write
issues: write

steps:
- name: Setup Python
uses: actions/setup-python@v6
with:
python-version: 3.14t

- name: Setup Node.js
uses: actions/setup-node@v6
with:
node-version: '20'

- name: Checkout repo
uses: actions/checkout@8e8c483db84b4bee98b60c0593521ed34d9990e8 # v6.0.1
with:
token: ${{ secrets.GITHUB_TOKEN }}

- name: Run Python SDK Tests
uses: getsentry/testing-ai-sdk-integrations@1c6853a3a46ff1217248bf2b61e3ca5c4fcafdca
env:
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
with:
language: py
openai-api-key: ${{ secrets.OPENAI_API_KEY }}
anthropic-api-key: ${{ secrets.ANTHROPIC_API_KEY }}
google-api-key: ${{ secrets.GOOGLE_API_KEY }}
Loading