tests: Move chalice under toxgen #3185

Job	Run time
Gevent (pinned) (3.8, ubuntu-22.04)	6m 24s
Gevent (pinned) (3.11, ubuntu-22.04)	6m 30s
Gevent (pinned) (3.12, ubuntu-22.04)	7m 26s
Gevent (pinned) (3.6, ubuntu-22.04)	3m 59s
Gevent (pinned) (3.10, ubuntu-22.04)	6m 26s
All pinned Gevent tests passed	3s
	30m 48s

Provide feedback