Test Framework.
This is a template to try out and launch the tests of the Agents in Drupal CMS. This will allow you to create more tests and groups of tests and run them. Fantastic for trying out different providers and models to see how well they run Drupal CMS.
A Video can be found here:
The template is built from here: https://github.com/drupalforge/drupal_cms_ai_agents_test_framework
You can download the module and get started locally instead here: https://www.drupal.org/project/ai_agents_test
Getting Started
- You will likely need more credits than Drupalforge gives for free. So you can go to Configuration -> AI -> AI Providers and add your own anthropic or OpenAI key.
- To get back to the Tests go to Content in the navigation and select "Agent Tests" as one of the tabs.
- Then go to the sub-tab "Test Groups" This is the best place to run the tests.
- Select a Group, click the little arrow on the most right bit of the screen and select Run test groups.
- You can also see the results or go into details of the tests to see all the steps.
- Note: These tests actually run on the drupal site, if the tests as for content to be created, actual content is created on the site (so the next test in the group can rely on that content existing). Therefore they can't easily be re-run unless you delete everything and start again.
- Tests and Test groups can be exported and imported, they are YAML files. We don't have a good way of storing those tests for other modules yet (Do you put it in the module itself, make a new module just for testing? Put them all in the above module?)
Our Goal is to make it so that these tests can also run in a CI/CD environment and test the latest version of Drupal CMS. You could also have a go creating your own tests entirely through the UI and add a test group. Or adding content types and modules and running tests on those.
We hope to make it easy to submit tests but you could try by adding things to the github repo above.
Happy testing!
