Benchmark Framework
The set up and configuration of specific tests will be covered in detail but deployment and and environment setup details can be found in page Benchmark Framework 2.0.
The benchmark lab configuration can be found on the internal Wiki page.
Compatibility Matrix
Table 1: Benchmark Project ListName | Description | Artifact Releases | Artifact Snapshots | Source | Prerequisites |
---|
Benchmark Server | Benchmark controller application and framework code | Releases | Snapshots | Source | |
Alfresco Sign Up | Create users in Alfresco as a prerequisite for Alfresco testing | Releases | Snapshots | Source |
Alfresco instance with /alfresco exposed |
Alfresco Data Load | Create shared, common data in Alfresco: Sites, site members, site-based files and folders | Releases | Snapshots | Source |
Alfresco instance with /alfresco exposed User collection mirror in MongoDB (Alfresco Sign Up) |
Alfresco Workflow | Create and progress through Activiti workflows in Alfresco | Releases | Snapshots | Source |
Alfresco instance with /alfresco exposed User collection mirror in MongoDB (Alfresco Sign Up) |
CMIS | Pure CMIS test | Releases | Snapshots | Source |
Any CMIS server User collection mirror in MongoDB (Alfresco Sign Up) |
Share | Selenium-based testing using Share page objects | Releases | Snapshots | Source |
Alfresco instance with /share exposed User collection mirror in MongoDB (Alfresco Sign Up) Selenium grid running local to each instance of the test (ideally) |
Table 1 gives the names of the Alfresco Benchmark projects and where to find artifacts and source code.
Click on the test name to get more detailed instructions on how to run the application.
Table 2: Benchmark Software CompatibilityProduct Version | Benchmark Test(s) |
---|
CMIS 1.1 Server |
Benchmark Server 2.1.1 or later CMIS 1.4 |
Alfresco 5.2.0 |
Benchmark Server 2.1.1 or later Sign Up 2.3 or later Data Load 2.6 or later CMIS 1.4 Workflow 1.1 Public API 1.0-SNAPSHOT Share 5.2.0-SNAPSHOT (trunk) |
Alfresco 5.1.0 |
Benchmark Server 2.1.1 or later Sign Up 2.3 or later Data Load 2.6 or later CMIS 1.4 Workflow 1.1 Public API 1.0-SNAPSHOT Share 5.1.0 |
Alfresco 5.0.N |
Benchmark Server 2.1.1 or later Sign Up 2.3 or later Data Load 2.6 or later CMIS 1.4 Workflow 1.1 Public API 1.0-SNAPSHOT Share 5.0.0 / 5.0.1 / 5.0.x-SNAPSHOT |
Alfresco 4.2.5 |
Benchmark Server 2.1.1 or later Sign Up 2.3 or later Data Load 2.6 or later Workflow 1.1 Share 4.2.x-SNAPSHOT |
Alfresco 4.2.3 |
Benchmark Server 2.1.1 or later Sign Up 2.3 or later Data Load 2.6 or later Workflow 1.1 Share 4.2.4.x-SNAPSHOT |
Alfresco 4.1.5 |
Benchmark Server 2.1.1 or later Sign Up 2.3 or later Data Load 2.6 or later Workflow 1.1 Share 4.1.x-SNAPSHOT |
Table 2 shows the test version compatibility with specific product versions.
Where a specific Product Version is not listed, use the most recent version listed. For example, if you are using Alfresco 4.2.4 and only Alfresco 4.1.3 and Alfresco 5.0.0 are listed, then the tests to use will be those of the latest prior release; in this example: Alfresco 4.1.3.