Version: Kora Courses, August 21, 2025 or later
Permissions required: Administrator
A program can include submissions from any number of courses, even spanning multiple semesters. For example, an admin could create a program using 1,000 submissions randomly sampled from a course or set of courses that were offered in different semesters over the last three years.
Once submissions are imported into a program, course level assessment that has already taken place can be reviewed and analysed. Submissions can also be distributed to designated reviewers or groups of reviewers for program assessment. Reviewers then assess the submissions using rubrics and learning outcomes, making it possible to evaluate student learning across courses and programs.
Access or Create new program
- To get started, log in and scroll down to My Programs (1).
- Create a new program (2). You must be a system administrator in order to create programs.
For more information on creating programs, please see “Create, edit, or delete programs.”
View and edit program Assessment Settings
- To view or edit the Program Assessment Settings, navigate to the Home (3) page of your Program. Click Assessment Settings (4) to edit the default settings and configure options such as due dates and submission anonymization.
Add Outcomes
- Keep Assessment visibility (5) turned off while setting up, then return to turn it on once your reviewers and submissions are allocated.
- Click to Add outcomes (6) and associated rubrics to define evaluation criteria.
For more information on Program assessment settings, please see “Configure Program Assessment Settings.”
Export and add submissions
- Once the program is created, submissions can be imported. Add submissions to include in your program using their Submission IDs (7) separated by spaces, commas, or newlines.
- To define which submissions you want to assess, you will first need a list of existing submissions. Admins can request an export by emailing support@digication.com (8). The submission data will be processed, and you will receive the exported file in CSV format.
Note: In an upcoming release, admins will be able to access submission data directly. For the moment, please contact Digication Support to request an export of submission data.
View and Manage Submissions
- After import, submissions appear in a grid view (9) on the Submissions page, where you can review and manage them.
Add People
- To add people to a program, click Add People (10) on the Home page or on the People page. People you have added can be assigned different roles, such as admin, manager, or reviewer.
- Admins and Managers have similar abilities within programs, but only Admins can create a program or add or remove submissions. People that only have a Reviewer role can only view their Home page and their My Assessments page.
For more information on adding people, please see “Add people to Program.”
Filter submissions
- Use filters (11) on the Submissions page to make the review process more efficient. You can filter by columns, for example by Assignment Type, Course Name or Number , or create custom filters to quickly find the submissions you need.
- Filtering is based on three options: Columns, Operator, and Value. You can apply multiple filters with “And” or “Or,” and remove filters individually or clear all at once.
For more information on refining your list of submissions, please see “Working with submissions page and export data.”
Allocate submissions
- Use Actions (12) to allocate the selected submissions (13) to reviewers, remove all reviewers from selected submissions, or to remove the selected submissions from the program.
- On the Select Reviewers page, choose who should assess the work (14).
- In the Allocation Options (15), set the number of reviewers per submission, and expand Advanced Settings (16) if you need to set limits on allocations or enable sample submissions to select a specific number of submissions from a larger pool.
- Once allocation is complete, the allocation status (17) is displayed along with the allocation results. You can navigate from here to either the Submissions page or the Reviewers page.
- On the Submissions page, assigned reviewers (18) will appear for each allocated submission. This helps you to quickly check which submissions have been allocated and who is responsible for reviewing them.
For more information on working with the submissions page and allocating submissions, please see “Working with submissions page and export data.” and “Allocate or remove reviewers from submissions”.
- You can also allocate submissions to selected reviewers from the Reviewers page (19). Navigate to the Reviewers page to view a list of all reviewers, their assigned roles, and their review progress.
- To allocate submissions to a specific reviewer, use the three-dot Menu (20) next to that reviewer.
- To allocate submissions to a group of reviewers, select the checkboxes (21) next to them and use the “Actions” button (22).
For more information on allocating or removing reviewers from submissions, please see “Allocate or remove reviewers from submissions.”
Completing the program setup
- Once the program setup is complete, go to Assessment Settings and make sure that Assessment Visibility (23) is set to Visible to reviewers so reviewers can access their assigned submissions.
Note: In an upcoming feature release, you will also be able to notify reviewers when assessments are ready to begin.
View Program status
Once the program has been fully set up, you can access a detailed program status overview on the Home page. This overview helps administrators track program progress and ensure all assessments are completed effectively.
- Submissions information (24) includes the total submissions, assessed submissions, flagged submissions, and submissions assigned to reviewers.
- Reviewer information (25) includes their allocation status, and the percentage of completed assessments.
For more information on viewing program status, please see “View Program Status.”
Generate and download reports
- On the Reports page (26) you can generate reports (27) and download reports (28) as .csv files containing your assessment data and use an AI report assistant (29) to analyse program assessment reports. These reports will help you analyze assessment outcomes, monitor reviewer performance, and provide feedback to academic committees.
Using AI Data Analyst
Begin chatting with the AI Data Analyst for an in-depth look at your results and trends in performance across various learning outcomes and their associated rubric criteria, highlighting both strengths and areas for potential improvement.
The AI Data Analyst allows you to explore your program’s assessment data through interactive conversation. You do not need technical skills to perform data analysis. Instead of viewing static dashboards, you can ask questions, identify trends, and investigate results directly from your reports.
As an administrator, you bring valuable knowledge about your program. The AI Data Analyst helps you use that insight to ask deeper questions that others might overlook, uncovering meaningful patterns and supporting continuous improvement.
- Simply type “Yes” in the chat field (30), or start asking questions in plain language to engage directly with your data, for example:
“Can you help me analyze these results in terms of student demographics?”
“Are there performance differences by department?”
- Gain insights into your program’s assessment data through interactive conversations and visual summaries.
For more information on working with reports, please see “View and manage Program Reports.”
For an overview of how faculty and reviewers access their assigned submissions, complete reviews, and track progress in My Assessments, please see “Overview of My Programs in Digication Kora for Faculty and Reviewers.”
Please see “View and manage my assessments” for detailed steps on how to view, manage, and complete your assigned reviews.