Assessment Administration

This assessment administration page is used to handle individual and assessor type assessment. Various assessment administration activities can be performed using this page. Assessment administration can setup and manage assessment.

Activities performed in assessment administration page:

• Create New assessment and apply various filters on assessment
• Add/Change existing assessment information, assessment scope information, general questions information.
• Set the pipeline builder Add/Change Notifications templates.
• Manage participants and notification templates.
• Rolling up and consolidating assessment
• Create charts and report for assessment

The page is organized into multiple panels or sections. We are using progressive UI in this page. Progressive UI means initially, we are displaying first panel and click on appropriate options in first panel then it will open the second panel and click on appropriate options in second panel then it will open the third panel and so on.

First Panel The first panel contains the options to create assessment, to search assessment and to select assessment from list of assessments. Activities performed in First Panel:

• Create New assessment without using existing assessment or using existing assessment.
• Apply various filters on assessment
  • Search assessment by start and end date
  • Search assessment by status (new, open, close)
  • List all assessments or list all assessments created by me
• Select assessment from list of assessments.

Second Panel We can see the second panel when we select an assessment from first panel. In second panel we are displaying various configuration sections of selected assessment. This panel is divided into various sections like configure assessment section, manage participants and data section, review and analyze section and report section.

Third Panel Based on option selected in second panel, we are displaying the content of third panel. Activities performed in Third Panel:

• For Configure Assessment Section
  • Add/Change existing assessment information
    • Set Assessment information like start date, end date, display style etc.
    • Set Experience controls like page break, show report, prompt comment etc.
    • Set Access controls like security code, identifier etc.
  • Add/Change assessment scope to make one assessment differ from another assessment
  • Add/Change assessment level general questions and scope level general questions
  • Set the pipeline builder means set the sequence, page titles and visibility of assessment pages and scope pages
  • Add/Change Notifications templates like set invitation email template, reminder email template, instruction template etc.
• For Manage Participants and Data Section
  • Add participants/ assessor to existing assessment
  • Send notification email to various assessment users
  • Add documents for assessment
  • Rolling up and consolidating assessment
• For Review and Analyze Section
  • Display assessment and importance summary
  • Display scope wise assessment and importance data of selected assessment
  • Create/Display various charts for selected assessment.
• For Report and Export Section
  • View the report of selected assessment. User can able to exclude/include various parts of selected assessment in report.
  • Export the data of selected assessment.

Fourth Panel We are displaying the fourth panel if we want to exclude/include various parts of selected assessment in report or display report with all parts. User can select the scope, change the assessment type, select layout options, select report parts and change display options in fourth panel. User can also save the selected options of fourth panel in database.

Fifth Panel In fifth panel, we are displaying the report based on selected report options from the fourth panel. We can navigate and export the report in various formats in fifth panel. We can use various report viewer functionality in fifth panel.

1. Create a new Assessment

• To create new assessment, click on “Add a New Assessment” option from the first panel. When we click on “Add a New Assessment” option it opens the dialog box which contains assessment information. The dialog box contains assessment name, start date, end date and template which contains list of available assessments using them we can create copy of existing assessment.
• Assessment name, start date and end date is required. We can ignore the template option.
• Assessment Name: It must be unique and we can assign alpha numeric value in assessment name.
• Start and End date: It is used to set assessment time period. The participants cannot enter or update score after the end date means after the assessment expire. Start date must be greater or equal to end date.
• There is “Save” button in dialog box and is used to save the assessment basic information. If assessment is selected from template option then it will copy assessment basic information, assessment scope information, assessment valuation objects information, assessment snapshots (For time based) information, assessment attribute(pipe line builder) information and assessment general questions and scope general questions of selected assessment.
• “Cancel” button is used to close the dialog box and discard the entered information.
• Once the assessment has been created using the dialog box, it will appear under the Assessment List.

2. Apply various filters on assessment

• We can apply various filters on assessment list.
• These filters are in the Navigation Panel (first panel).
• Filters are used to refresh assessment list using various criteria. We can refresh assessment list by using below criteria.
  • Using start date and end date
  • Using Status (Setup, open, close, Dry run). If status is “Setup” or “Dry Run”, we can change the scope. If status is “Open” means assessment is active and we cannot able to change the scope in middle of active assessment. If we need to change the scope, change the status to setup or dry run. If status is “Close” then we cannot able to enter/update the score of assessment.
  • Shows assessment created by me using “Show mine” option.
  • Shows all assessment using “Show all” option.

3. Select assessment from list of assessments.

• You can select specific assessment from list of assessments available in Navigation Panel (first panel)
• If we cannot see the assessment in the list, it means either we are not the administrator/owner of the assessment or the status of assessment is other than “Setup”.

4. Add/Change assessment basic information

• After the selecting the assessment from first panel, we have “Basic information” option in Information Panel (second panel) and clicking on that option we can get various information of assessment in third panel. We can add/change assessment information from third panel.
• Below is the various assessment information:
  • Standard Name and Name
    • We can set user defined Standard Name and Name of assessment. Standard Name is required and Name is optional.
  • Start Date and End Date
    • We can set time duration of assessment using Start and End Date option. Both Start Date and End date is required and End Date must be grater or equal to Start Date.
  • Status
    • We can set and select assessment status from list of assessment status. Various assessment status is Open, Close, Setup and Dry Run. Status is required and default value is “Setup”.
  • Survey Style
    • There are two styles (In-Line style, Spreadsheet Style) for presenting data and entering data for participants. Survey Style is optional.
    • If Survey Style is not specified by the administrator then we are assuming In-Line style to representing the assessment data.
  • Abbreviation
    • Abbreviation is optional field and we can specify shorten name to assessment using Abbreviation field.
  • Org Units
    • There are one or more Org Units associated with an organization. We can create assessment for specific Org Unit. Org Unit field is optional.
  • Include General Questions
    • Include General Questions is Boolean field and indicate that whether we want to Include General Questions of assessment/assessmentscope or not during the representing the assessment data.
  • Description and Comment
    • We can add description and comment of selected assessment. These fields are optional.
  • Active and Visible
    • If Active and Visible flags are checked then we are displaying the assessment to the user. Keep the Active and Visible flags checked. There is no need to check other boxed on the page.
  • Show Report
    • Show Report flag is used to give option to view the report of assessment to the user/participant.
  • Prompt Comment
    • Prompt Comment flag is used to display the comments for score entered by user/participant during representing the assessment data.
  • Page Break
    • We can set page break by Capability Set/Capability/None for capability type assessment. We are representing the capability type assessment data based on page break. This field is optional.
    • In capability type assessment, If Page Break is not specified by the administrator then we are assuming None as Page Break.
  • Include Scope Options
    • Include Scope Options flag is used to whether we want to display scope page selection in assessment summary page or not. If flag is not set then we are not displaying scope page selection in assessment summary page.
  • Identifier, Security Code and Skip Account Validation
    • When user wants to participant in any assessment and he made selection of assessment product from the market place page we can identify the selected assessment by Identifier field on registration page. After doing registration new user will be added in our system and by providing security code user do not need to do account activation. Same way if Skip Account Validation is true then he does not require account activation.

5. Add/Change assessment scope information

• Select “Scope” from the information panel (second panel). Next panel shows the list of scopes with their information.
• We can add/change assessment scope information to make one assessment differ from another assessment.
• If you did not create scope for assessment then click NEW in the top of grid header. To edit a scope already included in the assessment, click EDIT for the scope you want to modify.
• Below are main components of overall scope of assessment.
  • Assessment Type
    • We have Assessment Type either “Capability Assessment” or “Measure Assessment” for a scope.
    • You will not be able to change the Assessment Type. To change, you would need to delete the scope and create a new entry.
  • Capability Scope
    • Capability Scope for Capability Assessment, navigate through appropriate collection, domain, cluster or directly pick object (capability set/service/Technology) from the dropdown list.
    • Capability Scope for Measure Assessment, navigate through appropriate category, class, Sub Class, Value Dial, Entity Class, Entity Sub class or directly pick object (measure) from the dropdown list.
    • You will not be able to change the Capability Scope. To change, you would need to delete the scope and create a new entry.
    • We can set the user defined name of scope using Scope Name textbox. If we are not specifying scope name then default it will use object name as scope name.
    • We can associate measure with scope if Assessment Type is “Capability Assessment”.
  • Valuation Scope
    • We can choose appropriate valuation scope form valuation scope dropdown list.
    • If “Snapshot” valuation scope is selected from valuation scope dropdown list then to add or update valuation objects, select one or more Calendar entries from the Snapshot dropdown field.
    • If valuation scope other than “Snapshot” is selected from valuation scope dropdown list then to add or update valuation objects, navigate through appropriate options or directly pick one or more objects (Capability Sets/ ITServices/ Technologies/ Measures/ Service Components/ Technology Versions) from dropdown list.
    • If “Measure Assessment” from Assessment Type dropdown is selected then we do not have “Measure” as valuation scope. If “Capability Assessment” from Assessment Type dropdown is selected then we have “Measure” as valuation scope.
    • If “Snapshot” from valuation scope dropdown is selected then we can’t create time based assessment. If valuation scope other than “Snapshot” is selected then we can create time based assessment and have flag for time based assessment.
  • Time Scope
    • If assessment is time based then we can choose one or more time scopes form time scope dropdown list.
    • If we are using both Valuation scope and Time Scope in Assessment then there are below criteria to choose time scope and valuation scope.
      • Only one valuation object is allowed with multiple time scopes. If we want to include multiple valuation objects, remove time scopes from time scope drop down list.
      • Only one time scope is allowed with multiple valuation objects. If we want to include multiple time scopes, remove valuation objects.
  • Other Fields
    • We can set Assessment Level to Capability-based/Question-based/Measure from Assessment Level dropdown list. If Assessment Type “Capability Assessment” is selected then we have Capability-based/Question-based in assessment level dropdown list. If Assessment Type “Measure Assessment” is selected then we have Measure in assessment level dropdown list.
    • If you want to ask participants about the relative importance of various questions/capabilities/measures, mark “Include Importance” checkbox.
    • If you want to include NA as score option then mark “Include NA option” checkbox. We can also set description text of NA option using NA Description Textbox.
    • If you want to display assessment scope to user/participant then mark “Active” and “Visible” checkbox. Keep the Active and Visible flags checked.

6. Add/Change General Questions

• Select “General Questions” from the information panel (second panel). Next panel shows the list of general questions.
• We can add/change assessment level general questions as well as scope level general questions.
• If you did not create general question then click NEW in the top of grid header. To edit a general question already included in the assessment, click EDIT for the general question you want to modify.
• To add assessment scope level general questions, we need to select one assessment scope from Assessment Scope dropdown list.
• To add assessment level general questions, we do not need to select scope from Assessment Scope dropdown list.
• We can set Data Type of general question using list of data types available in Data Type drop down list. Data Type of general question is required for assessment level as well as assessment scope level.
• There are other optional fields like Class, Name, Question, Help tip, Min, Max, Default, and Sequence in assessment general question page.

7. Set the pipeline builder

• Select “Pipeline Builder” from the information panel (second panel). Next panel shows pipeline builder information.
• Set the pipeline builder means set the sequence, page titles and visibility of assessment pages and scope pages
• There are three sections in pipeline builder.
  • Assessment Pages
    • In this section, we can set the sequence, page titles and visibility of main pages in the assessment. Main pages include assessment level general question page, assessment scope pages and extended attribute page.
  • List of Scope and their Pages (scope Pages)
    • In this section, we can set sequence, titles and visibility of individual assessment scope.
    • We are displaying scope information using Parent-Child grid. Parent is the assessment scope and child is pages of scope.
    • We can set sequence, page title and visibility of individual scope as well as pages of scope.
  • Scope Pages - Default Settings
    • In this section, we can set sequence, titles and visibility of assessment scope pages. These settings are used when an assessment scope does not have specific settings.
• The Included in Pipeline flag must be checked to use drag-drop or move rows to change sequence.
• Click “Save” button to save or update settings. Click “Cancel” to ignore changes. Click “Reset to Default” to remove all assessment-specific settings and return to system default settings. Click “Preview” to preview pages’ sequence using applied setting and this will not save/update the setting in database.

8. Create/Edit Notifications templates

• We can create templates for email notifications or on-screen instructions. Similar to mail-merge in Word documents, these templates can include “placeholders” for personalized addressing.
• It includes number of standard templates for communication with participants. We can create assessment-specific templates.
• Select “Notifications” from the information panel to see the list of available templates and to create/edit assessment-specific templates.

• When we try to edit any of these templates, for the first time, it will pre-populate them with the system-defined template. Make any changes and save the template.
• The template editor is a rich-text editor. We can visual design the content and layout using the formatting buttons. We can review the HTML code and extend it with any valid HTML statements and properties.
• To include placeholders for user name, organization name and many assessment related data fields, click on the field chooser (last icon in the menu header of the editor) and select the field and it will be placed in the template at the point of the cursor.

9. Add participants/ assessor to existing assessment

• Select “Participants” from the information panel (second panel). Next panel shows the list of the participants with their status.
• Click “Enter Email Addresses to Invite” to add participants using their email addresses. In the open text field, enter email addresses separated by coma (,) or by semi-colon (;) to enter multiple email addresses.
• Click “Select from People list to Invite” to add participants by selecting one or more person from available person list of an organization.
• If We no longer want to include participant's response in the analysis, we can edit the participant's record by setting Active to false.
• An administrator always an Assessor. We may also assign someone else as an Assessor.
• We can also set Start Date and Complete Date of assessment for participant and it is optional. Start Date is the date the participant started. Completion Date is the date when the survey was completed. You can also see % completed at any given time.

10. Send notification email to various assessment users

• Select “Send Notification Email” from the information panel (second panel). It will list all participants in the next panel.
• Check the people you want to send the email.
• To send invitation email, click “Send Invitation Email” and emails using the invitation template will be sent immediately.
• To send reminder email, click “Send Reminder Email” and emails using the reminder template will be sent immediately.

11. Add documents for assessment

• Select “Documents” from the information panel (second panel). It will list all documents of assessment in the next panel.
• We can add assessment level document as well as assessment scope level documents.
• There is Document scope option which have values like Assessment and Assessment Scope. It is used to indicate whether we want to upload document for assessment level or assessment scope level.
• If we select Assessment Scope from Document Scope dropdown list then it displays list of assessment scopes in Assessment Scope drop down list. We can select one assessment scope at a time can and can upload document for that assessment scope.
• We can set the title and description of document using Title and Description text box.
• There is Document Type option which indicate from where we must upload document and Document Type is either Upload Document or Enter Link. If we set Document Type to Upload Document then we can upload document from the system. If we set Document Type to Enter Link then we can upload document using link specified in Enter Link textbox.
• We can also download the uploaded document.

12. Rolling up and consolidating assessment

• Select “Roll up Assessments” from the information panel (second panel). Next panel shows Roll up Assessments options.
• Check “Rollup Individual Maturity Data” checkbox to Roll up the Assessment across all participants. Rollup is required to compute the consolidated maturity score based on all individual assessments. A consolidated score is a weighted average of all individual scores. The maturity scores for the questions are rolled up to Capability Building Block (CBB) and Capability category and then eventually to a Capability.
• Check “Recalculate Participants' Percentage Completion” checkbox to recalculate and update participants’ percentage completion of the assessment.

13. Display assessment and importance summary

• Select “Assessment Summary/Importance Summary” from the information panel (second panel) to see the statistical summary for maturity score or importance.
• Beyond tracking individual progress, you can also check statistical analysis i.e. min/max, standard deviation for maturity score or importance across the responses of various participants of an assessment.

14. Display scope wise assessment and importance details data of assessment

• Select “Assessment Detail Data/Importance Details” from information panel (second panel) to see the scope wise assessment details data and importance details data of assessment in third panel.
• Select assessment scope from “Assessment Scope” dropdown list and we can get maturity/importance score of every participant of assessment scope and can get consolidated maturity/importance score of assessment scope and can get assessor score of assessment scope. If the assessment scope is capability based then we can get score for each capability, If the assessment scope is capability question based then we can get score for each capability question, if the assessment scope is measure level then we can get score for each measure.
• We can add assessor assessment if we or assigned assessor would like to add a perspective based on the interviews or additional information collected during the process. We can add this using by checking the radio button next to individual or consolidated assessments and then click on “Promote as Assessor’s Assessment” button. Promotion creates assessor records which can be updated. If an assessor assessment already exists, the system will ask if you would like to replace the existing record.
• If we click on “Start Assessor’s Assessment” then it redirects to MY ASSESSMENT page with the newly created assessor assessment. Edit the scores and add comments. In the end, calculate maturity and importance.

15. Display General Questions Details

• Select “General Questions Detail” from the information panel (second panel). It will list all general questions responses in the next panel.
• It lists all general questions responses made by various participants of an assessment. It shows the responses of general questions by participant of assessment.
• We can sort responses in ascending and descending order by Participants name.

16. Create/Display various charts of assessment

• Select “Analytics Dashboard” from the information panel (Second Panel). Next panel includes the options to select the charts and layout.
• We can change chart layout using the icons available in header. In top of the panel, we have options to select distinct types of layout in which charts will be loaded. Different Layouts are One, Two or three column layouts.
• Click the “Select Items” to open the list of charts available. Select any number of charts. These charts will be displayed in the panel.
• If a chart displays “Data is not available”, check filter settings.
• Each chart has filter, cloning and preview image icons when you mouse over or touch the chart header area. Click on the filter to open the filter options in a dialog box.
• In most of the charts, in addition to chart formatting options, you can select
  • Valuation Scope – Valuation Objects included in the assessment
  • Assessment Type - Consolidated Assessment/Assessor Assessment/Individual Assessment/Organizational Assessment
  • Chart Detail Level – Object/Capability Class/Capability Building Block/Capability Question

17. Generate Assessment Report

• To generate a report, select “Reports” from the information panel (Second Panel).
• In the next panel of information panel, we have Assessment Report as well as saved report with selected settings of logged in user.
• There various icons in header of panel like,
  • Play – After selecting any assessment report or saved report, we can view that report using Play icon of panel header. The report can be viewed in next panel (Fourth Panel).
  • Edit – After selecting any assessment report or saved report, if we click on Edit icon of header then in next panel (Fourth Panel), we can have filters of report.
  • Clone – We can clone(copy) the assessment report and that cloned report comes under saved reports.
  • Delete Clone – We can delete the Saved report using Delete Clone icon.
• After click on Edit icon of panel header, in next panel we have various filters of report. Use the filter to select the kind of data to include in the report.
• Fourth Panel displays either Assessment report (if we clicked on Play icon in third panel) or filters of report (if we clicked on Edit icon in third panel). We can save these filters and apply filter settings to repot. Using the filters, you can select-
  • Assessment Scope - select the scopes of assessment to include in report.
  • Assessment Type – Individual/Consolidated/Assessor/Organizational. We can generate report of specific assessment type.
  • Page Layout Options – Page Header/Page Footer. Using this option, we can include/exclude page header/footer in report.
  • Report Parts – Include/Exclude various parts of assessment in report.
  • Display Options – Select appropriate font size, font family, font style, color, text alignment for text of report. It also has an option to display report in Landscape mode. We can set the user defined report title from Display Options.
• After selecting appropriate options from the filters (in fourth panel), if we click on apply button which is in panel header, we can get report in next panel (in fifth panel).
• The report can be saved or viewed on-line in various formats.

18. Export Assessment Data

• To export assessment data, select “Export Assessment” from the information panel (third panel) of the Assessment Administration page.
• In third panel, we have two sections –
  • Standard Exports – in this section, right now we have two entries. One for Assessment Export and other for Assessment Segment Export
  • My Saved Exports – In this section, we display cloned items of assessment segment exports by User.
• We have three options(icons) in header of this panel
  • Export to excel – to export data of selected items directly
  • Settings – to open filters in new panel. It is enabled only for segment items and cloned items
  • Clone – To clone selected segment standard items and save them to User Settings table.
• By clicking on “Export to excel” icon, we will simply export file using default settings.
• By clicking on “Settings” icon, we will load filters in new panel.
  • In filter panel, we have export or cancel button. By clicking Export in filters will export file using selected options in filters
• Below are different filters used for assessment segment data export
  • Scope filters
    • Assessment Scope tree view - Select multiple available assessment scopes based on selected assessment.
    • Valuation Object list view - Select multiple valuation objects loaded based on selected scope.
  • Attribute filters
    • In attribute filters, we have three checkboxes to filters data by various types of attributes
      • Include Assessment Attributes
      • Include Person Attributes
      • Include General Questions
    • Based on selection of any of above items, we fill attribute tree view having type and name of attributes
  • Display Options Filters
    • Detail level dropdown - select detail level of data to export – Object, Capability Class, Capability Building Block, Capability Question
    • Score types checkbox list - select score type to include different scores in data.
    • Upload Mapping file –
      • We can upload their own mapping file that will be used to format excel in which data will be exported
      • We can also download mapping template from link 'Download Template' just below upload control.
    • Select Scores to include - Checkboxes to select which scores to include in exported data.

• Scope Type – We have two types of scope. Scope using capability maturity model as “Capability Assessment”. Scope using list of measures as “Measure Assessment”
• Assessment Type – We have six types of Assessment and these are Individual, Organization, Assessor, computed (Calculated), External, Linked (Derived).
• Assessment Mode - We have three type of assessment modes. Assessments using a capability maturity model (Maturity based), simple multiple-choice questions (Multiple choice) or a measure (measure-based).
• Survey Style -It is preference for layout of assessment data. There are two styles for presenting questions/capabilities/measures and entering data for participants.
  • In-Line Style - List or responses are shown below the question/capability/measure
  • Spreadsheet Style - The questions/capabilities/measures and response entry fields are displayed as a table, like a spreadsheet columns.

Q1: I don’t’ see any assessment in the first panel. Where did they all go?

A: If you did not create the assessment, you may not see them. Use the filter to find assessments - select the status and show all.

Q2: Cannot able to change the capability scope or measure scope of assessment?

A: You will not be able to change the capability scope or measure scope. To change, you would need to delete the scope and create a new entry.

Q3: Cannot able to change scope assessment type once we added it?

A: You will not be able to change the scope assessment type. To change, you would need to delete the scope and create new entry.

Q4: If assessment scope is time based then once we add one or more valuation objects from valuation scope then we cannot add multiple time scope?

A: Only one time scope is allowed with multiple valuation objects. If you want to include multiple time scopes, remove valuation objects.

Q5: If assessment scope is time based then once we add one or more time scopes then we cannot add multiple valuation objects?

A: Only one valuation object is allowed with multiple time scopes. If you want to include multiple valuation objects, remove time scopes from time scope drop down list.

Q6: Cannot drag-drop or move rows in pipeline builder grids?

A: The “Included in Pipeline Record” check box must be checked to use drag-drop or move rows to change sequence.

List of Assessment Charts and their information