# Data Model ## Druid Data Sources ## sl-project | Dimensions | Datatype | Description | | ------------------------------- | -------- | -------------------------------------------------------------------------------------------- | | program\_name | String | Name of the program to which the project is mapped to | | project\_updated\_date | Date | Project last updated date | | project\_evidence | String | Link of the attachment uploaded at the in a project | | tasks\_status | String | Status of the Task attached to project | | district\_externalId | String | Unique identifier of the District mapped to the user | | task\_evidence\_count | Long | Total attachment count uploaded for Task | | board\_name | String | Name of the board mapped to the user | | sub\_task\_deleted\_flag | Boolean | Indicates True or False which tells whether the sub-task is deleted by the user from the app | | school\_name | String | Name of the School declared by the User | | state\_code | Long | Unique identifier of the State code | | private\_program | String | boolean value that defines program type | | createdBy | String | User keycloak id on the sunbrid platform | | channel | String | Root organisation of user | | status\_of\_project | String | Status of the Project created or mapped | | project\_description | String | Summary of the project | | state\_name | String | Name of the State mapped to the user | | task\_assigned\_to | String | Provides the username or email to which user the task is assigned to | | sub\_task\_date | String | Last sync date of the sub task | | district\_name | String | Name of the District mapped to the user | | project\_completed\_date | String | Date of completion of the project | | task\_id | String | Unique identifier of Task attached to the Project | | task\_remarks | String | Remarks of the task | | organisation\_name | String | Organisation Name of the user belongs to | | project\_title\_editable | String | Edited name of the Project | | project\_duration | String | Duration of the project taken to complete | | block\_code | Long | Unique identifier of the Block code | | school\_externalId | String | Unique identifier of the School mapped to the user | | project\_goal | String | Goal of the Project created or mapped | | program\_externalId | String | Unique identifier of the program to which the project is mapped to | | project\_deleted\_flag | String | Indicates True or False which tells whether the projects is deleted by the user from the app | | tasks | String | Name of the Task attached to Project | | certificate\_id | String | Unique identifier of the Certificate | | certificate\_status\_customised | String | Customised Certificate Status Data as Issued or not | | block\_externalId | String | Unique identifier of the Block | | block\_name | String | Name of the Block mapped to the user | | task\_evidence\_status | String | Indicates true or false of evidence attached or not at the task level | | tasks\_date | Date | Last sync date of the task | | organisation\_id | String | Unique Identifier for the organisation | | project\_terms\_and\_condition | String | boolean value that defines terms and condition | | district\_code | Long | Unique identifier of the District code | | parent\_channel | String | Column with constant value - "SHIKSHALOKAM" | | user\_type | String | User Role | | certificate\_issued\_on | date | certificate issued date to user | | designation | String | Sub role of the user | | task\_end\_date | String | End date of Task attached to Project | | project\_remarks | String | Remarks of the projects | | certificate\_status | String | Status of the project ceritificate | | school\_code | Long | Unique identifier of the school code | | state\_externalId | String | Unique identifier of the State | | project\_title | String | Name of the Project | | sub\_task\_end\_date | String | End date of Sub task attached to task | | solution\_id | String | Unique identifier of the Solution in an Project generated by system | | task\_deleted\_flag | String | Indicates True or False which tells whether the task is deleted by the user from the app | | certificate\_template\_url | String | Url of the Ceritificate generated for the projects | | project\_created\_type | String | Type of the project either Imported from library (or) created by the user | | task\_evidence | String | Link of the attachment uploaded at the task level in a project | | task\_sequence | int | sequence of the tasks | | project\_id | String | Unique identifier of the Project created or mapped | | program\_id | String | Unique identifier of the program to which the project is mapped to | | project\_last\_sync | String | Last sync date of the project | | sub\_task\_id | String | Unique identifier of Sub task attached to the task | | sub\_task\_status | String | Status of Sub task attached to the task | | area\_of\_improvement | String | Category of the project created or assigned or imported | | task\_count | Long | Total count of tasks in project | | sub\_task | String | Name of Sub task attached to the task | | project\_created\_date | Date | Date of creation of the project | | project\_evidence\_count | Long | Total attachment count uploaded for Project | ## ml-project-status | ml-project-programLevel-status | Dimensions | Datatype | Description | | --------------------------- | -------- | ----------------------------------------------------------------------------------------------------------------------- | | unique\_projects | long | Agg. coloumn in druid - countDistinct of project\_id | | unique\_users | long | Agg. coloumn in druid - countDistinct of createdBy | | unique\_solution | long | Agg. coloumn in druid - countDistinct of solution\_id | | no\_of\_certificate\_issued | long | Agg. coloumn in druid - countDistinct of "certificate\_status\_customised" == "Issued" , "project\_id" | | no\_of\_imp\_with\_evidence | long | Agg. coloumn in druid - countDistinct of "evidence\_status" == True, "status\_of\_project" == "submitted","project\_id" | ## sl-observation | Dimensions | Datatype | Description | | --------------------------------- | -------- | ------------------------------------------------------------------------------------------------ | | solutionExternalId | String | Unique identifier of the Solution in an observation | | questionResponseType | String | which type of question is - Like text, radio, slider, multiselect, matrix, date, number | | instanceParentCriteriaName | String | question type has matrix Name of that is instanceParentCriteriaName | | criteriaId | String | Unique identifier of the Criteria in an observation | | criteriaName | String | Name of the Criteria to which the observation is submitted | | location\_validated\_with\_geotag | String | Observe Again location of user after user submitted | | user\_boardName | String | Board Name of the user belongs to - CBSE, State (Andhra Pradesh), IGOT-Health etc | | observationId | String | Unique identifier of the an observation | | programName | String | Name of the program to which the observation is submitted | | blockName | String | Name of the Block mapped to the user | | childType | String | Type of sub question in criteria - criteria | | organisation\_name | String | Organisation Name of the user belongs to -Staging Custodian Organization, Globe etc | | user\_clusterName | String | Cluster Name of the user belongs to | | solution\_type | String | Defines the type of Solution | | criteriaExternalId | String | Unique identifier of the Criteria in an observation | | questionResponseLabel | String | Answers given by User | | instanceParentExternalId | String | Matrix question External Id | | domainLevel | String | level label of Domin | | imp\_project\_externalId | String | Unique Identifier for the project | | organisation\_id | String | Unique Identifier for the organisation | | districtName | String | Name of the District mapped to the user | | entityName | String | Name of the entity added by the user during observation submission | | instanceParentResponsetype | String | which type of question is - Like text, radio, slider, multiselect inside instance question | | clusterExternalId | String | Unique identifier of the cluster | | entityExternalId | String | Unique identifier of the entity added by the user during observation submission | | instanceParentId | String | Unique identifier of the instance parent | | instanceParentQuestion | String | question type has matrix Name of that is | | scoringSystem | String | Type of scoring is the question has Ex : pointBasedScoring | | district\_externalId | String | Unique identifier of the District mapped to the user | | instanceId | String | Unique identifier of the instance | | role\_title | String | User sub type | | observationSubmissionId | String | Unique identifier generated by system for each submission | | district | String | Name of the District mapped to the user | | instanceParentEcmSequence | Long | sequence order of Questions | | state\_code | Long | Unique identifier of the State code | | maxScore | String | Max score can be given for Questions | | questionExternalId | String | Unique identifier for the Questions | | questionName | String | Question label | | criteriaLevelReport | Boolean | Is question criteria level | | submissionNumber | String | how many submission done for observation | | stateExternalId | String | Unique identifier of the State mapped to the user | | evidences | String | Link of the attachment uploaded | | percentageScore | String | percentage of score got for observation | | user\_schoolUDISE\_code | String | Unique identifier for the school | | question\_response\_number | String | Answers for question response type number | | completedDate | Date | Observation submission completion date | | user\_type | String | User Role | | childName | String | Name of the criteria | | solutionName | String | Name of the Project | | domainExternalId | String | Unique identifier for the Domian | | programId | String | Unique identifier generated by the system for the observation submitted | | solutionId | String | Unique identifier of the Solution in an observation generated by system | | criteriaDescription | String | Description of Criteria | | instanceParentCriteriaExternalId | String | question type has matrix Id of that | | cluster | String | Name of the Cluster mapped to the user | | user\_schoolName | String | Name of the School mapped to the user | | observationName | String | Name of the solution to which the observation is submitted | | questionId | String | Unique identifier for the question | | user\_districtName | String | Name of the District mapped to the user | | entityType | String | Type of entity for the observation submission | | questionSequenceByEcm | String | Sequenced order of Questions | | createdBy | String | User keycloak id on the sunbrid platform | | channel | String | Root organisation of the user | | entityTypeId | String | System generated unique identifier of the entity added by the user during observation submission | | programExternalId | String | Unique identifier of the observation submitted | | ancestorName | String | Name of ancestor | | isRubricDriven | Boolean | Defines the type of Solution | | state | String | Name of the State mapped to the user | | cluster\_externalId | String | Unique identifier of the cluster | | isAPrivateProgram | String | Boolean value that defines program type | | childExternalid | String | Unique identifier of the criteria | | imp\_project\_goal | String | Goal of project | | block\_code | Long | Unique identifier of the Block code | | school | String | Name of the School mapped to the user | | evidence\_count | String | Total attachment count uploaded | | criteriaLevel | String | level of Criteria | | district\_code | Long | Unique identifier of the District code | | cluster\_code | Long | Unique identifier of the Cluster code | | parent\_channel | String | Column with constant value - "SHIKSHALOKAM" | | programDescription | String | description of the Program | | submissionTitle | String | Tittle of Submission | | user\_blockName | String | Name of the Block mapped to the user | | isSubmissionDeleted | Boolean | is submission deleted or not | | solutionDescription | String | Name of the solution to which the observation is submitted | | domainScore | String | score's of Domin questions | | questionResponseLabel\_number | String | Ans for question response type number | | entity | String | Name of the entity added by the user during observation submission | | clusterName | String | Name of the Cluster mapped to the user | | instanceParentCriteriaId | String | matrix question criteria id | | user\_stateName | String | Name of the State mapped to the user | | createdAt | Date | Date of creation of the observation | | criteriaScore | String | score's of criteria questions | | minScore | String | minimum score's for questions | | stateName | String | Name of the State mapped to the user | | total\_evidences | Long | Total attachment count uploaded for observation | | updatedAt | Date | observation last updated date | | label | String | Name of the level's - level1, level2 | | imp\_project\_title | String | Title of project in observations | | blockExternalId | String | Unique identifier of the Block | | pointsBasedScoreInParent | Long | points based scoring system for parent type question | | domainName | String | Name of the Domain | | schoolName | String | Name of the School | | remarks | String | Remarks Given By the User | | scoreAchieved | String | Total score achivedBy User | | school\_externalId | String | Unique identifier of the School mapped to the user | | totalScore | String | Total score of observation | | block\_externalId | String | Unique identifier of the Block | | school\_code | Long | Unique identifier of the school code | | state\_externalId | String | Unique identifier of the State | | schoolExternalId | String | Unique identifier of the School Id mapped to the user | | user\_schoolId | String | Unique identifier of the School mapped to the user | ## sl-observation-status | Dimensions | Datatype | Description | | ------------------------ | -------- | ------------------------------------------------------------------------------------------------ | | solution\_id | String | Unique identifier of the Solution in an observation generated by system | | observed\_district\_code | Long | Observe Again Submission Entity i,e Districy Code | | observed\_state\_code | Long | Observe Again Submission Entity i,e State Code | | state\_name | String | Name of the State mapped to the user | | solution\_name | String | Name of the solution to which the observation is submitted | | observed\_district\_id | Long | Observe Again Submission Entity i,e District Id | | observed\_school\_name | Long | Observe Again Submission Entity i,e School Id | | user\_id | String | User keycloak id on the sunbrid platform | | observed\_cluster\_id | Long | Observe Again Submission Entity i,e Cluster Id | | program\_id | String | Unique identifier of the program to which the observaion is mapped to | | program\_externalId | String | Unique identifier of the program to which the observation is mapped to | | observed\_cluster\_code | Long | Observe Again Submission Entity i,e Cluster Code | | app\_name | String | Column with constant value - "dikshasurvey" | | observed\_school\_code | Long | Observe Again Submission Entity i,e School Code | | observed\_state\_name | String | Observe Again Submission Entity i,e state | | ecm\_marked\_na | String | Evidence collection method marked as Not Applicable | | cluster\_name | String | Name of the Cluster mapped to the user | | observed\_district\_name | String | Observe Again Submission Entity i,e District | | submission\_id | String | Unique system generated identifier for each observation submissions | | entity\_type | String | Type of entity for the observation submission | | observed\_block\_name | String | Observe Again Submission Entity i,e Block | | status | String | Status of the observation submission | | entity\_externalId | String | Unique identifier of the entity added by the user during observation submission | | entity\_name | String | Name of the entity added by the user during observation submission | | observed\_cluster\_name | String | Observe Again Submission Entity i,e Cluster Name | | school\_name | String | Name of the School declared by the User | | solution\_externalId | String | Unique identifier of the Solution in an observation | | block\_name | String | Name of the Block mapped to the user | | program\_name | String | Name of the program to which the observation is submitted | | observed\_block\_id | Long | Observe Again Submission Entity i,e Block Id | | observed\_state\_id | Long | Observe Again Submission Entity i,e Sate Id | | private\_program | String | boolean value that defines program type | | observed\_block\_code | Long | Observe Again Submission Entity i,e Block Code | | board\_name | String | Name of the board mapped to the user | | observed\_school\_id | Long | Observe Again Submission Entity i,e School Id | | district\_name | String | Name of the District mapped to the user | | entity\_id | String | System generated unique identifier of the entity added by the user during observation submission | ## ml-obs-status | Dimensions | Datatype | Description | | ------------------- | -------- | ------------------------------------------------------- | | unique\_entities | Long | Agg. coloumn in druid - countDistinct of entity\_id | | unique\_submissions | Long | Agg. coloumn in druid - countDistinct of submission\_id | | unique\_users | Long | Agg. coloumn in druid - countDistinct of createdBy | | unique\_solution | Long | Agg. coloumn in druid - countDistinct of solution\_id | ## ml-obs-domain | ml-obs-domain-criteria | Dimensions | Datatype | Description | | ------------------- | -------- | ------------------------------------------------------- | | domain\_externalId | String | Unique identifier of the Domian in an observation | | domain\_level | String | Level lable of the Domain | | domain\_name | String | Name of the Domain | | unique\_users | Long | Agg. coloumn in druid - countDistinct of createdBy | | unique\_entities | Long | Agg. coloumn in druid - countDistinct of entity\_id | | unique\_solution | Long | Agg. coloumn in druid - countDistinct of solution\_id | | unique\_submissions | Long | Agg. coloumn in druid - countDistinct of submission\_id | ## MongoDB Schema ## batchLogger collection ``` { "_id" : ObjectId, "dataSource" : String, // druid data source "taskId" : String, // druid task id "taskCreatedDate" : String, "statusCode" : Integer, "createdAt" : ISODate, "updatedAt" : ISODate, "status" : String } ``` ## reports\_logger collection ``` { "_id": ObjectId, "operation": String, // frontend_update, backend_create "file": String, // path of the report config JSON "reportId": String, // UUID of report "createdAt": ISODate, "updatedAt": ISODate, "config": Object, // report config "status": String // success, failed, duplicate } ``` --- # Agent Instructions: Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://ed.sunbird.org/use/source-code/manage-learn/ml-anaylatics-service/data-model.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.