Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azur - Diksha_data_summary file processing is not happening #656

Closed
chetandg123 opened this issue Oct 21, 2022 · 14 comments · Fixed by Sunbird-cQube/cQube_Edu#524, Sunbird-cQube/cQube_Edu#528 or Sunbird-cQube/cQube_Edu#541
Assignees
Labels
Bug-Major supporting components and modules are not working fine

Comments

@chetandg123
Copy link

chetandg123 commented Oct 21, 2022

Emitted the diksha tpd enrolment file to diksha_enrolment folder , file is not processing in static data processor

@krishnakr6
Copy link
Contributor

Azure support is not implemented in the below code.
https://github.com/Sunbird-cQube/cQube_Edu/blob/cqube-v4.0-beta/processing/datasource/python/diksha_enrolment_file_split.py

@Shoaib15khan add the azure support here.

@krishnakr6 krishnakr6 added Bug-Major supporting components and modules are not working fine and removed Bug-Blockers Blocks further testing labels Oct 21, 2022
@chetandg123
Copy link
Author

@htvenkatesh @padmanabha1234 @Shoaib15khan emitted the diksha_data_summary_UP_76dis.zip file to Diksha folder , nifi processing is not happening

@htvenkatesh
Copy link
Collaborator

@padmanabha1234 @Shoaib15khan wts the update on this ticket?

@devu1454 devu1454 changed the title Azur - Diksha enrolment files are not processing Azur - Diksha_data_summary file processing is not happening Oct 25, 2022
@devu1454
Copy link

@htvenkatesh re-tested this issue, still nifi is not picking the file from emission data storage

@devu1454
Copy link

Re-tested this issue, Still nifi is not picking the diksha_data_summary adn diksha_tpd file

@murali003
Copy link

@devu1454 you have checked older version can you please take latest updated code and re-test.

@devu1454
Copy link

@murali003 Installed the updated code and checked the data processing of diksha files. Still i am unable to process the diksha_data_summary.zip file

@murali003
Copy link

murali003 commented Oct 28, 2022

TDD:

  1. Emit the diksha_data_summary enrolment file to diksha_enrolment folder
    azure: diksha_data_summary file should be pick from emission bucket
  2. once it's pick the file all validation should be happen

Expected Result:

  1. Data should be updated in database table
  2. In log_summary folder, log_summary_diksha.json file to be generated

@RNarmatha
Copy link
Collaborator

@chetandg123  Please do the retest.

@chetandg123
Copy link
Author

Task is paused due to dependency of issue #688

@chetandg123
Copy link
Author

@padmanabha1234 diksha tpd enrolment file processing is not working

Image

@murali003
Copy link

@Shoaib15khan the issue is related to diksha enrolment file, so please look into it.

@Shoaib15khan
Copy link

@chetandg123 issue is resolved . please take a retest on it. @RNarmatha FYI.

@chetandg123
Copy link
Author

@htvenkatesh Diksha all files are processed and we are able to see the ui report with data

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment