ng6 issueshttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues2018-06-19T15:14:21+02:00https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/3Infos générales sur la page purge2018-06-19T15:14:21+02:00Celine NoirotInfos générales sur la page purgeDonner l'information de :
- la somme totale "purgeable"
- le nombre total de projets
correspondant aux projets filtrés.Donner l'information de :
- la somme totale "purgeable"
- le nombre total de projets
correspondant aux projets filtrés.V3.1 - PurgeClaire KuchlyClaire Kuchly2018-04-18https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/6Update of the picardtools2018-08-02T13:07:23+02:00Audrey GibertUpdate of the picardtoolsWe have picardtools 1.88
we want to test v2.14 on SLURMWe have picardtools 1.88
we want to test v2.14 on SLURMV3.2 - SlurmAudrey GibertAudrey Gibert2018-04-27https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/7Update of Samtools2018-08-01T09:19:30+02:00Maxime MannoUpdate of SamtoolsOn Genotoul we use samtools v1.1
We want to use the v1.3.1 on genologin (for the momentOn Genotoul we use samtools v1.1
We want to use the v1.3.1 on genologin (for the momentV3.2 - SlurmMaxime MannoMaxime Manno2018-04-30https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/9Regenerate a password for users added by the project manager2020-01-22T16:22:03+01:00Audrey GibertRegenerate a password for users added by the project managerFor now, there is no possibility for a user added by the project manager to regenerate their password.
=> It has to be addedFor now, there is no possibility for a user added by the project manager to regenerate their password.
=> It has to be addedRomain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/13flag project which all runs and analyses are purgeable2018-07-18T15:48:10+02:00Claire Kuchlyflag project which all runs and analyses are purgeableV3.1 - PurgeClaire KuchlyClaire Kuchly2018-06-30https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/14[purge] : for projet who has no administror : mail sent to all users project2018-08-28T14:39:30+02:00Claire Kuchly[purge] : for projet who has no administror : mail sent to all users projectV3.1 - PurgeCeline NoirotCeline Noirot2018-06-30https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/16generate script to compute storage size for extention2019-07-23T14:15:59+02:00Celine Noirotgenerate script to compute storage size for extentionV3.1 - Purge2018-06-29https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/12Add visualisation and compute of stored/purged size per group/lab2018-07-18T15:48:10+02:00Celine NoirotAdd visualisation and compute of stored/purged size per group/labAdd visualisation of stored/purged size per group/lab
Generate a table and a graphics.Add visualisation of stored/purged size per group/lab
Generate a table and a graphics.V3.1 - PurgeCeline NoirotCeline Noirot2018-06-29https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/17Add project extention2018-07-18T15:48:10+02:00Celine NoirotAdd project extentionIf a project has a obsolete run (not all), all its run or analysis can be extentedIf a project has a obsolete run (not all), all its run or analysis can be extentedV3.1 - PurgeCeline NoirotCeline Noirot2018-06-30https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/18List all project even not obsolete2018-06-28T18:11:30+02:00Celine NoirotList all project even not obsoleteList all project in purge management to enable the extention for the projects of a complete lab.List all project in purge management to enable the extention for the projects of a complete lab.V3.1 - PurgeCeline NoirotCeline Noirot2018-06-30https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/23Add total project size in purge demand email2018-06-27T16:32:07+02:00Celine NoirotAdd total project size in purge demand emailV3.1 - PurgeCeline NoirotCeline Noirothttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/29Modification du plugin nG6 typo3 pour utilisation sur php7 et typo3 V82018-08-28T14:15:29+02:00Gerald Salingerald.salin@inra.frModification du plugin nG6 typo3 pour utilisation sur php7 et typo3 V8copier/coller du mail ne fonctionne pas très bien.
mise de la procedure de mise à jour du plugin ng6 en PJ[procedure_mise_a_jour_ng6_typo3V8.pdf](/uploads/99473730dc54cc392fe051dc18a6f72e/procedure_mise_a_jour_ng6_typo3V8.pdf)[diffModifn...copier/coller du mail ne fonctionne pas très bien.
mise de la procedure de mise à jour du plugin ng6 en PJ[procedure_mise_a_jour_ng6_typo3V8.pdf](/uploads/99473730dc54cc392fe051dc18a6f72e/procedure_mise_a_jour_ng6_typo3V8.pdf)[diffModifnG6_Typo3_V8](/uploads/899e4ad5977dafc9bf0558339e03f93f/diffModifnG6_Typo3_V8)V3.2 - SlurmGerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.frhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/31add link and name to runs and analyses and projects in the purge email2019-09-10T11:58:20+02:00Gerald Salingerald.salin@inra.fradd link and name to runs and analyses and projects in the purge emaile.g.
Files impacted of:
- runs names: 314,315,316,317,735,723,1292,1414,1423,1530,1974,1983
- analyses ids: 1149,1151,1154,1150,1152,1153,1155,1159,1160,1156,1157,1158,3650,3652,3662,3634,3633,3623,3621,3636,3635,5835,5840,5852,5858,585...e.g.
Files impacted of:
- runs names: 314,315,316,317,735,723,1292,1414,1423,1530,1974,1983
- analyses ids: 1149,1151,1154,1150,1152,1153,1155,1159,1160,1156,1157,1158,3650,3652,3662,3634,3633,3623,3621,3636,3635,5835,5840,5852,5858,5855,5845,6309,6310,6311,6313,6314,6320,6321,6382,6381,6380,6379,6378,6383,6758,6757,6759,6763,8532,8539,8544,8547,8559,8568,8571,8582,158V3.2.6Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/32add manual for purging data2018-08-02T14:57:31+02:00Gerald Salingerald.salin@inra.fradd manual for purging dataV4 - MaintenanceClaire KuchlyClaire Kuchlyhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/33correct source indent (tabs/white space) for all files2019-08-29T14:11:18+02:00Gerald Salingerald.salin@inra.frcorrect source indent (tabs/white space) for all filesV4 - MaintenanceRomain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/39Purge : Set Email From, in ng6 conf pi6 comme pour pi12019-08-30T10:09:24+02:00Celine NoirotPurge : Set Email From, in ng6 conf pi6 comme pour pi1![image](/uploads/59f957cf14964106c3b4e51914488f29/image.png)![image](/uploads/59f957cf14964106c3b4e51914488f29/image.png)V3.2.6Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/42Upgrade jflow: load server file2018-08-09T17:15:33+02:00Celine NoirotUpgrade jflow: load server filecheck how ng6 upload server file.
This functionnality is now in jflowcheck how ng6 upload server file.
This functionnality is now in jflowV3.2 - SlurmCeline NoirotCeline Noirothttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/66add a way to align illumina reads against a subset of reads2018-09-06T13:56:45+02:00Gerald Salingerald.salin@inra.fradd a way to align illumina reads against a subset of readswith novaseq/hiseq data, the alignment step can be very time consuming.
think of a way to only align a subset of the reads, giving a workflow argument, e.g. --align-subset-reads
some source code is available in the extract_random_seq f...with novaseq/hiseq data, the alignment step can be very time consuming.
think of a way to only align a subset of the reads, giving a workflow argument, e.g. --align-subset-reads
some source code is available in the extract_random_seq function of SubSetAssignation componentV3.2 - SlurmClaire KuchlyClaire Kuchlyhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/68add md5sum for raw data in all pipelines2018-09-07T12:07:23+02:00Gerald Salingerald.salin@inra.fradd md5sum for raw data in all pipelinesV3.2 - SlurmGerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.frhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/69Add a super admin ng6 who can see all projects2019-09-27T13:14:15+02:00Claire KuchlyAdd a super admin ng6 who can see all projectshttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/70enhance disk usage with concatenatefilesgroups2018-09-17T09:30:51+02:00Gerald Salingerald.salin@inra.frenhance disk usage with concatenatefilesgroupsto limit the disk usage in illumina pipelines, do not store the output of ConcatenateFilesGroups component in its out output folder, but rather in the run.get_work_directory() folder.
saves a copy step (originally done in AddRawFiles com...to limit the disk usage in illumina pipelines, do not store the output of ConcatenateFilesGroups component in its out output folder, but rather in the run.get_work_directory() folder.
saves a copy step (originally done in AddRawFiles componenent) and limit the disk usage (can represent few hundreds of Gb for novaseq runs)V3.2 - Slurmhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/71clean pipeline outputs if succeeded2018-09-06T15:09:01+02:00Gerald Salingerald.salin@inra.frclean pipeline outputs if succeededallow the deletion of files in the worflow output dir to save dik spaceallow the deletion of files in the worflow output dir to save dik spaceV4 - Maintenancehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/87Enhancing the display of a project search result2019-08-29T14:24:03+02:00Audrey GibertEnhancing the display of a project search resultI was looking for project Epi on the ng6 project page.
It appears on the 2nd page of search result because according to ng6, space character comes after letters.I was looking for project Epi on the ng6 project page.
It appears on the 2nd page of search result because according to ng6, space character comes after letters.Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/96Extra space between md5 and file name in md5sum.txt2018-12-14T18:44:42+01:00Roxane BoyerExtra space between md5 and file name in md5sum.txtThere are 3 spaces instead of 2 in the md5sum file :
```
3efa244db27854b63b740a31e16e85e6 ESE00019_AAGTCCAA-TACTCATA-AH2MC2BBXY_L002_R1.fastq.gz
ff0510e4615e75a5b5cccac402262e88 ESE00107_GTTCCAAT-GCAGAATT-AH2MC2BBXY_L002_R2.fastq.gz...There are 3 spaces instead of 2 in the md5sum file :
```
3efa244db27854b63b740a31e16e85e6 ESE00019_AAGTCCAA-TACTCATA-AH2MC2BBXY_L002_R1.fastq.gz
ff0510e4615e75a5b5cccac402262e88 ESE00107_GTTCCAAT-GCAGAATT-AH2MC2BBXY_L002_R2.fastq.gz
```
md5sum -c md5sum.txt
md5sum: PLF7_GCCGCG-C28GH_L001_R1.fastq.gz: Aucun fichier ou dossier de ce type
PLF7_GCCGCG-C28GH_L001_R1.fastq.gz : Échec d'ouverture ou de lecture.Roxane BoyerRoxane Boyerhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/101adapt visualisation of ONT versions (gridion and promethion)2019-01-15T14:01:26+01:00Maxime Mannoadapt visualisation of ONT versions (gridion and promethion)The scripts parse-version for ONT gridion and promethion have been modified. We need to update and adapt the visualisationThe scripts parse-version for ONT gridion and promethion have been modified. We need to update and adapt the visualisationV3.2.3Maxime MannoMaxime Mannohttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/102Amélioration de la FAQ2019-08-02T09:42:35+02:00Roxane BoyerAmélioration de la FAQL'onglet FAQ de ng6 devrait peut-être faire peau neuve.
Notamment en ce qui concerne les adaptateurs des séquences Illumina, les informations présentées portent à confusion, et les index Illumina semblent avoir changé (une base en plus a...L'onglet FAQ de ng6 devrait peut-être faire peau neuve.
Notamment en ce qui concerne les adaptateurs des séquences Illumina, les informations présentées portent à confusion, et les index Illumina semblent avoir changé (une base en plus au début et à la fin de la séquence).Roxane BoyerRoxane Boyerhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/106Configuring different storage space2019-09-06T17:11:30+02:00Celine NoirotConfiguring different storage spaceAdd a workflow parameter to store raw data and processed results in different storage space depending on project (ng6 or seqoccin or labs ?)
Warn:
- Quality control must be keep even if storage space is deleted, must be store in in ng6 ...Add a workflow parameter to store raw data and processed results in different storage space depending on project (ng6 or seqoccin or labs ?)
Warn:
- Quality control must be keep even if storage space is deleted, must be store in in ng6 space ?
- Think to handle data purge (do not delete if it's in rented space), check administration purge.
Code :
- web interface:
- storage info is stored in application.properties and db
- file eg: run_view.tmpl use relative path : `{$link=(('fileadmin'|cat:$runs[key($runs)].directory)|cat:'/')|cat:$file}`
- statistics storage space: check and define how to handle those spaces
- jflow code :
- application.properties will contain new section for storage space defined py project/lab name
- the storage space name is linked to a project
- functions get_save_directory() ... has to be adapted
- db must contain storage space name
- filesystem
- web interface: create symbolic link in fileadmin directory on different spaces
- adding new storage space, create symbolic link (look at how is done in jflow for [storage] section
- only project table has new attribute storage spaceV3.2.5Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/107handle limit storage period/date depending on storage space parameter2019-08-30T17:25:07+02:00Celine Noirothandle limit storage period/date depending on storage space parameterData storage period depend on kind of project (eg seqoccin), this should be a workflow parameter.
To ensure the user do not set period value, the period has to be set in application.properties.
- For rented space validate how to set en...Data storage period depend on kind of project (eg seqoccin), this should be a workflow parameter.
To ensure the user do not set period value, the period has to be set in application.properties.
- For rented space validate how to set end of storage date
![image](/uploads/dcb383c6dea62c2d9ededd61a85fe433/image.png)
- end of storage date could depend on a date or a period depending on storage space name
```
[space_default]
retention_period = 3m
path=/ng6
[space_default_old]
retention_period = 2y
path=/ng6
[space_seqoc]
# pour un espace donnee : deux parametre exclusif retention_date != retention_period
retention_date=12/03/2021
#retention_period = 2year
path=/seqoc
```
- Add retention_time parameter in application.properties.example
V3.2.5Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/108export metadata2019-08-30T09:27:13+02:00Celine Noirotexport metadataadd a functionality to export all metadata of project, run, analysis.add a functionality to export all metadata of project, run, analysis.V4 - Maintenancehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/109ftp server architecture2019-08-30T09:27:13+02:00Celine Noirotftp server architectureKeep/generate run/analysis architecture for a project when ftp server will be available.Keep/generate run/analysis architecture for a project when ftp server will be available.V4 - MaintenanceGerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.frhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/111[ont-qc] Adding logs to ont-qc analysis2019-07-23T09:22:06+02:00Maxime Manno[ont-qc] Adding logs to ont-qc analysis#### It should have log files from :
* [x] the Merkaat pipeline log
* [x] final status run summary log#### It should have log files from :
* [x] the Merkaat pipeline log
* [x] final status run summary logV3.2.4Maxime MannoMaxime Manno2019-07-31https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/112[ont-qc] Adding new analysis : Demultiplex Stat for ONT2021-03-25T13:39:09+01:00Maxime Manno[ont-qc] Adding new analysis : Demultiplex Stat for ONT#### We need to change the current demultiplex stat analysis management : :metal:
**What will change ?** replacement of porechop by Qcat, creation of a new analysis
* [x] Create new component
* [x] Create new template
* [x] Add seqki...#### We need to change the current demultiplex stat analysis management : :metal:
**What will change ?** replacement of porechop by Qcat, creation of a new analysis
* [x] Create new component
* [x] Create new template
* [x] Add seqkit stats logs for all the samples (included the unmappaed files)
* [x] Add fastq files only for the barcodes added into the pool
* [x] Add Qcat and Seqkit path and oprions into the application.propertiesV4 - MaintenanceMaxime MannoMaxime Manno2019-08-31https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/113[ont_qc] Add N90 and 5 longest reads informations2019-07-24T09:39:10+02:00Maxime Manno[ont_qc] Add N90 and 5 longest reads informationsV3.2.3.1Maxime MannoMaxime Mannohttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/116Custom message for purged data2019-08-30T13:23:46+02:00Romain ThervilleCustom message for purged dataWe need another message, replacing "Results folder not synchronized yet... " when the data has been purged.We need another message, replacing "Results folder not synchronized yet... " when the data has been purged.V3.2.5Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/117Add duplication stat to alignmentStat analyze2019-08-30T13:23:44+02:00Claire KuchlyAdd duplication stat to alignmentStat analyzeV3.2.5Natacha FaivreNatacha Faivrehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/120add the retention policy to project view2020-01-22T11:28:03+01:00Gerald Salingerald.salin@inra.fradd the retention policy to project viewV3.2.6Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/122changes to NG6's database structure should appear in a .sql file2019-10-14T16:19:52+02:00Romain Thervillechanges to NG6's database structure should appear in a .sql fileWe should change the MO and check that all changes to the databse structure do appear in /bin/ng6_database.sql (Or find a better way not to miss those changes).We should change the MO and check that all changes to the databse structure do appear in /bin/ng6_database.sql (Or find a better way not to miss those changes).V3.2.6https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/126Add a new group superadmin2019-10-29T09:36:55+01:00Celine NoirotAdd a new group superadminDuring purge step, system administrator need to have access to all the project.
*Actually to do so, we add in production a nG6_ADMIN users which is added to all project manually (via sql query during purge process)*
It would be interest...During purge step, system administrator need to have access to all the project.
*Actually to do so, we add in production a nG6_ADMIN users which is added to all project manually (via sql query during purge process)*
It would be interesting to have a new group "superadmin" which give access to all the projects.V3.2.6Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/127Purge email should be send to all the users of the project.2019-09-20T11:37:40+02:00Celine NoirotPurge email should be send to all the users of the project.From now, email to alert for a purge has to be sent to all the member, administrator and manager of the project.From now, email to alert for a purge has to be sent to all the member, administrator and manager of the project.V3.2.6Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/128Discard some email adress from purge email.2019-09-20T10:27:40+02:00Celine NoirotDiscard some email adress from purge email.Add a list a emails address to discard from purge email.
To be configure as "email_from"
Eg:
plugin.tx_nG6_pi6.email_to_discard = ctd@inra.fr,ng6-support@inra.fr
Remove thoses email from the list of destinator of the emailAdd a list a emails address to discard from purge email.
To be configure as "email_from"
Eg:
plugin.tx_nG6_pi6.email_to_discard = ctd@inra.fr,ng6-support@inra.fr
Remove thoses email from the list of destinator of the emailV3.2.6Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/129Script/workflow to migrate a list of project to from a space to another2020-11-30T11:30:50+01:00Celine NoirotScript/workflow to migrate a list of project to from a space to anotherDevelop a script to transfert a project from a storage space to another :
- change project space id
- change path of run, analyzes (of the project and of the runs)
- move filesDevelop a script to transfert a project from a storage space to another :
- change project space id
- change path of run, analyzes (of the project and of the runs)
- move filesV3.2.7.5Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/137The static retention period given in the purge mail has to be computed2020-01-27T17:01:35+01:00Romain ThervilleThe static retention period given in the purge mail has to be computed"Dear user,
The two years data storage period of part or whole Accord-Bio project (1 run(s) and 7 analyse(s)) is ended."
Now that the retention is not a constant anymore, the purge mail text should be updated to give the right retention..."Dear user,
The two years data storage period of part or whole Accord-Bio project (1 run(s) and 7 analyse(s)) is ended."
Now that the retention is not a constant anymore, the purge mail text should be updated to give the right retention period.V3.2.6Romain ThervilleRomain Therville2019-11-21https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/142manage run 10X with samples with custom index that have to be processed like ...2022-12-16T16:21:27+01:00Claire Kuchlymanage run 10X with samples with custom index that have to be processed like 10X samplesLike SOCSMURIS projects : [mantis 4657](https://genomique.genotoul.fr/Mantis/view.php?id=4657), 10X samples and other samples in the same lane with longranger demultiplexing.
Rigth now, only sample with 10X indexes can be analyse with 1...Like SOCSMURIS projects : [mantis 4657](https://genomique.genotoul.fr/Mantis/view.php?id=4657), 10X samples and other samples in the same lane with longranger demultiplexing.
Rigth now, only sample with 10X indexes can be analyse with 10X illumina qc workflow.Claire KuchlyClaire Kuchlyhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/146There are hard-coded links in Admin>Extend Project>Project name column2020-06-11T17:01:31+02:00Romain ThervilleThere are hard-coded links in Admin>Extend Project>Project name columnEx: href="index.php?id=3&tx_nG6_pi1[project_id]=1"
The "id=3" has to be recovered from the typo3 "plugin.tx_nG6_pi6.redirection_page" template value.
This is defined in tx_nG6_pi6.js, line 706.
The expected result would be href="index.p...Ex: href="index.php?id=3&tx_nG6_pi1[project_id]=1"
The "id=3" has to be recovered from the typo3 "plugin.tx_nG6_pi6.redirection_page" template value.
This is defined in tx_nG6_pi6.js, line 706.
The expected result would be href="index.php?**id=55**&tx_nG6_pi1[project_id]=1" .V3.2.7Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/148Add the duplicat rate without alignment in all illumina workflow2022-12-16T16:21:27+01:00Claire KuchlyAdd the duplicat rate without alignment in all illumina workflowAll the pipeline must have the duplication rate of all the samples : it must be a mandatory analysis.
Add to ng6workflow.pyAll the pipeline must have the duplication rate of all the samples : it must be a mandatory analysis.
Add to ng6workflow.pyClaire KuchlyClaire Kuchly2019-12-31https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/149[Sequel2] make new qc pipeline for Sequel2 data2022-12-16T16:21:28+01:00Claire Kuchly[Sequel2] make new qc pipeline for Sequel2 dataRaw data from Sequel2 instrument are different from the raw data of the RSII instrument.
We would create new pipeline :
This pipeline take CCS and CLR data.
This pipeline make available for :
* CCS data : subreads.ccs.bam file
* CL...Raw data from Sequel2 instrument are different from the raw data of the RSII instrument.
We would create new pipeline :
This pipeline take CCS and CLR data.
This pipeline make available for :
* CCS data : subreads.ccs.bam file
* CLR data : all files in output directory
Create of one analysis of run_stat.
? Make available fastq file.
?Claire KuchlyClaire Kuchly2020-01-31https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/151Add a space id column in Administration > Mail obsolete project2020-01-16T17:33:08+01:00Romain ThervilleAdd a space id column in Administration > Mail obsolete project- New space_id column
- Replace the "size greater than" filter with a "space_id" selection- New space_id column
- Replace the "size greater than" filter with a "space_id" selectionV3.2.6Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/156Style error2020-04-03T14:00:13+02:00Celine NoirotStyle error- Cadre pour les projets chevauchant et n'utilise pas tout l'espace
- foooter non centré- Cadre pour les projets chevauchant et n'utilise pas tout l'espace
- foooter non centréV3.2.6Celine NoirotCeline Noirothttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/161A rework of the purge processes is needed2020-03-04T09:25:59+01:00Romain ThervilleA rework of the purge processes is neededWith the new retention, space and migration features, a few new cases have to be handled by the purge system:
* New mail model, for the projects in shortterm storage (4 months), that indicate 1 month in advance that the data are going ...With the new retention, space and migration features, a few new cases have to be handled by the purge system:
* New mail model, for the projects in shortterm storage (4 months), that indicate 1 month in advance that the data are going to be deleted.
No extention is allowed in this case.
* A new CRON that sends the purge mail one month before the data deletion and opens a purge request (Admin > Mail obsolete projects).
* A new CRON (every week) to send to the ng6 administrators the list of the last purge mails sent.V3.2.7Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/167[Sequel2] make available BAM format from addrun2022-12-16T16:21:28+01:00Celine Vandecasteele[Sequel2] make available BAM format from addrunCurrently we can only make available fastq format when we add a run in NG6.
Data size on NG6 should be calculated from bam format.
#149Currently we can only make available fastq format when we add a run in NG6.
Data size on NG6 should be calculated from bam format.
#149Audrey GibertAudrey Giberthttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/169FAQ style is ugly2020-02-11T14:32:56+01:00Celine NoirotFAQ style is uglyDo it less uglyDo it less uglyV3.2.6Celine NoirotCeline Noirothttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/179[purge] link analyzes to runs in the email2021-10-12T08:53:41+02:00Gerald Salingerald.salin@inra.fr[purge] link analyzes to runs in the emailFiles impacted of:
• Runs : NemaTools-1 (12035), NemaTools-1 (12336)
• Analyzes : IlluminaFilter (47020), ContaminationSearch (47027), ReadsStats (47035), IlluminaFilter (48330), ContaminationSearch (48338), ReadsStats (48339)
...Files impacted of:
• Runs : NemaTools-1 (12035), NemaTools-1 (12336)
• Analyzes : IlluminaFilter (47020), ContaminationSearch (47027), ReadsStats (47035), IlluminaFilter (48330), ContaminationSearch (48338), ReadsStats (48339)
to be transformed as
Files impacted of:
• Run NemaTools-1 (12035)
Analyzes : IlluminaFilter (47020), ContaminationSearch (47027), ReadsStats (47035),
• Run NemaTools-1 (12336)
Analyzes : IlluminaFilter (48330), ContaminationSearch (48338), ReadsStats (48339)V3.4Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/181make filenames in NG6 uniq2020-05-15T07:36:11+02:00Gerald Salingerald.salin@inra.frmake filenames in NG6 uniqin NG6 FAQ, for downloading :
On a Windows workstation (Command lines), copy/paste this list in a file "listOfFiles" (B**e aware that if the same filename is found in different url, the local file will be overriden**). Then you can down...in NG6 FAQ, for downloading :
On a Windows workstation (Command lines), copy/paste this list in a file "listOfFiles" (B**e aware that if the same filename is found in different url, the local file will be overriden**). Then you can download curl for Windows (https://curl.haxx.se/download.html), extract the archive, and run this following command in a windows prompt
should not happen.
prefix the filename so that it is uniq (add the name of the parent folder which is uniq? the run Id + analysis Id?)V4 - Maintenancehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/182[Web interface]Improve FAQ accesses2021-09-01T08:59:46+02:00Audrey Gibert[Web interface]Improve FAQ accesses2 ideas on the web interface :
* [x] on a project page, on the top-right corner below the data overview frame : adding a sentence "You can add a collaborator to your project : visit the [NG6 FAQ](https://ng6.toulouse.inra.fr/index.php?id...2 ideas on the web interface :
* [x] on a project page, on the top-right corner below the data overview frame : adding a sentence "You can add a collaborator to your project : visit the [NG6 FAQ](https://ng6.toulouse.inra.fr/index.php?id=57) > How to add a user to my project?
* [x] On the run view, in the Raw Data tab, below the "Retention date" frame : adding "There is a fast way to retrieve your data, more information in the [NG6 FAQ](https://ng6.toulouse.inra.fr/index.php?id=57) > How to get my data?
* [x] On an analysis view, in the Download section, same sentence as above : "You can retrieve your data easily, more information in the [NG6 FAQ](https://ng6.toulouse.inra.fr/index.php?id=57) > How to get my data?
* [x] Be more explicit with the download by URL on windows in the FAQ
- [x] @gsalin : Add a news to signal the information!V3.3Gerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.frhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/185Adding a warning to prevent users from lauching 20+ direct url downloads at t...2022-12-16T16:21:28+01:00Romain ThervilleAdding a warning to prevent users from lauching 20+ direct url downloads at the same timeThis morning, the nG6 virtual server had a 40+ load average.
The cause seems to be a big number of direct downloads (urldownload method) from a single user.
We should add a warning like:
"If you need to recover a large number of files, ...This morning, the nG6 virtual server had a 40+ load average.
The cause seems to be a big number of direct downloads (urldownload method) from a single user.
We should add a warning like:
"If you need to recover a large number of files, please copy the links and only launch 2 to 3 downloads at the same time (Either with the wget command, or with your web browser). Thank you."Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/186put the addrawfile component generic for any type of file to be saved2022-12-16T16:21:27+01:00Claire Kuchlyput the addrawfile component generic for any type of file to be savedNow the addrawfile component is only for fastq.gz files or with PacBio data we want to saves bam/xml and json files also.
So we want to add :
* [ ] management of any files to saved
* [ ] add calculation of the number of reads and base...Now the addrawfile component is only for fastq.gz files or with PacBio data we want to saves bam/xml and json files also.
So we want to add :
* [ ] management of any files to saved
* [ ] add calculation of the number of reads and bases for bam filesAudrey GibertAudrey Gibert2020-09-30https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/188[IlluminaWF]Hiding some analyses per defaut2020-07-15T10:02:05+02:00Audrey Gibert[IlluminaWF]Hiding some analyses per defautBy default, there is only the "log files" analysis that is hidden :
![image](/uploads/6603fbe0bddccccce2c13a16675d8079/image.png)
We should also hide
* Subset read files
* alignment
* alignmentStats
* InsertSizes
*...By default, there is only the "log files" analysis that is hidden :
![image](/uploads/6603fbe0bddccccce2c13a16675d8079/image.png)
We should also hide
* Subset read files
* alignment
* alignmentStats
* InsertSizes
* DemultiplexStatsV4 - MaintenanceAudrey GibertAudrey Gibert2021-07-01https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/189GPDR2021-04-23T15:07:08+02:00Gerald Salingerald.salin@inra.frGPDRadding a user to a project allows any authenticated manager user to access the list of all users, including their password :
![image](/uploads/02075d0ab92873342988603ae9e5c84a/image.png)adding a user to a project allows any authenticated manager user to access the list of all users, including their password :
![image](/uploads/02075d0ab92873342988603ae9e5c84a/image.png)V3.2.8https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/193The purge process should ignore hidden runs and analyses2021-03-25T14:28:42+01:00Romain ThervilleThe purge process should ignore hidden runs and analysesWe don't want the hidden runs and analyzes to appear in the purge alert mail sent to the research teams.
So they have to be removed from the project's expired components, and excluded from the total storage size.We don't want the hidden runs and analyzes to appear in the purge alert mail sent to the research teams.
So they have to be removed from the project's expired components, and excluded from the total storage size.V3.2.7.5Romain ThervilleRomain Therville2021-03-05https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/196mail method : some people does not receive mails sent by ng6-slurm2021-04-28T18:59:38+02:00Gerald Salingerald.salin@inra.frmail method : some people does not receive mails sent by ng6-slurmhttps://ariane.inrae.fr/block/?id=ariane_ticket&table=incident&sys_id=96e56e891bdfec102c571176bd4bcb76https://ariane.inrae.fr/block/?id=ariane_ticket&table=incident&sys_id=96e56e891bdfec102c571176bd4bcb76V3.2.8Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/198upgrade to run under typo3 v92021-04-28T18:58:29+02:00Gerald Salingerald.salin@inra.frupgrade to run under typo3 v9V3.2.8Gerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.frhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/199update links2021-04-28T14:46:19+02:00Gerald Salingerald.salin@inra.frupdate linkswith the new typo3 version, links are human readable :
change the index.php?id=XX&WWWWWWW with the corresponding page slug in the source
and have to create redirects in apache for those who access the old linkswith the new typo3 version, links are human readable :
change the index.php?id=XX&WWWWWWW with the corresponding page slug in the source
and have to create redirects in apache for those who access the old linksV3.2.8.1Gerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.frhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/200allow to display all entries of a datatable in an analysis2021-04-28T16:30:55+02:00Gerald Salingerald.salin@inra.frallow to display all entries of a datatable in an analysisV3.2.8.1Gerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.frhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/204smarty deprecation warnins2021-05-04T11:48:23+02:00Gerald Salingerald.salin@inra.frsmarty deprecation warninsin backend error viewer :
Core: Error handler (FE): PHP Runtime Deprecation Notice: Function create_function() is deprecated in /usr/local/bioinfo/src/ng6_sources/ng6-V3.2.8/ui/nG6/res/smarty/libs/Smarty.class.php line 742
Core: Er...in backend error viewer :
Core: Error handler (FE): PHP Runtime Deprecation Notice: Function create_function() is deprecated in /usr/local/bioinfo/src/ng6_sources/ng6-V3.2.8/ui/nG6/res/smarty/libs/Smarty.class.php line 742
Core: Error handler (FE): PHP User Notice: function call 'assign_by_ref' is unknown or deprecated, use 'assignByRef' in /usr/local/bioinfo/src/ng6_sources/ng6-V3.2.8/ui/nG6/res/smarty/libs/sysplugins/smarty_internal_data.php line 79V3.2.8.1Gerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.frhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/213upgrade to typo3 v102021-10-12T08:47:15+02:00Gerald Salingerald.salin@inra.frupgrade to typo3 v10V3.3Gerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.frhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/214add a link to the reinit password interface2021-10-12T08:47:06+02:00Gerald Salingerald.salin@inra.fradd a link to the reinit password interfaceV3.3Gerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.frhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/221[IlluminaWF] Change algo use with BWA for ContaminationSearch analysis2022-12-16T16:21:28+01:00Jules Sabban[IlluminaWF] Change algo use with BWA for ContaminationSearch analysisCurrently, the **ContaminationSearch** analysis for illumina workflows is performed with `bwa aln`.
This algorithm is not optimal for the length of reads we currently have ; so we should use `bwa mem`.
Moreover, in the future pipeli...Currently, the **ContaminationSearch** analysis for illumina workflows is performed with `bwa aln`.
This algorithm is not optimal for the length of reads we currently have ; so we should use `bwa mem`.
Moreover, in the future pipeline under Nextflow we will use ***FastqScreen*** to make this analysis. This tool already use `bwa mem`.
So to have comparable results between the two pipelines, we must change `bwa aln` to `bwa mem`.Jules SabbanJules Sabbanhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/224Project page : Remove the "Raw data and analysis results use xxx"2022-04-26T14:00:49+02:00Romain ThervilleProject page : Remove the "Raw data and analysis results use xxx"This part of the page is computed on the fly, and does not exclude hidden elements. It can be removed.This part of the page is computed on the fly, and does not exclude hidden elements. It can be removed.V3.3Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/225[Purge] Do not purge the hidden runs and analyses2022-04-26T14:00:23+02:00Romain Therville[Purge] Do not purge the hidden runs and analysesHidden runs and analyzes should be removed from the purge process.
(They will be removed semi-manualy.)Hidden runs and analyzes should be removed from the purge process.
(They will be removed semi-manualy.)V3.3Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/227[ont_qc] Change end of sequencing report file2022-05-11T10:29:03+02:00Jules Sabban[ont_qc] Change end of sequencing report fileNanopore has change the end of sequencing report file format from PDF to HTMLNanopore has change the end of sequencing report file format from PDF to HTMLV3.3Jules SabbanJules Sabbanhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/233add support to typo3 v112022-10-07T17:07:41+02:00Gerald Salingerald.salin@inra.fradd support to typo3 v11typo3 v10 is maintained until beginning of 2023.
typo3 V11 is maintained until october 2024.
https://typo3.org/cms/roadmap/maintenance-releases
update nG6 extension source code to be compatible with typo3 V11typo3 v10 is maintained until beginning of 2023.
typo3 V11 is maintained until october 2024.
https://typo3.org/cms/roadmap/maintenance-releases
update nG6 extension source code to be compatible with typo3 V11V3.4Gerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.frhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/235Hide and unhide a run2022-10-07T17:07:32+02:00Jules SabbanHide and unhide a runWhen I hide a run : every analysis bellow are hidden too
When I unhide a run : every analysis bellow are unhidden too
The behavouir we want when I unhide a run : nothing at analysis level OR unhide every analysis except 'Log files' ...When I hide a run : every analysis bellow are hidden too
When I unhide a run : every analysis bellow are unhidden too
The behavouir we want when I unhide a run : nothing at analysis level OR unhide every analysis except 'Log files' analysis.
The behavouir we want when I hide a run : nothing at analysis level OR same as now (to be discuss).
---
At analysis level, everything works well.
When I hide an analysis : the run above is no hidden : OK !
When I unhide an analysis : the run above is not unhidden : OK !V3.4Romain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/239error displaying workflow status if too much runs present2022-11-07T16:33:55+01:00Gerald Salingerald.salin@inra.frerror displaying workflow status if too much runs presenterror in web developper interface of the browser : Request-URI Too Long The requested URL's length exceeds the capacity limit for this server.error in web developper interface of the browser : Request-URI Too Long The requested URL's length exceeds the capacity limit for this server.V3.4.1Gerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.frhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/245store ngl-bi analysis code in ng6 run2024-03-11T10:40:45+01:00Gerald Salingerald.salin@inra.frstore ngl-bi analysis code in ng6 runto allow the request for raw data path and update reasets path in NGL-Bi
in run table, add a new column ngl-bi-runcode-and-lane
check how to populate it from jflowto allow the request for raw data path and update reasets path in NGL-Bi
in run table, add a new column ngl-bi-runcode-and-lane
check how to populate it from jflowV3.4.5Gerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.frhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/246allow to create symlinks on genobioinfo2023-11-14T05:38:23+01:00Gerald Salingerald.salin@inra.frallow to create symlinks on genobioinfoallow to choose the server where to create the cymbolic links (genologin pr genobioinfo)allow to choose the server where to create the cymbolic links (genologin pr genobioinfo)V3.4.3Gerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.fr