ng6 issueshttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues2022-11-30T15:59:30+01:00https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/211Jflow issues2022-11-30T15:59:30+01:00Romain ThervilleJflow issuesLately, we have encountered a lot a failed processes on nG6, and they all seem to revolve around jflow.
I'll put in the issue every jflow error found on ng6.Lately, we have encountered a lot a failed processes on nG6, and they all seem to revolve around jflow.
I'll put in the issue every jflow error found on ng6.V4 - MaintenanceRomain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/210switch_space_id workflow fail2021-06-04T10:39:18+02:00Romain Thervilleswitch_space_id workflow failThe switch_space_id workflow fails on nG6 and via bash commands.
**on NG6:**
Error "bad username/password" when entering the correct ng6 credentials.
**using bash commands:**
`python3.4 /usr/local/bioinfo/src/ng6_sources/nG6/bin/ng6_...The switch_space_id workflow fails on nG6 and via bash commands.
**on NG6:**
Error "bad username/password" when entering the correct ng6 credentials.
**using bash commands:**
`python3.4 /usr/local/bioinfo/src/ng6_sources/nG6/bin/ng6_cli.py switch_space_id --project_id "xxx" --space_id "longterm_bioinfo"`
python3.4 not found
`python2.7 /usr/local/bioinfo/src/ng6_sources/nG6/bin/ng6_cli.py switch_space_id --project_id "1713" --space_id "longterm_bioinfo"`
Traceback (most recent call last):
File "/usr/local/bioinfo/src/ng6_sources/nG6/bin/ng6_cli.py", line 27, in <module>
from jflow.workflows_manager import WorkflowsManager
File "/usr/local/bioinfo/src/ng6_sources/nG6/src/jflow/__init__.py", line 23, in <module>
from jflow.config_reader import JFlowConfigReader
File "/usr/local/bioinfo/src/ng6_sources/nG6/src/jflow/config_reader.py", line 24, in <module>
from configparser import RawConfigParser, NoOptionError
ImportError: No module named configparser
The module configparser seems to be missing from the python libs.V4 - Maintenancehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/208RunStats image paths are wrong for A2P1b-PlaGe-Caille2021-05-20T13:54:56+02:00Romain ThervilleRunStats image paths are wrong for A2P1b-PlaGe-CailleEven after the migration, the filepaths are still '/data_shortterm/' instead of '/data_seqoccin/'.
**TODO:**
```
UPDATE tx_nG6_result
SET rvalue = REPLACE(rvalue, '/data_shortterm/', '/data_seqoccin/')
WHERE analyze_id IN (
SELECT an...Even after the migration, the filepaths are still '/data_shortterm/' instead of '/data_seqoccin/'.
**TODO:**
```
UPDATE tx_nG6_result
SET rvalue = REPLACE(rvalue, '/data_shortterm/', '/data_seqoccin/')
WHERE analyze_id IN (
SELECT analyze_id FROM tx_nG6_run_analyze WHERE run_id IN (
SELECT run_id FROM tx_nG6_project_run WHERE project_id = xxx
)
);
UPDATE tx_nG6_result
SET rvalue = REPLACE(rvalue, '/data_shortterm/', '/data_seqoccin/')
WHERE analyze_id IN (
SELECT analyze_id FROM tx_nG6_project_analyze WHERE project_id = xxx
);
```V4 - MaintenanceRomain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/207Usergroup with deleted = 1 / Error for "tsime-ngando" 's password sync2021-05-27T14:45:34+02:00Romain ThervilleUsergroup with deleted = 1 / Error for "tsime-ngando" 's password syncThe user "tsime-ngando" has its correct password "xxx" on esitoul.
Its password on nG6 is "yyy" instead.
If we set the right password via the nG6 interface or the database, it is automatically set back to the wrong one "yyy".
So, why do...The user "tsime-ngando" has its correct password "xxx" on esitoul.
Its password on nG6 is "yyy" instead.
If we set the right password via the nG6 interface or the database, it is automatically set back to the wrong one "yyy".
So, why does the synch sets a password different than the one from esitoul?
(See also : https://forgemia.inra.fr/get-plage/e-sitoul_adminscripts/-/blob/master/synchronizeUsers.pl)V4 - MaintenanceRomain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/206Login / logout issues2021-05-27T14:45:45+02:00Romain ThervilleLogin / logout issuesAfter a first login, login out or getting disconnected results in a "bad password" error blocking any other connection, with any user.
Clearing the cache, history or cookies doesn't resolve the problem.
It is specific to the browser, ope...After a first login, login out or getting disconnected results in a "bad password" error blocking any other connection, with any user.
Clearing the cache, history or cookies doesn't resolve the problem.
It is specific to the browser, openning a new one allows to connect one user, once.
(Maybe restarting the entire computer works, I haven't tried yet.)V4 - Maintenancehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/194The Downloadsymlink workflow stays stuck when ng6 ssh user has a rsa passphrase2021-05-04T11:49:20+02:00Romain ThervilleThe Downloadsymlink workflow stays stuck when ng6 ssh user has a rsa passphrase**Symptoms:**
- Creating symbolic links through the web interface results in an infinite loading.
- The associated workflow doesn't end.
- The workflow debug returns the following :
Traceback (most recent call last):
File "/work/ng6/j...**Symptoms:**
- Creating symbolic links through the web interface results in an infinite loading.
- The associated workflow doesn't end.
- The workflow debug returns the following :
Traceback (most recent call last):
File "/work/ng6/jflow/work/downloadsymlink/wf008708/.working/f85edccc0a/_Stash/0/0/0/w0000000", line 86, in <module>
outputs = create_symbolik_link(*new_args)
File "/work/ng6/jflow/work/downloadsymlink/wf008708/.working/f85edccc0a/_Stash/0/0/0/w0000000", line 79, in create_symbolik_link
s.cmd('bash %s'%user_script)
File "/usr/local/bioinfo/src/ng6_sources/ng6-V3.2.7.4/src/weaver/../ng6/utils.py", line 568, in cmd
return self.ssh_results(pid, f)
File "/usr/local/bioinfo/src/ng6_sources/ng6-V3.2.7.4/src/weaver/../ng6/utils.py", line 561, in ssh_results
got = self._read(f)
File "/usr/local/bioinfo/src/ng6_sources/ng6-V3.2.7.4/src/weaver/../ng6/utils.py", line 538, in _read
x = os.read(f, 1024)
**Cause of the problem:**
When lauching an SSH connection with the ng6 user (Python : s = SSH(username, password, server_params[0]) ), a passphrase defined in /home/ng6/.ssh/id_rsa is asked.V4 - MaintenanceRomain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/188[IlluminaWF]Hiding some analyses per defaut2020-07-15T10:02:05+02:00Audrey Gibert[IlluminaWF]Hiding some analyses per defautBy default, there is only the "log files" analysis that is hidden :
![image](/uploads/6603fbe0bddccccce2c13a16675d8079/image.png)
We should also hide
* Subset read files
* alignment
* alignmentStats
* InsertSizes
*...By default, there is only the "log files" analysis that is hidden :
![image](/uploads/6603fbe0bddccccce2c13a16675d8079/image.png)
We should also hide
* Subset read files
* alignment
* alignmentStats
* InsertSizes
* DemultiplexStatsV4 - MaintenanceAudrey GibertAudrey Gibert2021-07-01https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/183WF AddAnalysis : rsync errors in error output2020-10-02T19:33:12+02:00Audrey GibertWF AddAnalysis : rsync errors in error outputWhen there is a lot of files to be sent to NG6 with the Addanalysis workflow, the rsync command seems to have some trouble.
I had 6 file groups to send, only 1/6 worked without error message.
The error message looks like this :
```bash...When there is a lot of files to be sent to NG6 with the Addanalysis workflow, the rsync command seems to have some trouble.
I had 6 file groups to send, only 1/6 worked without error message.
The error message looks like this :
```bash
rsync: sender failed to remove PL1_Pool2_11_BD20_2017.2.fq.gz: No such file or directory (2)
rsync: sender failed to remove PL1_Pool2_11_BD20_2017.rem.1.fq.gz: No such file or directory (2)
rsync: sender failed to remove PL1_Pool2_11_BD20_2017.rem.2.fq.gz: No such file or directory (2)
rsync: sender failed to remove PL1_Pool2_12_BK28_2018.1.fq.gz: No such file or directory (2)
rsync: sender failed to remove PL1_Pool2_12_BK28_2018.2.fq.gz: No such file or directory (2)
rsync: sender failed to remove PL1_Pool2_12_BK28_2018.rem.1.fq.gz: No such file or directory (2)
rsync: sender failed to remove PL1_Pool2_12_BK28_2018.rem.2.fq.gz: No such file or directory (2)
rsync: sender failed to remove PL1_Pool2_14_A69_2013.1.fq.gz: No such file or directory (2)
rsync: sender failed to remove PL1_Pool2_14_A69_2013.2.fq.gz: No such file or directory (2)
rsync: sender failed to remove PL1_Pool2_14_A69_2013.rem.1.fq.gz: No such file or directory (2)
...
rsync: send_files failed to open "/work/ng6/jflow/work/data/analyze/efa9850d7/PL1_Pool2_9_BE53_2017.1.fq.gz": Not a directory (20)
rsync: sender failed to remove PL1_Pool2_6_BD73_2017.rem.2.fq.gz: Not a directory (20)
rsync: send_files failed to open "/work/ng6/jflow/work/data/analyze/efa9850d7/PL1_Pool2_9_BE53_2017.2.fq.gz": Not a directory (20)
rsync: sender failed to remove PL1_Pool2_7_BK70_2_2018.1.fq.gz: Not a directory (20)
rsync: send_files failed to open "/work/ng6/jflow/work/data/analyze/efa9850d7/PL1_Pool2_9_BE53_2017.rem.1.fq.gz": Not a directory (20)
rsync: sender failed to remove PL1_Pool2_7_BK70_2_2018.2.fq.gz: Not a directory (20)
rsync: send_files failed to open "/work/ng6/jflow/work/data/analyze/efa9850d7/PL1_Pool2_9_BE53_2017.rem.2.fq.gz": Not a directory (20)
rsync: sender failed to remove PL1_Pool2_7_BK70_2_2018.rem.1.fq.gz: Not a directory (20)
rsync: sender failed to remove PL1_Pool2_7_BK70_2_2018.rem.2.fq.gz: Not a directory (20)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1052) [sender=3.0.9]
```
Md5sum is the same between the files to send, and the files in NG6, so no rush in here. But maybe this feature can be improved..V4 - Maintenancehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/181make filenames in NG6 uniq2020-05-15T07:36:11+02:00Gerald Salingerald.salin@inra.frmake filenames in NG6 uniqin NG6 FAQ, for downloading :
On a Windows workstation (Command lines), copy/paste this list in a file "listOfFiles" (B**e aware that if the same filename is found in different url, the local file will be overriden**). Then you can down...in NG6 FAQ, for downloading :
On a Windows workstation (Command lines), copy/paste this list in a file "listOfFiles" (B**e aware that if the same filename is found in different url, the local file will be overriden**). Then you can download curl for Windows (https://curl.haxx.se/download.html), extract the archive, and run this following command in a windows prompt
should not happen.
prefix the filename so that it is uniq (add the name of the parent folder which is uniq? the run Id + analysis Id?)V4 - Maintenancehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/180Analysis sort by data in project view2020-05-05T14:40:13+02:00Celine NoirotAnalysis sort by data in project viewUnable to sort project analysis by date
![image](/uploads/f37bbc5558f1d7655864dd3a3ef086cb/image.png)Unable to sort project analysis by date
![image](/uploads/f37bbc5558f1d7655864dd3a3ef086cb/image.png)V4 - Maintenancehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/152Tests a faire lors d'une mise en prod2020-07-09T14:07:54+02:00Celine NoirotTests a faire lors d'une mise en prodJ'aimerai que l'on liste l'ensemble des element a verifier lors d'une mise en prod pour eviter au mieux les bugs
tester :
* [ ] le download
* [ ] create symblink
* [ ] add project
* [ ] add run
* [ ] add analysis
* [ ] add raw files
* [...J'aimerai que l'on liste l'ensemble des element a verifier lors d'une mise en prod pour eviter au mieux les bugs
tester :
* [ ] le download
* [ ] create symblink
* [ ] add project
* [ ] add run
* [ ] add analysis
* [ ] add raw files
* [ ] vue projet
* [ ] vue run/downloads
* [ ] vue analyses/downloads
* [ ] verifier le application.properties est a jours en fonction des nouveaux dev
* [ ] verifier que le template dans typo3 est a jours en fonction des nouveaux devV4 - Maintenancehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/144Javascript visual bug on a project's runs list2020-06-11T17:06:27+02:00Romain ThervilleJavascript visual bug on a project's runs listThe mouseover on a cell in the 'Sequencer' column sometimes adds a "end of line" character (on the "-" character).
(This seems to happen on every cell, but is only really visible when the cell contains a long string).
The "visual artef...The mouseover on a cell in the 'Sequencer' column sometimes adds a "end of line" character (on the "-" character).
(This seems to happen on every cell, but is only really visible when the cell contains a long string).
The "visual artefact" can be seen on this project (just mouseover the cells in the Sequencer column) :
https://ng6.toulouse.inra.fr/index.php?id=55&tx_nG6_pi1%5Bproject_id%5D=289
It appears on: Google Chrome
It doesn't appear on: Mozilla Firefox, Internet ExplorerV4 - MaintenanceRomain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/138Display error in a project view : Table can not be sorted by date if the user...2020-04-03T15:58:05+02:00Audrey GibertDisplay error in a project view : Table can not be sorted by date if the user is not administratorMargot Zahm came to us because she can not sorter her project table by date :
![image](/uploads/80b4a32a42ffec62512a7fe598d11911/image.png)
![image](/uploads/f3bccdad743010390191f94004919555/image.png)
Order of dates is random
We could ...Margot Zahm came to us because she can not sorter her project table by date :
![image](/uploads/80b4a32a42ffec62512a7fe598d11911/image.png)
![image](/uploads/f3bccdad743010390191f94004919555/image.png)
Order of dates is random
We could not reproduce her bug because we were logged as CTD and it works perfectly for us...
One lead has been reported with the inspector column of web explorer :
what is sent in member view
![image](/uploads/2d8f69ffb2bbd8d28acc37314637bdeb/image.png)
what is sent in admin view
![image](/uploads/7114492349815c674d45ff5ba62c93f4/image.png)V4 - MaintenanceAudrey GibertAudrey Giberthttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/136Fail to update a user's role on a project2020-06-11T17:08:53+02:00Romain ThervilleFail to update a user's role on a projectOn nG6 (prod), the user 513 was both member and admin on a project.
We should check if another user is concerned, and find why there were 2 rows in 'fe_rights' linking the user to the project.
Kanboard link : https://genomique.genotoul...On nG6 (prod), the user 513 was both member and admin on a project.
We should check if another user is concerned, and find why there were 2 rows in 'fe_rights' linking the user to the project.
Kanboard link : https://genomique.genotoul.fr/kanboard/?controller=TaskViewController&action=show&project_id=18&task_id=1132V4 - MaintenanceRomain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/125Differences between projet's hidden parameter and its run's hidden parameter2020-06-11T17:09:11+02:00Romain ThervilleDifferences between projet's hidden parameter and its run's hidden parameterSometimes (see exemple), hidden projects have visible analyses. Sometimes they do not.
http://ng6-test.toulouse.inra.fr
Project **FlaxCoreCol**
![2019-09-05_172449](/uploads/82d77c3e33ce35a60eb412286fa9d529/2019-09-05_172449.png)
Proj...Sometimes (see exemple), hidden projects have visible analyses. Sometimes they do not.
http://ng6-test.toulouse.inra.fr
Project **FlaxCoreCol**
![2019-09-05_172449](/uploads/82d77c3e33ce35a60eb412286fa9d529/2019-09-05_172449.png)
Project **FlaxCoreCol** Run **FlaxCoreCol-3** (recent)
![2019-09-05_172520](/uploads/bfbc0dea5ea36649347228321404ebd5/2019-09-05_172520.png)
Project **FlaxCoreCol** Run **FlaxCoreCol-4** (older)
![2019-09-05_172649](/uploads/05b5faaf00dc4f2f9d7ef39d0d8caca9/2019-09-05_172649.png)
(At least the icons are missing, but a check in the database is necessary.)V4 - MaintenanceRomain ThervilleRomain Thervillehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/112[ont-qc] Adding new analysis : Demultiplex Stat for ONT2021-03-25T13:39:09+01:00Maxime Manno[ont-qc] Adding new analysis : Demultiplex Stat for ONT#### We need to change the current demultiplex stat analysis management : :metal:
**What will change ?** replacement of porechop by Qcat, creation of a new analysis
* [x] Create new component
* [x] Create new template
* [x] Add seqki...#### We need to change the current demultiplex stat analysis management : :metal:
**What will change ?** replacement of porechop by Qcat, creation of a new analysis
* [x] Create new component
* [x] Create new template
* [x] Add seqkit stats logs for all the samples (included the unmappaed files)
* [x] Add fastq files only for the barcodes added into the pool
* [x] Add Qcat and Seqkit path and oprions into the application.propertiesV4 - MaintenanceMaxime MannoMaxime Manno2019-08-31https://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/109ftp server architecture2019-08-30T09:27:13+02:00Celine Noirotftp server architectureKeep/generate run/analysis architecture for a project when ftp server will be available.Keep/generate run/analysis architecture for a project when ftp server will be available.V4 - MaintenanceGerald Salingerald.salin@inra.frGerald Salingerald.salin@inra.frhttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/108export metadata2019-08-30T09:27:13+02:00Celine Noirotexport metadataadd a functionality to export all metadata of project, run, analysis.add a functionality to export all metadata of project, run, analysis.V4 - Maintenancehttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/105sort order not numeric in contaminationsearch table2019-10-28T15:44:50+01:00Gerald Salingerald.salin@inra.frsort order not numeric in contaminationsearch table![image](/uploads/c5da447e601b3750890b5432d22e18a3/image.png)![image](/uploads/c5da447e601b3750890b5432d22e18a3/image.png)V4 - MaintenanceAudrey GibertAudrey Giberthttps://forgemia.inra.fr/genotoul-bioinfo/ng6/-/issues/91[methylseq] do not store files for analyses Alignment and Metylation extractor2018-11-06T17:50:17+01:00Gerald Salingerald.salin@inra.fr[methylseq] do not store files for analyses Alignment and Metylation extractorthese data are too huge and for no use after the quality pipeline is overthese data are too huge and for no use after the quality pipeline is overV4 - Maintenance