[hafiztalha]

ERROR MESSAGE: Invalid command line: Malformed walker argument: Could not find walker with name: IndelRealigner

having same error again and again. i have tried updating java , also i have latest GATK 3.7. can any one help me ?

[sayali]

Thank a lot for the document.
I have a suggestion here. You can use cutadapt software after FastQC if the quality of the sequenced reads is not good.

[j6163m]

Thank you GenoMax.

Please, could you send me the new updated manual(or advise me to download it) when it was available?

Thankś again.

Juan M.

[GenoMax]

@Juan M: bam files are binary data so you can't read/view them directly (a text file command like 'head' will not work). That is the reason you only saw garbled data on screen (and your last post was tagged as spam since you pasted that data in). So what you have does look like a binary bam file.

I was hoping that @ulz_peter would chime in by now on a possible update to the manual.

[j6163m]

A searching of BAM files in Escritorio directory gives the next output:

ubuntu@ubuntu-Compaq-CQ58-Notebook-PC:~/Escritorio/picard-tools-1.128$ ls -lh /home/ubuntu/Escritorio/*.bam
-rw-rw-r-- 1 ubuntu ubuntu 83M may 16 19:20 /home/ubuntu/Escritorio/output.bam
-rw-rw-r-- 1 ubuntu ubuntu 0 may 17 21:28 /home/ubuntu/Escritorio/OUTPUT=output.bam
-rw-rw-r-- 1 ubuntu ubuntu 0 may 16 19:19 /home/ubuntu/Escritorio/test.bam

And showing the first 10 lines of output.bam:

ubuntu@ubuntu-Compaq-CQ58-Notebook-PC:~/Escritorio$ head -10 output.bam
�BC�U�?K1��Z[�"�����jɿ��
!>R�5ld�B�4��C��ZI�a��@\?�[�A�K�#���I~/�K���sas�k�������#r!�,9�
�\h�582
9嚹�O�&�D
�
E�FF'�T*�"R211^�5eJ+7���>O�#s���/ez�#3��r"�wK��Hb$Aߍ��fs�'/D悏��-��l^��&��v׌��Qj��nT�+��aN�.�^#6�V��,cwu���,��p��8k����2b0<���ġ��Y�$`�x�Bx�����^������iK
������}��F/S��&N>�Ԥ��d���' �}���]�@�>>���^�֖�>GMw��^���Møη��(��o�d܎����޾���˿>���r�_������w�z��-��������}���h��0O�*���/C?��$N��̚<��m��e�~���qYTu]F��nӼ�|�u�U�&uZ�u��A��Q��6��6M�6Ip�M"���G�7�iZ��7o�m�6���m=i~0�ͻ��Y�F���=��<z�
�>�v���sߟ�~��I7��؏��[�����'k�p;Y��n���~�MV7Y
/�^��~�N<��&�~<>�y����������_��;���E������u��ES�a�D�5��i�I��6
�m]�a��aӆe6UV�ESn�2���-�ڪ���H\i��Qĸ�u��g�Uש�Q]���eې�m�����$W9���U�T�����\�L-'����
��uWϽ*�u_<��ʳ={w���"������!�%qA̔TOY+�Ad{���0仇��<��!OS7���.��L��@G?~���>}�lP��$Κ� J��w�2��:�%Tiă�W~�U�qR��[�>~&q�C�y�@���i�4�2�2��iu��9��<y��{�옖{0]�����t����fm��}w���gO�{��&^��.
���X<Z���Q׮��pxUgh�����$R��B?g�L�Ntuߍ|�QA�tݼ���hQ�vZ��w�u<����:z�h��QٔE�a�5������jYiA�Y��3��8�#�ȯ��� O�o��6=��(o�M@���I�Y4�ʄ �τ�@��5�@��Ɔ|��o�B��렞=��W6�rq��,*���t.�q�Kw��x>_��8\��ۙ�u��eλ���m/���D�� 'Q�Y� �MP�
��:
)M��96v�n;9z)����O��?��>~�׻�o?Y�U��q�yٶ��eU�@�Ҳ�3
)�p9�5m�WE��� B����LJծZ�m´-��qۤa\�Y���ǥ����*�u�&m��ُ*�����Jz��'W�yg���5��{�
+�O��Q�%�f��q����ݵ�����mfϬ�z��f���ϯ)��^�KM��v69{��ӿac�l���ћD
�����8�۶̂���(ڠ�m��F��M��}�Rhf����Bk�6���ƶ���`�����8m�Aؖm�Tu҆P��I��ߗ��<�HMS�Ӧ�-��}��t7���}u�����*5�J��u�r]^)����;"`������]�d�޳��n�ݨ��\l8���v!3��A9e� I\F�M���O��gyjܝ�=��Ƌ���_��I�����3�"*`
�*ZVծ�C���
��`[���i�*����ʣ*��
o+#X�&)�������874������"���\��v���w:d�B����n<j��M���'�h�ǟ#���7�"�H���iakDŽƯ��ij2Q�U
�����y��� �a�8`����X�@K����^�E�O�����w���/�&�Ҭ����Ac��`���2j�E������A�fPe�Cu�q��Y�r�Ngz.>���F
^ ��8�[���G՝Du����y߉�^t0j��PK@�n/ͦq�
�۶9�ٛ
���wg�]����ju�Q��IP��H�wK�"��4#(���@U�w�h��u�&Q��/ Z���9��#�K�6��q���ۖUQI�jY��֧�oY���8
�
W�G�l링Af���A�TAV۪�����e��[ْa����^��R�G���C�a៩�cz��:�����Ыrͮ&�{��\\�|�/�Y�1�n���܃�ɥ�h�Н�g�a8JG��k�h�,����_������s��t��R������AewrP�[<��ny~��'K^��D����IK4

Thatś right or wrong?

Waiting for your answer,please, thank you very much.

Juan M.

[j6163m]

Hi again,

This is my input and output for the step/section 2.4 of the guide (marking PCR duplicates);

ubuntu@ubuntu-Compaq-CQ58-Notebook-PC:~/Escritorio/picard-tools-1.128$ java -jar picard.jar MarkDuplicates INPUT=input.bam OUTPUT=input.marked.bam METRICS_FILE=metrics VALIDATION_STRINGENCY=LENIENT CREATE_INDEX=true
[Tue May 19 19:42:48 CEST 2015] picard.sam.markduplicates.MarkDuplicates INPUT=[input.bam] OUTPUT=input.marked.bam METRICS_FILE=metrics VALIDATION_STRINGENCY=LENIENT CREATE_INDEX=true MAX_SEQUENCES_FOR_DISK_READ_ENDS_MAP=50000 MAX_FILE_HANDLES_FOR_READ_ENDS_MAP=8000 SORTING_COLLECTION_SIZE_RATIO=0.25 PROGRAM_RECORD_ID=MarkDuplicates PROGRAM_GROUP_NAME=MarkDuplicates REMOVE_DUPLICATES=false ASSUME_SORTED=false DUPLICATE_SCORING_STRATEGY=SUM_OF_BASE_QUALITIES READ_NAME_REGEX=[a-zA-Z0-9]+:[0-9][0-9]+)[0-9]+)[0-9]+).* OPTICAL_DUPLICATE_PIXEL_DISTANCE=100 VERBOSITY=INFO QUIET=false COMPRESSION_LEVEL=5 MAX_RECORDS_IN_RAM=500000 CREATE_MD5_FILE=false
[Tue May 19 19:42:48 CEST 2015] Executing as ubuntu@ubuntu-Compaq-CQ58-Notebook-PC on Linux 3.13.0-52-generic amd64; OpenJDK 64-Bit Server VM 1.7.0_79-b14; Picard version: 1.128(c8e12338d226532b30e9ecdbf33180a073c3ffc7_1421081159) IntelDeflater
[Tue May 19 19:42:48 CEST 2015] picard.sam.markduplicates.MarkDuplicates done. Elapsed time: 0,01 minutes.
Runtime.totalMemory()=60293120
To get help, see http://broadinstitute.github.io/pica...ml#GettingHelp
Exception in thread "main" htsjdk.samtools.SAMException: Cannot read non-existent file: /home/ubuntu/Escritorio/picard-tools-1.128/input.bam
at htsjdk.samtools.util.IOUtil.assertFileIsReadable(IOUtil.java:308)
at htsjdk.samtools.util.IOUtil.assertFilesAreReadable(IOUtil.java:325)
at picard.sam.markduplicates.MarkDuplicates.doWork(MarkDuplicates.java:108)
at picard.cmdline.CommandLineProgram.instanceMain(CommandLineProgram.java:187)
at picard.cmdline.PicardCommandLine.instanceMain(PicardCommandLine.java:95)
at picard.cmdline.PicardCommandLine.main(PicardCommandLine.java:105)


And this is my searching of bam files in my system:

ubuntu@ubuntu-Compaq-CQ58-Notebook-PC:~/Escritorio/picard-tools-1.128$ ls -lh /home/ubuntu/Escritorio/picard-tools-1.128/*.bam
-rw-rw-r-- 1 ubuntu ubuntu 0 may 19 19:27 /home/ubuntu/Escritorio/picard-tools-1.128/OUTPUT=input.marked.bam

What is your opinion about the code I have used?. Thatś right or wrong?.Could you help me and to correct it,please ?.

Thank you so much.

Juan M.

[GenoMax]

Yes, I am at the begining of section 2.3(SAM to BAM conversión)

If you look at the section 2.2 there is a code like:

bwa samse -f out.sam -r
"@RQ\tID:<ID>\tLB:<LIBRARY_NAME>\tSM:<SAMPLE_NAME>\tPL:ILLUMIN A" hg19 input1.sai
input2.sai input1.fq input2.fq

This is the code I used (pair end data).If you see apear out.sam.Is this out.sam I have?

Then, Can I go on with step/section 2.4 and the same and exactly code included in the following steps/sections until the end (without change anything)?.If was necessary to change some of the codes of the differents steps,please, send me it.


Waiting for the answers to these questions,please, thank you so much for your help.

Juan M.

@ulz_peter: The manual looks a bit confusing. File from step 2.3 is called out.sam but then in 2.4 it is being referred to as input.sam? Since the syntax for Picard has changed perhaps you should consider updating your manual.

@Juan M: That looks to be the right file (but make a note that the name is not the same as in manual). Since you are using a newer version of picard you should use the command @ulz_peter provided in post #126.

[j6163m]

Yes, I am at the begining of section 2.3(SAM to BAM conversión)

If you look at the section 2.2 there is a code like:

bwa samse -f out.sam -r
"@RQ\tID:<ID>\tLB:<LIBRARY_NAME>\tSM:<SAMPLE_NAME>\tPL:ILLUMIN A" hg19 input1.sai
input2.sai input1.fq input2.fq

This is the code I used (pair end data).If you see apear out.sam.Is this out.sam I have?

Then, Can I go on with step/section 2.4 and the same and exactly code included in the following steps/sections until the end (without change anything)?.If was necessary to change some of the codes of the differents steps,please, send me it.


Waiting for the answers to these questions,please, thank you so much for your help.

Juan M.

[GenoMax]

That sam file looks ok. Are you at the start of section 2.3? In any case don't blindly follow steps in the document if you don't understand what is happening at that step.

[j6163m]

Hi again,

This is the output:

ubuntu@ubuntu-Compaq-CQ58-Notebook-PC:~$ cd /home/ubuntu/Escritorio
ubuntu@ubuntu-Compaq-CQ58-Notebook-PC:~/Escritorio$ head -10 out.sam
@SQ SN:chr10 LN:135534747
@SQ SN:chr11 LN:135006516
@SQ SN:chr12 LN:133851895
@SQ SN:chr13 LN:115169878
@SQ SN:chr14 LN:107349540
@SQ SN:chr15 LN:102531392
@SQ SN:chr16 LN:90354753
@SQ SN:chr17 LN:81195210
@SQ SN:chr18 LN:78077248
@SQ SN:chr19 LN:59128983

Yes, the pdf guide is at the beginning of this thread.

What is the next step I have to do?

Thank you

Juan M.

[GenoMax]

Hi GenoMax.Thank you for your answer.

You are right. This is the output:

ubuntu@ubuntu-Compaq-CQ58-Notebook-PC:~$ ls -lh /home/ubuntu/Escritorio/picard-tools-1.128/*.sam
ls: no se puede acceder a /home/ubuntu/Escritorio/picard-tools-1.128/*.sam: No existe el archivo o el directorio

The output says : It doesn t exist the file or directory.

So that mystery is solved. We know that file is not there so you are getting the error.

However, when I look for into the Escritorio directory (Desktop), the output is:

ubuntu@ubuntu-Compaq-CQ58-Notebook-PC:~$ ls -lh /home/ubuntu/Escritorio/*.sam
-rw-rw-r-- 1 ubuntu ubuntu 0 may 17 21:28 /home/ubuntu/Escritorio/INPUT=input.sam
-rw-rw-r-- 1 ubuntu ubuntu 253M may 11 23:07 /home/ubuntu/Escritorio/out.sam

Can you show the first 10 lines of out.sam by doing this?

$ head -10 out.sam

I am not sure why the above ls command is showing full paths in your file listing (perhaps your system is setup that way). Which PDF guide are you following? Is it at the beginning of this thread?

[j6163m]

Hi GenoMax.Thank you for your answer.

You are right. This is the output:

ubuntu@ubuntu-Compaq-CQ58-Notebook-PC:~$ ls -lh /home/ubuntu/Escritorio/picard-tools-1.128/*.sam
ls: no se puede acceder a /home/ubuntu/Escritorio/picard-tools-1.128/*.sam: No existe el archivo o el directorio

The output says : It doesn t exist the file or directory.

However, when I look for into the Escritorio directory (Desktop), the output is:

ubuntu@ubuntu-Compaq-CQ58-Notebook-PC:~$ ls -lh /home/ubuntu/Escritorio/*.sam
-rw-rw-r-- 1 ubuntu ubuntu 0 may 17 21:28 /home/ubuntu/Escritorio/INPUT=input.sam
-rw-rw-r-- 1 ubuntu ubuntu 253M may 11 23:07 /home/ubuntu/Escritorio/out.sam

Then, what can I do with the step SAM to BAM conversion? Or must I start again all the steps from the beginning with the BWA alignment?

Until now I applied step by step the exome analysis short guide(pdf),Do you know any easy method or pipeline to exome analysis?

Waiting for your answer,please, thank you so much.

Juan M.

[GenoMax]

@Juan M.: Error indicates that file does not exist.

Can you see it with a directory listing? Post the output of

$ ls -lh /home/ubuntu/Escritorio/picard-tools-1.128/*.sam

Note: Just because you went through the steps does not mean that the process worked right. Did you see any other errors upstream of this step?

[j6163m]

Thank you ulz_peter for your answer.I send/copy you my input (with your instructions) and the respective output:

ubuntu@ubuntu-Compaq-CQ58-Notebook-PC:~/Escritorio/picard-tools-1.128$ java -jar picard.jar SortSam SO=coordinate INPUT=input.sam OUTPUT=output.bam VALIDATION_STRINGENCY=LENIENT CREATE_INDEX=true
[Mon May 18 19:25:34 CEST 2015] picard.sam.SortSam INPUT=input.sam OUTPUT=output.bam SORT_ORDER=coordinate VALIDATION_STRINGENCY=LENIENT CREATE_INDEX=true VERBOSITY=INFO QUIET=false COMPRESSION_LEVEL=5 MAX_RECORDS_IN_RAM=500000 CREATE_MD5_FILE=false
[Mon May 18 19:25:34 CEST 2015] Executing as ubuntu@ubuntu-Compaq-CQ58-Notebook-PC on Linux 3.13.0-52-generic amd64; OpenJDK 64-Bit Server VM 1.7.0_79-b14; Picard version: 1.128(c8e12338d226532b30e9ecdbf33180a073c3ffc7_1421081159) IntelDeflater
[Mon May 18 19:25:34 CEST 2015] picard.sam.SortSam done. Elapsed time: 0,01 minutes.
Runtime.totalMemory()=60293120
To get help, see http://broadinstitute.github.io/pica...ml#GettingHelp
Exception in thread "main" htsjdk.samtools.SAMException: Cannot read non-existent file: /home/ubuntu/Escritorio/picard-tools-1.128/input.sam
at htsjdk.samtools.util.IOUtil.assertFileIsReadable(IOUtil.java:308)
at picard.sam.SortSam.doWork(SortSam.java:71)
at picard.cmdline.CommandLineProgram.instanceMain(CommandLineProgram.java:187)
at picard.cmdline.PicardCommandLine.instanceMain(PicardCommandLine.java:95)
at picard.cmdline.PicardCommandLine.main(PicardCommandLine.java:105)
ubuntu@ubuntu-Compaq-CQ58-Notebook-PC:~/Escritorio/picard-tools-1.128$

What is your opinion about this output?
I don t understand :...........Cannot read non-existent file:/home/ubuntu/Escritorio/picard-tools-1.128/input.sam. I say it because I did well the early steps belong to A short guide to Exome seq. analysis using Illumina technology (your analysis pdf guide),until this step(SAM to BAM conversion),with 2 fastq files (paired end) mine. I think the conversion to SAM files was without problems.Then, why cannot read non existent file:/home/ubuntu/Escritorio/picard-tools-1.128/input.sam ? What is this input.sam?

Do you think I can go on with the next steps(Marking PCR duplicates and the rest of steps) of this pipeline/analysis short guide and with the exactly same code (for the following steps) than the included in this same analysis short guide?.If now the code is different for all steps remaining,please, could you send me this one corrected for all steps?

Waiting for your answer,please, thank you so much for your help.(Sorry but I haven t experience with this pipeline).

Juan M.

[ulz_peter]

Hi JM,

Newer versions of Picard do not come with a bunch of jar files per command, but with a unified jar file where the command you want to execute can be specified (the version I use currently is picard 1.128.

So the command would now look something like:

java -jar picard.jar SortSam SO=coordinate INPUT=input.sam OUTPUT=output.bam VALIDATION_STRINGENCY=LENIENT CREATE_INDEX=true

Besides of that, it is hard to tell where the actual problem lies. You could try to post the actual code you are trying to run.