Extract multiple fasta sequences from a fasta file based on sequenes

[entomology]

Actually, I do more wet lab most of the time. Sometimes, I'll also do simple small rna analysis with ready-to-use perl script and simple shell script. It's enough most of the time with my work, but sometime it's not easy for me.

What scripting/programming language(s) are you learning?

[maubp]

What scripting/programming language(s) are you learning?

[entomology]

Seems these script also deal with a list of ids, then using these ids to fetch sequences in a fasta file. I wanna use sequences directly and get a subset of fasta from a big fasta file base on provided sequences. Thank you for your information as well.

Here are my Python scripts to do this, with Galaxy wrappers:

This filters the FASTA file (loads all the IDs, then goes through the FASTA file once):

https://github.com/peterjc/pico_galaxy/tree/master/tools/seq_filter_by_id

This indexes the FASTA file, then goes through the IDs one by one:

https://github.com/peterjc/pico_galaxy/tree/master/tools/seq_select_by_id

The difference is which order do you want? The order in the FASTA file (faster), or the order in the ID file (slower).

[maubp]

Here are my Python scripts to do this, with Galaxy wrappers:

This filters the FASTA file (loads all the IDs, then goes through the FASTA file once):

https://github.com/peterjc/pico_galaxy/tree/master/tools/seq_filter_by_id

This indexes the FASTA file, then goes through the IDs one by one:

https://github.com/peterjc/pico_galaxy/tree/master/tools/seq_select_by_id

The difference is which order do you want? The order in the FASTA file (faster), or the order in the ID file (slower).

[entomology]

Actually, I do prefer command based under shell environment. grep seems a great way to do it, thanks for tips.

There's almost certainly lots of ways to do this depending on what tools you're comfortable with.

In R/Bioconductor, you could read in the fasta using the bioconductor ShortRead package, and then use vcountPattern to identify the hits to your query sequences and write those as a new fasta file.

It's been a long time since I used it, but BioPython also has some nice iterators for going through fasta files, and would be better suited for a bigger fasta file. You would essentially write a little loop that iterates through the fasta and queries each record for your desired sequence. If it finds the sequence, write the record to a new file, otherwise move on to the next record.

I'm sure some folks might have some grep based methods for the commandline as well

[entomology]

3xs for the info.

You can extract sequences that share kmers with your sequences with BBDuk:

bbduk.sh in=a.fa ref=b.fa out=c.fa mkf=1 mm=f k=31

This will print to C all the sequences in A that share 100% of their 31-mers with sequences in B.

You can also do something more precise with Dedupe, as it allows arbitrary set operations; so, let me know if the above method is insufficient.

[cmbetts]

There's almost certainly lots of ways to do this depending on what tools you're comfortable with.

In R/Bioconductor, you could read in the fasta using the bioconductor ShortRead package, and then use vcountPattern to identify the hits to your query sequences and write those as a new fasta file.

It's been a long time since I used it, but BioPython also has some nice iterators for going through fasta files, and would be better suited for a bigger fasta file. You would essentially write a little loop that iterates through the fasta and queries each record for your desired sequence. If it finds the sequence, write the record to a new file, otherwise move on to the next record.

I'm sure some folks might have some grep based methods for the commandline as well

[Brian Bushnell]

You can extract sequences that share kmers with your sequences with BBDuk:

bbduk.sh in=a.fa ref=b.fa out=c.fa mkf=1 mm=f k=31

This will print to C all the sequences in A that share 100% of their 31-mers with sequences in B.

You can also do something more precise with Dedupe, as it allows arbitrary set operations; so, let me know if the above method is insufficient.

[entomology]

I've searched in the forum and google as well, but most of cases are extract sequences from fasta file based on id list. but now I only have several sequences without ids and i want to extract from a fasta file based on these sequences, does anyone have clues for it? Actually, that means I need the sequences identifier (or id) from the fasta file.

Thank you very much for your help.