Metagenomics Machine Learning
Introduction
This is the reference material for the "Machine Learning in Metagenomics" workshop. By the end of workshop, you will be able to classify metagenomic samples using Kraken2 and predict the source organism of the sample with simple ML methods.
Click here for "Metagenomics - Deep Learning" workshop
Environment Setup
We will be using Python, Jupyter notebook and command line tools for this workshop.
If you are using Windows, you can install WSL2 and use Ubuntu. If you are using Mac, you can use the terminal.
Running Kraken2
In the first step, let's generate abundance report using Kraken2. Kraken2 is a taxonomic sequence classifier that assigns taxonomic labels to short DNA sequences.
Install anaconda
$ wget https://repo.anaconda.com/archive/Anaconda3-2024.06-1-Linux-x86_64.sh $ bash Anaconda3-2021.05-Linux-x86_64.sh
Install kraken2
$ conda install -c bioconda kraken2
Download pre-built viral database
$ wget -c https://genome-idx.s3.amazonaws.com/kraken/k2_viral_20240605.tar.gz $ mkdir -p k2_viral $ tar -xzvf k2_viral_20240605.tar.gz -C k2_viral
Download sample fastq files
$ wget -c https://ftp.sra.ebi.ac.uk/vol1/fastq/ERR103/077/ERR10359977/ERR10359977.fastq.gz
Kraken2 classification
$ kraken2 --db k2_viral ERR10359977.fastq.gz --report k2_report.txt --output k2_output.txt
Generate Krona plot
Install Krona & update taxonomy
$ conda install -c bioconda krona $ ktUpdateTaxonomy.sh
Generate Krona plot
$ ktImportTaxonomy k2_report.txt -o k2_report.html
Building custom database
Download taxanomy
$ kraken2-build --download-taxonomy --db k2_fungi
Download required genomes
$ ncbi-genome-download --format fasta --section refseq --assembly-level complete fungi -v
Build kraken2 database
$ find refseq -name "*.gz" -print0 | parallel -0 gunzip $ find refseq -name "*.fna" -exec kraken2-build --add-to-library {} --db custom_db \; $ kraken2-build --db custom_db --build --threads 36
Using kraken-db-builder
to build database
$ pip install ncbi-genome-download kraken-db-builder $ kraken-db-builder --db-type fungi
Predicting Source of Metagenomic Sample
Geometry Mean of Pairwise Ratios (GMPR)
Bray-Curtis dissimilarity
t-Stochastic Neighbor Embedding (t-SNE)
k-Nearest Neighbors (k-NN)
Download sample data
$ wget https://raw.githubusercontent.com/maxibor/sourcepredict/master/data/test/dog_test_sink_sample.csv -O dog_example.csv $ wget https://raw.githubusercontent.com/maxibor/sourcepredict/master/data/modern_gut_microbiomes_labels.csv -O sp_labels.csv $ wget https://raw.githubusercontent.com/maxibor/sourcepredict/master/data/modern_gut_microbiomes_sources.csv -O sp_sources.csv
Download sourcepredict
$ python -m pip install git+https://github.com/AvilPage/sourcepredict
Machine Learning Notebooks
https://github.com/ChillarAnand/avilpage.com/tree/master/mg_workshop
Useful links:
https://benlangmead.github.io/aws-indexes/k2
https://jszym.com/blog/dna_protein_complexity/
https://avilpage.com/2024/07/mastering-kraken2-initial-runs.html