<?xml-model href='http://www.tei-c.org/release/xml/tei/custom/schema/relaxng/tei_all.rng' schematypens='http://relaxng.org/ns/structure/1.0'?><TEI xmlns="http://www.tei-c.org/ns/1.0">
	<teiHeader>
		<fileDesc>
			<titleStmt><title level='a'>The Mutationathon highlights the importance of reaching standardization in estimates of pedigree-based germline mutation rates</title></titleStmt>
			<publicationStmt>
				<publisher></publisher>
				<date>01/12/2022</date>
			</publicationStmt>
			<sourceDesc>
				<bibl> 
					<idno type="par_id">10390243</idno>
					<idno type="doi">10.7554/eLife.73577</idno>
					<title level='j'>eLife</title>
<idno>2050-084X</idno>
<biblScope unit="volume">11</biblScope>
<biblScope unit="issue"></biblScope>					

					<author>Lucie A Bergeron</author><author>Søren Besenbacher</author><author>Tychele Turner</author><author>Cyril J Versoza</author><author>Richard J Wang</author><author>Alivia Lee Price</author><author>Ellie Armstrong</author><author>Meritxell Riera</author><author>Jedidiah Carlson</author><author>Hwei-yen Chen</author><author>Matthew W Hahn</author><author>Kelley Harris</author><author>April Snøfrid Kleppe</author><author>Elora H López-Nandam</author><author>Priya Moorjani</author><author>Susanne P Pfeifer</author><author>George P Tiley</author><author>Anne D Yoder</author><author>Guojie Zhang</author><author>Mikkel H Schierup</author>
				</bibl>
			</sourceDesc>
		</fileDesc>
		<profileDesc>
			<abstract><ab><![CDATA[In the past decade, several studies have estimated the human per-generation germline mutation rate using large pedigrees. More recently, estimates for various nonhuman species have been published. However, methodological differences among studies in detecting germline mutations and estimating mutation rates make direct comparisons difficult. Here, we describe the many different steps involved in estimating pedigree-based mutation rates, including sampling, sequencing, mapping, variant calling, filtering, and appropriately accounting for false-positive and false-negative rates. For each step, we review the different methods and parameter choices that have been used in the recent literature. Additionally, we present the results from a ‘Mutationathon,’ a competition organized among five research labs to compare germline mutation rate estimates for a single pedigree of rhesus macaques. We report almost a twofold variation in the final estimated rate among groups using different post-alignment processing, calling, and filtering criteria, and provide details into the sources of variation across studies. Though the difference among estimates is not statistically significant, this discrepancy emphasizes the need for standardized methods in mutation rate estimations and the difficulty in comparing rates from different studies. Finally, this work aims to provide guidelines for computational and statistical benchmarks for future studies interested in identifying germline mutations from pedigrees.]]></ab></abstract>
		</profileDesc>
	</teiHeader>
	<text><body xmlns="http://www.tei-c.org/ns/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink">
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Introduction</head><p>Germline mutations are the source of most genetic diseases and provide the raw material for evolution. Thus, it is crucial to accurately estimate the frequency at which mutations occur in order to better understand the course of evolutionary events. The development of high-throughput next-generation sequencing offers the opportunity to directly estimate the germline mutation rate over a single generation, based on a whole-genome comparison of pedigree samples (mother, father, and offspring), without requiring assumptions about generation times or fossil calibrations <ref type="bibr">(Tiley et al., 2020)</ref>. Pedigree sequencing provides multiple pieces of information in addition to an overall mutation rate. For instance, the genomic locations, the spectrum of mutation types (e.g., transition or transversion), and the nucleotide context of all mutations can easily be gleaned. Furthermore, pedigree sequencing enables researchers to identify the parental origin of the mutations; that is, whether the mutation arose in the maternal or paternal germline. Finally, using pedigrees means that researchers often have precise information about the age of the parents at the time of reproduction, and comparing several trios (i.e., three related individuals: mother, father, and offspring) at different parental ages can tell us about the effect of parental age on the total number of transmitted mutations, their location, and their spectrum. Thus, there has been a growing interest in applying this method to address medical and evolutionary questions.</p><p>The first estimate of the human germline mutation rate using pedigrees was published more than 10 years ago <ref type="bibr">(Roach et al., 2010)</ref>. Four years later, the first pedigree-based mutation rate for a nonhuman primate, the chimpanzee, was estimated <ref type="bibr">(Venn et al., 2014)</ref>. Today, at least 20 vertebrate species have mutation rates estimated by pedigree sequencing (Table <ref type="table">1</ref>), with half added in the past two years. Each study differs in the number of trios, the sequencing technology and depth, the ages of individuals included, and the bioinformatics pipelines used to analyze the data (see Table <ref type="table">1</ref> and Supplementary file 1a). Thus, reported variation in mutation rates among studies might result from a combination of biological and methodological factors. Although most studies using human pedigrees have now reached similar rates of ~1.2 &#215; 10 -8 mutations per site per generation at an average age of around 30 years (Table <ref type="table">1</ref>), the effect of different methodologies is likely to have a much larger effect on estimates in other species. This is because these species have lower-quality genome assemblies, less information about segregating polymorphisms, often higher heterozygosity, and an overall deficit in prior information on mutation rates. With an increasing number of studies being published, an examination of the differences among studies and suggestions for standards that will minimize differences caused by methodological discrepancies are warranted.</p><p>The key principle of the pedigree-based approach is to detect de novo mutations (DNMs) present in a heterozygous state in an offspring that are absent from its parents' genomes (Figure <ref type="figure">1</ref>). A per-site per-generation mutation rate can be inferred by dividing the number of DNMs by the number of sites in the genome that mutations could possibly be identified in (and accounting for the diploid length of the genome, as mutations can be transmitted by both the mother and the father). As mutations are rare events, detecting all the true DNMs (or having a high sensitivity) while avoiding errors (or increasing precision) from a single generation remains challenging. False-positive (FP) calls (sites incorrectly detected as DNMs) can be caused by sequencing errors, errors introduced by read mapping and genotyping steps, stochastically missing an alternative allele in a parent, or somatic mutations in the offspring. Numerous filters are thus often applied on the variant sites to increase the precision of the candidate DNMs' detection. However, filters that are too conservative can also discard true DNMs, reducing the sensitivity by increasing the rate of false-negative calls (true DNMs not detected). Therefore, a balance should be found between precision and sensitivity -a goal that has led to the development of multiple different methods to estimate germline mutation rates from pedigree samples.</p><p>Table <ref type="table">1</ref>. Vertebrate species with a direct estimate of the mutation rate using a pedigree approach. The list of species includes 10 primates, 5 nonprimate mammals, 1 bird, and 4 fish (see Supplementary file 1b for differences in study design and methodology). In this study, we aim to define what we consider to be the state of the art in pedigree-based germline mutation rate estimation, to discuss the pros and cons of each methodological step, and to summarize best practices that should be used when calling germline mutations. We review several recently published methods that estimate germline mutation rates from pedigree samples. In parallel, we set up a competition -the 'Mutationathon' -among five research groups to explore the effect of different methodologies on mutation rate estimates. Using a common genomic dataset consisting of a pedigree of the rhesus macaque (Macaca mulatta; <ref type="bibr">Bergeron et al., 2021)</ref>, each group estimated the number of candidate DNMs (validated by PCR amplification and Sanger resequencing) and a germline mutation rate. An examination of the estimated rates produced by different groups not only highlighted the choices that can be made in estimating per-generation mutation rates, but it also provided us with an opportunity to characterize the impact of these choices on the systematic differences in estimated rates, which in turn yielded important insights into the parameters that could reduce the occurrence of FP calls.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Results and discussion</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Comparison of methods</head><p>The overall pipeline from high-throughput next-generation sequencing data to an estimated mutation rate is similar across all studies listed in Table <ref type="table">1</ref>. It includes five steps (Figure <ref type="figure">2</ref>):</p><p>1. sampling and whole-genome sequencing of at least one trio or extended pedigrees that also include a third generation (useful for validation of putative DNMs in the offspring), 2. alignment of reads to a reference genome and post-processing of alignments, 3. variant calling to infer genotypes or genotype likelihoods for all individuals,    Step 1: Sampling and sequencing</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Sample size</head><p>Pedigree-based study designs can vary significantly, from those that include only one trio per species (e.g., <ref type="bibr">Besenbacher et al., 2019)</ref> to those that include thousands of trios (e.g., <ref type="bibr">Halldorsson et al., 2019)</ref>. The first study to estimate a pedigree-based human mutation rate used only two trios and estimated a mutation rate of 1.1 &#215; 10 -8 per site per generation <ref type="bibr">(Roach et al., 2010)</ref>, which is within the overall variation reported across studies with larger sample sizes (Table <ref type="table">1</ref>). Larger sample sizes reduce uncertainty in the average mutation rate for a species and offer more statistical power for the exploration of various parameters such as the parental age effect, the contribution of each parent to the total number of DNMs, and the distribution of mutations across genomes. Multi-sibling pedigrees (i.e., when there is more than one offspring) offer a unique opportunity to detect mutations that may be mosaic within one of the parents indicative of having occurred early in development. Indeed, if, for instance, a paternal DNM is detected in more than one sibling from a pedigree, it is unlikely that the same mutation occurred in different sperm cells. Instead, an early postzygotic mutation may have occurred in primordial germ cells (PGCs) during embryonic development of the father. Therefore, the mutation would be absent from the father's somatic tissue, while affecting more than one of his descendants. Moreover, by means of haplotype sharing with a third noncarrier sibling, DNMs that arose before the PGC specification can be detected, even if present in the parental somatic tissue sampled (e.g., <ref type="bibr">J&#243;nsson et al., 2018)</ref>. Multigeneration pedigrees, also referred to as extended trios, can be used to validate true DNMs and to adjust quality filters by studying transmission to a third generation. Multigeneration pedigrees also allow researchers to easily determine whether these transmitted mutations came from the maternal or paternal parent in the first generation (e.g., <ref type="bibr">J&#243;nsson et al., 2017)</ref>. Therefore, whenever possible, multiple trios should be analyzed and more than two generations should be included. Finally, the age of the parents at the time of reproduction is required for estimating the per-year mutation rate from the per-generation rates directly measured in the trios.</p><p>In some studies, the age of the parents at conception is not available, and instead, the mean age of reproduction is used for the estimation of the per-year mutation rate. While useful, this approximation can lead to biased results if the age of the parents at conception was much older or much younger compared to the mean age in the population. Thus, when possible, the information on the age of each parent at the time of conception should be collected as it is essential for the interpretation of results and to help understand parental age effects on mutation rate. </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Sample type</head><p>The most commonly used sample types are somatic tissues such as whole blood, muscle, or liver, which generally produce a high quantity of DNA with long fragment sizes and allow for high-coverage sequencing. The duration and temperature of storage can affect the quality of the extracted DNA and increase the rate of sequencing errors. Thus, to minimize DNA damage during storage, DNA is typically kept in TE (tris-EDTA) buffer. Moreover, it is advised to store DNA at -80&#176;C for long-term storage (months to years) and in liquid nitrogen at -164&#176;C for decades <ref type="bibr">(Baust, 2008;</ref><ref type="bibr">Straube and Juen, 2013)</ref>. Other materials such as buccal swabs or fur can be considered, but they can be technically challenging. For instance, as part of a recent study on rhesus macaques <ref type="bibr">(Bergeron et al., 2021)</ref>, DNA was extracted from hair samples and sequenced at 95&#215; coverage, yet, due to the fragmentation, only 38% of the reads were mappable to the reference genome. After variant calling, the average depth of usable reads was 6&#215;, with only 10% of sites covered by more than 10 reads. To reduce the number of FP calls caused by somatic mutations, it is best to avoid tissues with an accumulation of such mutations, such as skin. In this regard, blood is often the preferred tissue: as many different tissues contribute cells to the blood, the hope is that a somatic mutation in any one of them will not be mistaken for a DNM. However, in rare cases, mainly in older individuals, clonal hematopoiesis can lead to high-frequency somatic mutations in the blood. Thus, sequencing more than one type of tissue, when feasible, should be considered. Comparing the DNMs called from different tissues could reduce the potential for mistaking somatic mutations as DNMs. If only one tissue is available, allelic balance of both candidate DNMs and known single-nucleotide polymorphisms (SNPs) should allow for better detection of somatic mutations.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Libraries</head><p>After DNA extraction, genomic library preparation is another step that can introduce sequencing errors. Most studies have used Illumina sequencing platforms, yet, even for a single technology, there are different library preparation protocols available. PCR amplification is commonly used to increase the quantity of DNA, but this can generate artifacts caused by the introduction of sequence errors (PCR errors) or by the overamplification of some reads (PCR bias) <ref type="bibr">(Acinas et al., 2005)</ref>. Thus, for samples yielding a sufficient amount of DNA, PCR-free libraries that do not involve amplification prior to cluster generation are preferable. Moreover, as different library preparation methods can result in different amplification biases <ref type="bibr">(Ross et al., 2013;</ref><ref type="bibr">Wingett, 2017)</ref>, utilizing different types of library preparations may be advisable to reduce the sources of error.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Sequencing</head><p>All Illumina sequencing platforms use similar sequencing chemistry (sequencing-by-synthesis) and mainly differ in running speed and throughput. Another equivalent technology, used in two studies <ref type="bibr">(Bergeron et al., 2021;</ref><ref type="bibr">Roach et al., 2010)</ref>, is BGISEQ-500, combining DNA nanoball nanoarrays with polymerase-based stepwise sequencing <ref type="bibr">(Mak et al., 2017)</ref> and showing similar performances to Illumina on data quality <ref type="bibr">(Chen et al., 2019;</ref><ref type="bibr">Patch et al., 2018)</ref>. Another study used 10X Genomics-linked reads, which can help phase maternal and paternal mutations <ref type="bibr">(Campbell et al., 2021)</ref>. However, it remains unclear if alternative library preparation and sequencing platforms introduce additional biases compared to standard Illumina protocols. Most pedigree-based studies of germline mutations have sequenced each individual to a depth between 30&#215; and 50&#215; <ref type="bibr">(Besenbacher et al., 2019;</ref><ref type="bibr">Campbell et al., 2021;</ref><ref type="bibr">J&#243;nsson et al., 2017;</ref><ref type="bibr">Kessler et al., 2020;</ref><ref type="bibr">Malinsky et al., 2018;</ref><ref type="bibr">Milholland et al., 2017;</ref><ref type="bibr">Sasani et al., 2019;</ref><ref type="bibr">Smeds et al., 2016;</ref><ref type="bibr">Thomas et al., 2018;</ref><ref type="bibr">Turner et al., 2017;</ref><ref type="bibr">Wang et al., 2020;</ref><ref type="bibr">Wu et al., 2020)</ref>, three studies sequenced at a higher depth of 80&#215; <ref type="bibr">(Bergeron et al., 2021;</ref><ref type="bibr">Maretty et al., 2017)</ref> and 150&#215; <ref type="bibr">(Tatsumoto et al., 2017)</ref>, while six studies sequenced at a depth lower than 25&#215; on average <ref type="bibr">(Harland et al., 2017;</ref><ref type="bibr">Koch et al., 2019;</ref><ref type="bibr">Lindsay et al., 2019;</ref><ref type="bibr">Martin et al., 2018;</ref><ref type="bibr">Pfeifer, 2017;</ref><ref type="bibr">Rahbari et al., 2016)</ref>. A minimum coverage of 15&#215; has been advised to call SNPs accurately <ref type="bibr">(Fumagalli et al., 2013</ref>). Yet, this depth might not be sufficient to call germline mutations since it might be hard to distinguish genuine germline mutations from somatic mutations that are present in a substantial fraction of cells. Furthermore, with low coverage the probability of calling a parent homozygous for the reference allele, when they are actually heterozygous, becomes non-negligible at the genome-wide level. For example, the binomial probability of not observing a read with one of the alleles in a heterozygote with 15&#215; coverage is 0.5 15 = 3.05 &#215; 10 -5 , which will happen by chance around 30&#215; in a genome with 1 million heterozygous positions. Likewise, based on the binomial distribution, the probability that a somatic mutation present in 10% of cells is seen in more than 30% of reads is 0.0113 with 20&#215; coverage but falls to 0.0004 with 35&#215; coverage. Thus, it is advised to aim for a minimum of 35&#215; as a rule of thumb.</p><p>Step 2: Alignment and post-alignment processing Alignment</p><p>To find DNMs, we must first find where in the genome each of the short sequencing reads comes from. The Burrows-Wheeler Aligner (BWA; <ref type="bibr">Li and Durbin, 2009)</ref> is an algorithm developed to map short reads (50-250 bp) to a reference genome and has been used in the majority of studies on direct mutation rate estimation <ref type="bibr">(Bergeron et al., 2021;</ref><ref type="bibr">Besenbacher et al., 2019;</ref><ref type="bibr">Harland et al., 2017;</ref><ref type="bibr">J&#243;nsson et al., 2017;</ref><ref type="bibr">Kessler et al., 2020;</ref><ref type="bibr">Koch et al., 2019;</ref><ref type="bibr">Malinsky et al., 2018;</ref><ref type="bibr">Maretty et al., 2017;</ref><ref type="bibr">Milholland et al., 2017;</ref><ref type="bibr">Pfeifer, 2017;</ref><ref type="bibr">Sasani et al., 2019;</ref><ref type="bibr">Smeds et al., 2016;</ref><ref type="bibr">Tatsumoto et al., 2017;</ref><ref type="bibr">Thomas et al., 2018;</ref><ref type="bibr">Turner et al., 2017;</ref><ref type="bibr">Wang et al., 2020;</ref><ref type="bibr">Wu et al., 2020)</ref>. In particular, the BWA-MEM algorithm is fast, accurate, and can be implemented with an insert size option to improve the matching of paired reads. Several aspects of the study organism and study design can have detrimental effects on read mapping. Some studies reported a trimming step to remove adapter sequences and poor-quality reads -those with a high proportion of unknown ('N') bases or low-quality-score bases <ref type="bibr">(Bergeron et al., 2021;</ref><ref type="bibr">Maretty et al., 2017;</ref><ref type="bibr">Tatsumoto et al., 2017;</ref><ref type="bibr">Wu et al., 2020)</ref>. However, trimming might not be necessary as some mapping software will soft-clip (or mask) the adaptors, while low-quality reads can be removed during the variant-calling step. The quality of the reference genome can play an important role in obtaining a large proportion of reads with high mapping scores. In the case of a poor or nonexistent reference genome, using the reference genome of a phylogenetically related species is an option, but this could make the downstream analysis more complex <ref type="bibr">(Prasad and Lorenzen, 2021)</ref>. Moreover, BWA was designed to map lowdivergence sequences, so that using a related species, or even a closely related individual in the same species when heterozygosity is high, could impact the mapping. Finally, low-complexity regions (LCRs) and repetitive sequences such as dinucleotide tandem repeats can be problematic for read mapping.</p><p>Standards have been proposed for human genome analysis and can be followed for germline mutation rate calling in species with comparable heterozygosity (for details, see <ref type="bibr">Regier et al., 2018)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Post-alignment processing</head><p>To correct for possible misalignment of sequencing reads to the reference genome, post-alignment quality control is necessary. This step often includes base quality score recalibration (BQSR), removing of duplicate reads, and realignment around indels. BQSR corrects for any bias in the base quality score assigned by the sequencer by utilizing information from a set of known variants for the studied species. When such a dataset is not available, as in many nonhuman species, the Best Practices of the Genome Analysis ToolKit (GATK) software from the Broad Institute advises to proceed first with variant calling in all available samples and subsequently using the best-quality variants to recalibrate the base quality scores <ref type="bibr">(GATK team, 2021)</ref>. If multiple generations are available, high-quality variants fully transmitted across generations can be used for BQSR <ref type="bibr">(Wu et al., 2020)</ref>. However, some studies have ignored this step due to the circularity of this method and its computational expense, as variants will be called twice <ref type="bibr">(Bergeron et al., 2021;</ref><ref type="bibr">Thomas et al., 2018;</ref><ref type="bibr">Wang et al., 2020)</ref>. A comparative study presented a difference of less than 0.1% between the total variant sites called with and without recalibration <ref type="bibr">(Li, 2014)</ref>, and this difference was even lower for high-coverage (40&#215;) sequencing <ref type="bibr">(Tian et al., 2016)</ref>; however, this step is still advised to increase the quality of variant calling <ref type="bibr">(Li, 2020)</ref>. Duplicates, identical reads due to amplification (PCR duplicates) or sequencing clusters (optical duplicates), can increase FP calls and erroneously inflate sequencing coverage. Therefore, duplicates should be marked or removed even for sequences from PCR-free libraries. Reads terminating with indels are more likely to be misaligned; thus, depending on the variant caller used, realignment around indels may be advised to correct for this artifact. Specifically, realignment around indels is required when calling variants with non-haplotype-aware callers (such as GATK's UnifiedGenotyper), but is not necessary with haplotype-aware variant callers (such as GATK HaplotypeCaller <ref type="bibr">[Poplin et al., 2018]</ref>, Platypus <ref type="bibr">[Rimmer et al., 2014]</ref>, or FreeBayes <ref type="bibr">[Garrison and Marth, 2012]</ref>). From GATK release 3.6 onward, the realigned reads around indels can be outputted during the variant-calling step. Alternatively, BWA alignments can be used to construct a variation-aware graph with GraphTyper <ref type="bibr">(Eggertsson et al., 2017)</ref>, including known polymorphisms and newly genotyped variants. Thereby, reads are realigned to the graph, reducing reference bias and improving read alignment near indels <ref type="bibr">(Eggertsson et al., 2017)</ref> and structural variants <ref type="bibr">(Eggertsson et al., 2019)</ref>. Finally, other quality controls can be applied after mapping, such as removing reads mapping to multiple locations, as they could map with a good mapping quality in two or more locations and be ignored by further quality filters. However, the overall impact of many of these filters, such as BQSR and realignment around indels, on the final set of DNMs has not yet been studied.</p><p>Step 3: Variant calling Software</p><p>Different algorithms have been shown to perform similarly well in calling nucleotide variants <ref type="bibr">(Li, 2014)</ref>. GATK (Van der Auwera and O'Connor, 2020) is widely used among studies that call germline DNMs <ref type="bibr">(Bergeron et al., 2021;</ref><ref type="bibr">Besenbacher et al., 2019;</ref><ref type="bibr">Campbell et al., 2021;</ref><ref type="bibr">Feng et al., 2017;</ref><ref type="bibr">Harland et al., 2017;</ref><ref type="bibr">J&#243;nsson et al., 2017;</ref><ref type="bibr">Koch et al., 2019;</ref><ref type="bibr">Malinsky et al., 2018;</ref><ref type="bibr">Maretty et al., 2017;</ref><ref type="bibr">Milholland et al., 2017;</ref><ref type="bibr">Pfeifer, 2017;</ref><ref type="bibr">Sasani et al., 2019;</ref><ref type="bibr">Smeds et al., 2016;</ref><ref type="bibr">Tatsumoto et al., 2017;</ref><ref type="bibr">Thomas et al., 2018;</ref><ref type="bibr">Turner et al., 2017;</ref><ref type="bibr">Wang et al., 2020;</ref><ref type="bibr">Wong et al., 2016;</ref><ref type="bibr">Wu et al., 2020)</ref>. Other commonly used variant callers are GraphTyper <ref type="bibr">(Eggertsson et al., 2017;</ref><ref type="bibr">e.g., utilized by Beyter et al., 2021;</ref><ref type="bibr">Halldorsson et al., 2019;</ref><ref type="bibr">Jonsson et al., 2021;</ref><ref type="bibr">J&#243;nsson et al., 2018)</ref> and FreeBayes <ref type="bibr">(Garrison and Marth, 2012;</ref><ref type="bibr">e.g., utilized by Turner et al., 2017)</ref>. Using more than one variant caller can increase confidence in the SNP set but can become computationally expensive <ref type="bibr">(Turner et al., 2017)</ref>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Parameters</head><p>Even within the same variant caller, different methods can be used (see Supplementary file 1a). For instance, in GATK v3, three strategies are available: (1) per-sample variant calling;</p><p>(2) batch calling, in which samples are analyzed separately and concatenated for downstream analysis; and (3) joint calling, in which variants are called simultaneously across all samples (with the UnifiedGenotyper command).</p><p>In GATK v4, the new recommendation is to first call variants for each sample separately (Haplotype-Caller in ERC mode), and then combine all the samples (GenomicsDBImport) to jointly genotype them (GenotypeGVCFs); thus, the initial identification of variant sites is separable from the assignment of genotypes to each individual. UnifiedGenotyper and HaplotypeCaller should have a similar ability to detect SNPs, but differences in variant sets have been observed <ref type="bibr">(Lescai et al., 2014)</ref>. Moreover, the GATK HaplotypeCaller ERC mode has two options: the BP_RESOLUTION option provides records for every single site in the genome, even nonvariant sites, while the GVCF option groups the nonvariant sites into a block of record. This variant-calling step is computationally expensive, especially if variants are called in BP-RESOLUTION mode, but it can be useful to determine the part of the genome in which there is full power to detect mutations. It is still unclear which strategy should be prioritized; thus, it is advised to report the method used and any additional options that have been implemented. The default settings of GATK applied during variant calling should also be kept in mind. For instance, the heterozygosity prior is by default at 0.001, which could have an impact when analyzing species with much higher or much lower heterozygosity, though the effect of this prior has not been evaluated in the context of mutation rate studies.</p><p>Step 4: Detecting de novo mutations Site-specific filters</p><p>Variant information is stored in the 'variant-calling file (.vcf)' file format, which includes different types of information on the quality of the genotype calls (see Box 1). Thus, the first set of filters (i.e., site-specific filters) can be applied to ensure that there is a true variant at a particular position. GATK's Best Practices (Van der Auwera and O'Connor, 2020) advise to perform a Variant Quality Score Recalibration (VQSR) step to ensure that genotypes are correctly called. However, this tool is not suitable for DNMs as it would remove many rare variants; instead, hard filtering should be applied. GATK provides some general recommendations for these site-specific filters, warning that these should be a starting point and filters may need to be adjusted depending on the callset or the species studied <ref type="bibr">(GATK team, 2020)</ref>.</p><p>The currently advised hard filter criteria for germline short variant discovery are QD &lt; 2.0; MQ &lt; 40.0; FS &gt; 60.0; SOR &gt; 3.0; MQRankSum &lt; -12.5; ReadPosRankSum &lt; -8.0 (see Box 1 and Supplementary file 1b for details on each filter). Although some studies followed these best practices <ref type="bibr">(J&#243;nsson et al., 2017;</ref><ref type="bibr">Wu et al., 2020)</ref>, others implemented only a subset of filters (e.g., three studies reported the GATK filters without SOR &gt; 3.0; <ref type="bibr">Koch et al., 2019;</ref><ref type="bibr">Thomas et al., 2018;</ref><ref type="bibr">Wang et al., 2020)</ref>   <ref type="bibr">(Pfeifer, 2017;</ref><ref type="bibr">Smeds et al., 2016;</ref><ref type="bibr">Tatsumoto et al., 2017)</ref>. Given this plethora of choices, we suggest that reporting filter details should be common practice to improve the comparability of mutation rate estimates. Another site-specific filter is the Phred-scaled probability that a certain site is polymorphic in one or more individuals (QUAL), which has been used in some studies <ref type="bibr">(Harland et al., 2017;</ref><ref type="bibr">Pfeifer, 2017;</ref><ref type="bibr">Wu et al., 2020)</ref>.</p><p>Box 1. The variant call format.</p><p>The variant call format, or vcf, is a text format for storing information on genetic variants. Each line in the file corresponds to a particular variant detected and provides information on:</p><p>&#8226; CHROM and POS: the position of the variant (chromosome name and site);</p><p>&#8226; REF and ALT: the reference and alternative alleles;</p><p>&#8226; QUAL: the p-Phred probability that a variant is actually present at that site;</p><p>&#8226; FILTER: after filtering, PASS indicates that the variant position passes the filtering;</p><p>&#8226; INFO: site-specific annotations;</p><p>&#8226; FORMAT: sample-specific annotations; and</p><p>&#8226; an additional column per sample with the values for the FORMAT annotations.</p><p>The sample-specific annotations provide information on the quality of a particular genotype for a sample and include:</p><p>&#8226; DP: the read depth;</p><p>&#8226; AD: the allelic depth for the reference and alternative allele; and</p><p>&#8226; GQ: the genotype quality.</p><p>On the other hand, the site-specific annotations are informative as to whether a site has an alternative allele or not and include:</p><p>&#8226; QD: quality of a call at a given site taking into account the depth (QUAL/DP);</p><p>&#8226; MQ: the root mean square of the mapping quality at the position;</p><p>&#8226; FS and SOR: information on strand bias;</p><p>&#8226; MQRankSum: the comparison of the mapping quality of reads carrying an alternative or a reference allele;</p><p>&#8226; BaseQRankSum: the comparison of the base quality of reads carrying an alternative or a reference allele; and</p><p>&#8226; ReadPosRankSum: position bias within reads.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Filters of candidate DNMs</head><p>From pedigrees, germline mutations are detected as 'Mendelian violations' where at least one of the alleles observed in the offspring is absent from both of its parents. Most mutation rate studies restrict Mendelian violations to sites where both parents are homozygous for the reference allele (HomRef; 0/0) and the offspring is heterozygous (Het; 0/1 or 1/0) <ref type="bibr">(Bergeron et al., 2021;</ref><ref type="bibr">Besenbacher et al., 2019;</ref><ref type="bibr">J&#243;nsson et al., 2017;</ref><ref type="bibr">Koch et al., 2019;</ref><ref type="bibr">Pfeifer, 2017;</ref><ref type="bibr">Smeds et al., 2016;</ref><ref type="bibr">Thomas et al., 2018;</ref><ref type="bibr">Wang et al., 2020;</ref><ref type="bibr">Wu et al., 2020)</ref>. Other combinations of genotypes could also be caused by germline mutations such as parents homozygous for the alternative allele (HomAlt; 1/1) with heterozygous offspring (0/1 or 1/0), or one parent HomRef (0/0) and the other HomAlt (1/1) with an offspring either HomRef (0/0) or HomAlt (1/1). These sites are usually filtered out and assumed to represent a small portion of the genome to avoid the added uncertainty associated with these genotypes <ref type="bibr">(Wang et al., 2021a)</ref>. However, before excluding these sites, researchers should note that their expected frequency increases with the level of heterozygosity of the species studied and the phylogenetic distance to the reference genome used for mapping. For a phylogenetic distance to the reference genome of 2%, ~1 in 50 true DNMs is expected to occur in a background where both parents are homozygous for the alternative allele (1/1). After selecting the final set of Mendelian violations, several sample-specific filters are applied to ensure the genotypes of each individual are of high quality and to reduce FP calls. These individual filters and thresholds used vary substantially between studies (see Supplementary file 1c), but generally include a depth filter (i.e., the number of reads for each individual at a particular site), a genotype quality filter (i.e., the Phred-scaled confidence of the assigned genotype), as well as a filter on the allelic depth (i.e., the number of reads supporting the alternative allele and the reference allele).</p><p>Sites with low read depth (DP) are prone to exhibit Mendelian violations due to stochastic sampling of reads and due to sequencing and genotyping errors, while positions with particularly high depth could indicate a misalignment of reads in low complexity or paralogous regions. As each study analyzed pedigrees sequenced at various depths, different cutoffs were chosen for this filter, some more permissive than others. Some studies only set a minimum DP of approximately 10 reads (e.g., <ref type="bibr">J&#243;nsson et al., 2017;</ref><ref type="bibr">Pfeifer, 2017;</ref><ref type="bibr">Sasani et al., 2019)</ref>, while other higher-coverage studies were able to set more conservative minimum and maximum thresholds, varying from a minimum of 10-20 to a maximum of 60-150 (e.g., <ref type="bibr">Maretty et al., 2017: DP &lt; 10 and DP &gt; 150;</ref><ref type="bibr">Thomas et al., 2018: DP &lt; 20 and DP &gt; 60;</ref><ref type="bibr">Wang et al., 2020: DP &lt; 20 and DP &gt; 60)</ref>. Another approach is to use a relative depth threshold for each individual (e.g., depth individual &#177; 3&#963;, with &#963; being the standard deviation around the average depth <ref type="bibr">[Tatsumoto et al., 2017]</ref>, or a maximum threshold of 2 &#215; depth individual <ref type="bibr">[Besenbacher et al., 2019]</ref>) or, when all individuals were sequenced at a similar depth, an relative depth per trio (e.g., a DP filter of 0.5 &#215; depth trio and 2 &#215; depth trio <ref type="bibr">[Bergeron et al., 2021]</ref>). Alternatively, <ref type="bibr">Rahbari et al., 2016 and</ref><ref type="bibr">Wu et al., 2020</ref> tested if the depth at each site followed a Poisson distribution under the null hypothesis that lambda was depth individual , and filtered away sites where at least one individual of the trio had a p-value higher than 2 &#215; 10 -4 .</p><p>To correct for genotyping errors, two parameters from the output .vcf can be used: the Phredscaled likelihood of the genotype (PL) and the genotype quality (GQ). The most likely genotype has a PL of 0, while the least likely genotype has the highest PL value. GQ is the difference between the PL 2nd most likely and PL 1st most likely , with a maximum reported of 99. Applied GQ thresholds vary between 20 <ref type="bibr">(J&#243;nsson et al., 2017;</ref><ref type="bibr">Sasani et al., 2019)</ref> and 70 <ref type="bibr">(Wang et al., 2021b</ref><ref type="bibr">, Wang et al., 2020)</ref>. Instead of using GQ, some studies used the difference between PL 2nd most likely and PL 1st most likely , which is not limited to a maximum of 99, and applied more conservative criteria for the offspring heterozygous genotype than for the homozygous parents <ref type="bibr">(Maretty et al., 2017:</ref> homozygous PL 2nd most likely -PL 1st most likely &lt; 80, heterozygous PL 2nd most likely -PL 1st most likely &lt; 250; <ref type="bibr">Tatsumoto et al., 2017:</ref> homozygous PL 2nd most likely -PL 1st most likely &lt; 100, heterozygous PL 2nd most likely -PL 1st most likely &lt; 200).</p><p>Variants can also be filtered using allelic depth: the number of reads supporting the reference allele and the alternative allele. To ensure the homozygosity of the parents, some studies filter away sites where alternative alleles are present in the parents' reads. AD refers to the number of reads supporting the alternative allele, with previously utilized thresholds include AD &gt; 0 <ref type="bibr">(Besenbacher et al., 2019;</ref><ref type="bibr">Harland et al., 2017;</ref><ref type="bibr">Koch et al., 2019;</ref><ref type="bibr">Pfeifer, 2017;</ref><ref type="bibr">Sasani et al., 2019;</ref><ref type="bibr">Smeds et al., 2016;</ref><ref type="bibr">Wang et al., 2021b)</ref>, AD &gt; 1 <ref type="bibr">(J&#243;nsson et al., 2017;</ref><ref type="bibr">Wang et al., 2020)</ref>, or AD &gt; 4 <ref type="bibr">(Maretty et al., 2017)</ref>. Even more conservative, one study used a lowQ AD2 &gt; 1, that is, the number of alternative alleles in the low-quality reads (not used for variant calling) should not exceed 1 <ref type="bibr">(Besenbacher et al., 2019)</ref>.</p><p>Allelic depth is also used to calculate the allelic balance (AB): the proportion of reads supporting the alternative allele relative to the total depth at this position. In the case of a DNM, the offspring should have approximately 50% of its reads supporting each allele. Purely somatic mutations are expected to cause only a small fraction of reads to carry an alternate allele, though this fraction can be different for mutations occurring early in the zygote stage of the offspring and leading to germline mosaicism. A previous large-scale analysis of human pedigrees recovered a bimodal allelic balance distribution of Mendelian violations in the offspring before applying an AB filter, with a peak around 50% interpreted as DNMs, and another peak around 20% likely corresponding to somatic mutations <ref type="bibr">(Besenbacher et al., 2015)</ref>, mismapping errors, or sample contamination <ref type="bibr">(Karczewski et al., 2019)</ref>. Thus, careful filtering on AB is required to avoid FPs. Thresholds used for the AB filter vary between a minimum of 20% <ref type="bibr">(Pfeifer, 2017)</ref> to 40% <ref type="bibr">(Thomas et al., 2018)</ref>, and a maximum, when applied, of 60% <ref type="bibr">(Thomas et al., 2018)</ref> to 75% <ref type="bibr">(J&#243;nsson et al., 2017)</ref>. Instead of a hard cutoff, one study used a binomial test on the allelic balance under the null hypothesis of a 0.5 frequency, removing positions with a p-value lower than 0.05 <ref type="bibr">(Wu et al., 2020)</ref>.</p><p>Additional filters can be used, for instance, to remove candidate DNMs present in individuals other than the focal offspring, including siblings <ref type="bibr">(Pfeifer, 2017;</ref><ref type="bibr">Smeds et al., 2016)</ref>, only unrelated individuals in the same dataset <ref type="bibr">(Bergeron et al., 2021;</ref><ref type="bibr">Besenbacher et al., 2019;</ref><ref type="bibr">Campbell et al., 2021;</ref><ref type="bibr">Thomas et al., 2018;</ref><ref type="bibr">Wu et al., 2020)</ref>, or polymorphism datasets of the same species <ref type="bibr">(Pfeifer, 2017;</ref><ref type="bibr">Smeds et al., 2016;</ref><ref type="bibr">Wu et al., 2020)</ref>. This filter is based on the idea that the chance of getting a DNM at a position already being polymorphic is very low unless there is very high heterozygosity, thus guarding against the possibility that a heterozygous site was missed in the parents. However, recurrent mutations have been reported, especially at CpG locations <ref type="bibr">(Acuna-Hidalgo et al., 2016;</ref><ref type="bibr">S&#233;gurel et al., 2014)</ref>. Filters can also be applied to the distance between mutations, again assuming that the probability of having two mutations close to each other is low. For instance, in some studies, candidate DNMs were removed if four or more candidates were located in a 200 base-pairs window <ref type="bibr">(Koch et al., 2019)</ref> or two candidates were less than 10 base-pairs <ref type="bibr">(Tatsumoto et al., 2017)</ref> or 100 base-pairs apart <ref type="bibr">(Wu et al., 2020)</ref> from each other. Here again, the underlying assumptions is not always fulfilled as there is evidence of nonrandom clustering of mutations <ref type="bibr">(Brandler et al., 2016;</ref><ref type="bibr">Turner et al., 2016)</ref>. In humans, ~3% of the DNMs are part of a mutation cluster <ref type="bibr">(Besenbacher et al., 2016;</ref><ref type="bibr">Kaplanis et al., 2019)</ref>, a feature that appears to be conserved among all eukaryotes <ref type="bibr">(Schrider et al., 2011)</ref>. Therefore, instead of discarding these mutations, exploring their proportion may be an additional quality filter. Finally, some studies removed DNM candidates located in the LCRs <ref type="bibr">(Sasani et al., 2019)</ref> or repetitive regions of the genome <ref type="bibr">(Pfeifer, 2017)</ref> that are prone to mismapping.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Assessing FPs</head><p>After choosing each filter according to the dataset, a total number of candidate DNMs per offspring is found. Yet, as stringent as the filters can be, there are still chances for FPs to be introduced in the final set of DNMs. Even though there is no perfect method to correct the FP calls, this issue should be addressed.</p><p>One of the most straightforward methods to validate DNMs is by PCR amplification followed by resequencing such as Sanger sequencing to ensure the genotype of each individual of the trio <ref type="bibr">(Bergeron et al., 2021;</ref><ref type="bibr">Koch et al., 2019;</ref><ref type="bibr">Maretty et al., 2017;</ref><ref type="bibr">Tatsumoto et al., 2017;</ref><ref type="bibr">Wu et al., 2020)</ref>. However, this PCR amplification and resequencing method can be challenging. In addition to the cost, designing primers for the region of the candidate DNMs can be difficult, especially for candidates located in repeat regions. Furthermore, most Sanger resequencing is aimed at validating the heterozygous state of the offspring, not the homozygous state of the parents. If all candidate DNMs are successfully validated, the FPs can be removed from the set of candidate DNMs. However, it is often the case that we cannot check every candidate DNM. In these cases, it is common to estimate the FDR from a subset of candidates that can be checked. The FDR can be estimated as:</p><p>with PCR validated being the number of candidate DNMs successfully amplified and passing the resequencing validation and PCR failed being the number of candidate DNMs successfully amplified but failing the resequencing validation. We can then adjust the total number (nb) of DNMs in the entire dataset by using the following relationship:</p><p>where nb candidateDNMscorrected is the updated number of DNMs in the dataset. Of note, some studies refer to a FP rate instead of the FDR (e.g., <ref type="bibr">Bergeron et al., 2021;</ref><ref type="bibr">J&#243;nsson et al., 2017;</ref><ref type="bibr">Wang et al., 2020</ref>), yet, it also refers to the ratio of FP calls on the total number of candidates (i.e., true positives and FPs).</p><p>A second method to check candidate DNMs is manual curation, using visualization software such as the Integrative Genome Viewer <ref type="bibr">(Robinson et al., 2011)</ref>. By comparing the read mappings of the parents and their offspring at candidate DNMs, FP calls can be detected. Estimates of the FDR using this approach have varied widely depending on the study design, from 91% <ref type="bibr">(Pfeifer, 2017)</ref> at low coverage to 35% <ref type="bibr">(Smeds et al., 2016)</ref> at medium coverage to 11% at high coverage <ref type="bibr">(Bergeron et al., 2021)</ref>. Further work is needed to ensure that manual curation is consistent when applied by different researchers working in different systems.</p><p>A third method to estimate the FDR, based on deviations from the expected 50% transmission rate of DNMs to the next generation, can be used if an extended pedigree is available. With this method, Wu et al., 2020 estimated an FDR of 18%. However, such a deviation from 50% can arise from the expected variance of a binomial distribution, especially if the number of mutations is small. Moreover, clusters of mutations could increase this variance if linked mutations are passed on together to the next generation, especially if the number of trios is small. When this method is used, transmission should be clearly defined as it can be when the grandchild has been genotyped as heterozygote with the mutant allele or alternatively when at least a few reads contain the mutant allele. <ref type="bibr">J&#243;nsson et al., 2017</ref> used multiple individuals and haplotype sharing to assess the consistent segregation of DNM allele in the next generation.</p><p>A fourth method of estimating the FDR takes advantage of monozygotic twins. Germline mutations transmitted from parents to monozygotic twins are expected to be present in both twins as they are derived from the same zygote. <ref type="bibr">J&#243;nsson et al., 2017</ref> exploited the discordance between candidate DNMs in monozygotic twins to derive the FDR (3%). This estimate is an upper bound because discordance between monozygotic twins is a combination of post-zygotic mutations and FP calls. However, the authors analyzed a unique dataset of 91 human trios with monozygotic twins -data that will be hard to obtain in most species.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Step 5: Mutation rate estimation</head><p>To calculate a per-site per-generation mutation rate, the total number of candidate DNMs (corrected for FPs) should be divided by the number of sites in the genome with full detection power. The denominator takes into account the callable genome (CG) -sites where mutations could have been detected -and the FNR -the rate at which actual DNMs have been missed by the pipeline that has been applied to this point. Assuming that the rate of mutation is similar in the remaining part of the genome, the mutation rate per-site per-generation &#181; of a diploid species can be estimated as</p><p>.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Callable genome</head><p>Different methods have been used to estimate the CG, the number of sites where a DNM would have been detected if it was there (Supplementary file 1a). Many studies used the strict individual filters applied during the detection of candidate DNMs, including all sites where the parents were homozygotes for the reference allele and each individual met the DP, GQ, and any other filters. However, the set of filters and input files used to infer CG differ between studies (Supplementary file 1a) and, consequently, estimates vary widely from CG representing 45% <ref type="bibr">(Tatsumoto et al., 2017)</ref> to 91.5% <ref type="bibr">(Malinsky et al., 2018)</ref> of the total genome. For instance, some studies used GATK's CallableLoci tool <ref type="bibr">(Van der Auwera et al., 2013)</ref> that estimates the number of sites that pass the DP filters from the read alignment (.bam) files (e.g., <ref type="bibr">Wu et al., 2020)</ref> while another study <ref type="bibr">(Wang et al., 2020)</ref> used the .vcf from the SAMtools mpileup caller <ref type="bibr">(Li et al., 2009)</ref>. From GATK 4 onward, CallableLoci is no longer</p><p>supported, yet, with the BP_RESOLUTION mode, every single site of the genome has a depth and genotype quality value that can be used to estimate the callable sites (used in e.g., <ref type="bibr">Bergeron et al., 2021;</ref><ref type="bibr">Pfeifer, 2017)</ref>. Moreover, some studies restrict the CG to the orthologous genome in order to match for base composition when making comparisons across species (e.g., <ref type="bibr">Wu et al., 2020)</ref>. Due to these differences, it is important to report which methodology and filters are used to estimate CG.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Assessing false-negatives</head><p>On the number of sites considered callable, additional corrections for the FNR can be included. Indeed, even if the CG represents the sites that pass most of the individual filters, some filters can simply not be applied to non-polymorphic sites. The methods and results differ between studies, with an estimated FNR from 0% <ref type="bibr">(Smeds et al., 2016;</ref><ref type="bibr">Tatsumoto et al., 2017)</ref> to 44% <ref type="bibr">(Thomas et al., 2018)</ref>.</p><p>One way to estimate an FNR is to introduce random DNMs to the sequencing reads and run the entire pipeline (steps 2-4) to calculate its efficiency in finding these simulated DNMs (e.g., <ref type="bibr">Feng et al., 2017;</ref><ref type="bibr">J&#243;nsson et al., 2017;</ref><ref type="bibr">Pfeifer, 2017;</ref><ref type="bibr">Wu et al., 2020)</ref>. The FNR can then be estimated as</p><p>This method corrects for errors during alignment, post-alignment processing, calling, and filtering as the reads are passed into the pipeline a second time. However, it can be computationally intensive as variant calling needs to be run multiple times and is a resource-and time-intensive step.</p><p>Another way to estimate the FNR is to use the number of callable sites that will be filtered away by filters different from those taken into account in the CG estimation, such as site or allelic balance filters <ref type="bibr">(Bergeron et al., 2021;</ref><ref type="bibr">Besenbacher et al., 2019;</ref><ref type="bibr">Thomas et al., 2018)</ref>. As some site filters are inferred during variant calling based on statistical tests following known null distributions, it is possible to estimate the proportion of callable sites filtered away by these site filters <ref type="bibr">(Bergeron et al., 2021;</ref><ref type="bibr">Besenbacher et al., 2015)</ref>. Moreover, some true DNMs could have an allelic balance outside the allelic balance filter chosen due to sequencing variability or mosaicism. This bias can be estimated by the heterozygous sites in the offspring (that are not DNMs) presenting an allelic balance outside the allelic balance filter, assuming that this bias occurs at the same rate at DNMs and heterozygous sites in the offspring (i.e., one parent is homozygous for the reference allele, one parent is homozygous for the alternative allele, and the offspring heterozygous). Therefore, FNR can be inferred as the proportion of true heterozygous sites outside the AB filter as</p><p>Finally, the denominator can be estimated based on a probability to detect a DNM at a site, given various parameters at that site. Thus, there is no clear distinction between CG and FNR as the latter is part of the CG estimation. Specifically, <ref type="bibr">Besenbacher et al., 2019</ref> used inherited variants to estimate the probability that a DNM at a given site would pass all filters conditional on the depth of each individual. They then summed these probabilities to calculate the number of callable sites in the genome.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Mutationathon: Twofold variation in estimated rates from the same trio</head><p>To understand the effect of various methods on mutation rate estimates from a single dataset, a threegeneration pedigree of rhesus macaque (M. mulatta) was analyzed by researchers from five groups: Lucie Bergeron (LB), S&#248;ren Besenbacher (SB), Cyril Versoza (CV), Tychele Turner (TT), and Richard Wang (RW). The macaque pedigree consisted of Noot (father), M (mother), Heineken (daughter), and Hoegaarde (Heineken's daughter) (Figure <ref type="figure">3a</ref>). Each individual was sequenced with BGISEQ-500 at an average coverage between 40&#215; (Noot) and 70&#215; (all other individuals). The raw data were trimmed using SOAPnuke <ref type="bibr">(Chen et al., 2018)</ref> to remove adaptors, low-quality reads, and N-reads (see Materials and methods for more information). Trimmed reads were shared with all participants, who applied their respective pipelines to identify DNMs in Heineken and to estimate a per-site per-generation germline mutation rate.</p><p>Each group of investigators implemented their own set of filters (Table <ref type="table">2</ref>-source data 1) and detected between 18 (CV) and 32 (SB) candidate DNMs. After PCR amplification and Sanger sequencing validation of the DNM candidates from all research groups (43 distinct sites), we validated Source data 2. Sanger sequencing chromatograms of the 39 DNM candidate sites that were successfully amplified for the four individuals, i.e. father (Noot), mother (M), offspring (Heineken), and second-generation offspring (Hoegaarde). 33 positions as true-positive DNMs, 6 were determined to be FP calls, and 4 did not successfully amplify (Figure <ref type="figure">3b</ref>, Figure <ref type="figure">3</ref>-source data 1). No group found all true-positive DNMs. Of the 33 truepositive DNMs, only 7 were detected by all research groups (Figure <ref type="figure">3c</ref>). Fourteen additional truepositive mutations were detected by at least four groups; six detected by all except CV, four by all except RW, two by all except LB, one by all except SB, and one by all except TT. Of the 12 remaining true-positive mutations, 5 were detected by three groups, 1 by two groups, and 6 by a single group. The candidate DNMs found by a single group are more likely to be FPs as the six FP candidates revealed by the PCR experiment were all candidates detected by a single pipeline. The differences in candidate DNMs led to differences in the spectrum of mutations (Figure <ref type="figure">3-figure supplement 1</ref>), yet the transition-to-transversion ratio (ti/tv) did not significantly differ between groups (ti/tv all truepositives = 2.7; SB = 2.25; CV = 3; TT = 3.2; RW = 3.2; LB = 5.5; Fisher's exact test p-value=0.87). The transmission rate to the next generation varied between 52% (with SB pipeline: 15 true-positive DNMs transmitted on 29 true-positive candidates) and 67% (with RW pipeline: 14 true-positive DNMs transmitted on 21 true-positive candidates). The transmission rate of all true-positive DNMs (33) was 67% with 21 DNMs transmitted to the next generation; this rate is not significantly different from the expected 50% inheritance (binomial test p-value=0.08).  The online version of this article includes the following source data for figure <ref type="figure">4</ref>:</p><p>Source data 1. Number of candidate DNMs, estimated callable genome and per generation mutation rate by each researcher group.</p><p>In addition to identifying DNMs, each group was tasked with estimating the per-site per-generation rate of mutation. The final estimated rate depends on the size of the CG considered by each group, as well as corrections for FPs and false-negatives. Even with the variation in the number of candidate DNMs from each group (Figure <ref type="figure">4a</ref>), different values for these additional parameters could still have resulted in equivalent rate estimates between different groups. However, differences in methodology led to almost a twofold variation in the estimated rates, greater than the variation in the number of DNMs. TT estimated the lowest rate of 0.46 &#215; 10 -8 mutations per site per generation (Figure <ref type="figure">4b</ref>). This estimate was based on autosomes and the X chromosome (where two candidates were found), and the CG represented almost the full genome size. Using the full genome size in the denominator is commonly used in human studies, for which most of the genome is callable due to the high-quality reference genome, while stricter corrections are usually applied in nonhuman studies. CV, RW, SB, and LB found similar rates (CV: 0.77 &#215; 10 -8 ; RW: 0.85 &#215; 10 -8 ; SB: 0.73 &#215; 10 -8 ; LB: 0.63 &#215; 10 -8 ), with 25% differences between the lowest and the highest rate and large overlap of the confidence intervals (Figure <ref type="figure">4c</ref>). RW estimated the highest rate with 0.85 &#215; 10 -8 mutations per site per generation, from a relatively small set of candidates ( <ref type="formula">22</ref>), yet the denominator was also small as CG represented about 50% of the autosomal genome. SB and LB estimated a similar value of CG, representing approximately 80% of the autosomal genome; however, there was a difference in rates due to the smaller number of candidates found by LB (28) compared to SB (32).</p><p>The different individual filters applied by each group explain some of the differences in the candidate DNMs (Table <ref type="table">2</ref>, Table <ref type="table">2</ref>-source data 1). For instance, many groups filtered away candidate sites where the parents were heterozygotes as they could be more prone to FP calls. TT's pipeline was the only one to find a candidate mutation at a site where the father was heterozygous C/G, the mother was homozygous for the reference allele G/G, and the offspring was heterozygous A/G. These genotypes were validated by the PCR experiment, indicating that a true germline mutation has arisen at a heterozygous site in a parental genome. Each method varied in power to detect the true DNMs Table <ref type="table">2</ref>. Site-specific and sample-specific filters used by the different groups to detect de novo mutations (DNMs) in Heineken (difference in the other steps of the pipeline in The online version of this article includes the following source data for table 2:</p><p>Source data 1. Details on the methodology and filtering criteria applied by the five different pipelines to estimate the mutation rate on the common pedigree.</p><p>(sensitivity), and in the proportion of validated true candidates on the overall candidates found (precision). For instance, RW used especially conservative filters on the allelic balance for both the offspring (AB) and the number of alternative alleles allowed in the parents (AD). It resulted in a lower sensitivity, only 22 candidates were found, but a high precision as no candidates were determined to be FP calls. Similarly to RW, some groups were conservative on the AB filter, while other groups were more conservative on the GQ filter (SB and LB) or DP filter (LB, CV, RW). For instance, SB used a relaxed filter on DP, with a minimum threshold of 10&#215;, but a relatively conservative threshold on AB and GQ criteria. TT did not use strict filters for any parameter; however, the precision was increased by the required overlap among multiple variant callers. We explored the effect of the individual filter on the number of candidate DNMs, the number of FP calls, the CG, the FNR, and the final estimated mutation rate per-site per generation (&#181;). We used the LB pipeline (see individual filters in Table <ref type="table">2</ref> and other methods in Table <ref type="table">2</ref>-source data 1) and changed one filter at a time using various criteria used by the Mutationathon participants and in the literature (Figure <ref type="figure">5</ref>, Figure <ref type="figure">5</ref>-source data 1). The GQ filter had the largest impact on the number of mutations and the final estimated mutation rate. The number of candidate DNMs found with GQ &lt; 20 was three times higher than the one obtained with the most conservative GQ filter (GQ Hom &lt; 100 and GQ Het &lt; 200), and the difference was still twofold after correcting for FP calls. The CG also decreased with GQ &lt; 80, leading to an estimated rate 39% lower when GQ &lt; 80 (&#181; = 0.56 The online version of this article includes the following source data for figure <ref type="figure">5</ref>:</p><p>Source data 1. Details on the number of candidate DNMs, the number of false positive calls, the size of the callable genome, the false negative rate and the final estimated mutation rate using various individual filters.</p><p>&#215; 10 -8 ) compared to when GQ &lt; 20 (&#181; = 0.91 &#215; 10 -8 ). This filter also seems to be the most efficient at reducing the number of FP calls, estimated here with the manual curation method, as more than 90% of the candidates DNMs were FPs with no GQ filter while we found no FPs with conservative GQ filters (GQ &lt; 80 and GQ Hom &lt; 100 and GQ Het &lt; 200). Another important filter was the allelic balance on the heterozygous offspring, resulting in a twofold difference in the number of candidate DNMs detected, and 1.5-fold difference after the correction for FP calls. Yet, the estimated FNR was almost five times higher when using a conservative AB filter (AB &lt; 0.4 and AB &gt; 0.6; FNR = 15.8%) compared to the least conservative AB filter (AB &lt; 0.2; FNR = 3.5%). This led to a mutation rate estimate 28% lower with the conservative AB filter (AB &lt; 0.4 and AB &gt; 0.6; &#181; = 0.69 &#215; 10 -8 and AB &lt; 0.2; &#181; = 0.83 &#215; 10 -8 ). The DP filter also impacted the estimated rate but to a lesser extent with only a 6% difference between the estimated mutation rate with DP &lt; 10 (&#181; = 0.67 &#215; 10 -8 ) and the most conservative DP filter (DP &lt;0.5 &#215; depth individual and DP &gt;2 &#215; depth individual ; &#181; = 0.63 &#215; 10 -8 ). Finally, the AD filter did not show a large impact on the mutation rate, with less than 2% difference between no filter on AD (&#181; = 0.63 &#215; 10 -8 ) and the conservative AD &gt;0 (&#181; = 0.62 &#215; 10 -8 ).</p><p>The mutation rate was calculated with LB pipeline as nbcandidateDNMs-FP ) .</p><p>These results show that some of the differences in estimated rates between the five research groups may be attributed to the individual filters. Yet, earlier steps in the different bioinformatic pipelines could also lead to differences in candidate DNMs and estimated rates. For instance, the site filters were different between some of the groups (see Table <ref type="table">2</ref>-source data 1). Testing different combinations of site filters on the shared trio of rhesus macaques affected the set of SNPs detected, which could lead to variation in candidate DNMs detected. For instance, on the 12,634,956 variants found by LB pipeline, 473,142 SNPs were removed when using GATK-advised filters (QD &lt; 2.0; MQ &lt; 40.0; FS &gt; 60.0; SOR &gt; 3.0; MQRankSum &lt; -12.5; ReadPosRankSum &lt; -8.0), while the stringent filters used by LB pipeline (QD &lt; 2.0, FS &gt; 20.0, MQ &lt; 40.0, MQRankSum &lt; -2.0, MQRankSum &gt; 4.0, Read-PosRankSum &lt; -3.0, ReadPosRankSum &gt; 3.0, and SOR &gt; 3.0) removed 1,124,005 SNPs. Despite this difference in the number of SNPs, using the LB pipeline to detect candidate DNMs on the three callset (no filters, GATK-advised filter, or stringent filters), led to the same final number of candidate DNMs due to the stringent individual filters applied in the following steps of the pipeline. Other steps, such as mapping and variant calling, could also lead to some of the differences between the five groups. For instance, the six candidates identified as FPs by the Sanger sequencing were filtered away in the LB pipeline. Four of the FP candidates were not detected because all individuals were genotyped as homozygous for the reference allele, one position was filtered out by the mapping quality site filter (MQ &lt; 40), and one position had DP = 0. Thus, differences in the mapping of the reads and variant callers explain some of the discrepancies between pipelines.</p><p>Overall, these results show that for the same dataset differences in estimated mutation rates caused by methodological discrepancies are non-negligible. Therefore, such differences should be considered when comparing mutation rates between different species when they are estimated by different pipelines. Some of the differences in estimated rates between groups can be attributed to the different individual filters applied for the detection of candidate DNMs. Most notably, varying the GQ and AB filters leads to large variations in estimated rates. Some of the difference is also introduced in earlier steps when mapping reads and calling variants. Moreover, the estimated CG is different between the five groups; in addition to changing the denominator of the mutation rate calculation, this difference could reflect the ability of individual methods to query mutation in different genomic regions. Some variation might therefore be explained by true mutation rate heterogeneity between genomic regions (such as low-or high-complex regions). Our results also suggest that despite the different methods and filters the estimated rates are comparable when both the numerator (number of candidates and FPs) and the denominator (CG and FNR) are carefully corrected. For instance, CV, SB, LB, and RW estimated similar rates, but SB and RW used a probabilistic method to calculate the CG, while LB used strict filters (DP and GQ) on a base-pair resolution .vcf and corrected for FNR using the site filters and the allelic balance filter and CV used a similar method to estimate CG, yet, did not apply a correction for FNR. Finally, the Mutationathon was carried out using a single trio, thus providing no information about sampling error. It would be of interest to pursue a similar effort of comparing methodologies using larger or more pedigrees in order to reach a broader consensus. Using available human datasets could further allow some control on known benchmarks such as ti/tv or known population SNPs, but may not represent the scenario confronting researchers studying new species.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Best practices</head><p>When estimating germline mutation rates from pedigree samples, there is no standardized set of methods. Different studies use different software versions and filtering thresholds, which can impact the estimated rate and can complicate the comparison of rates between or within species across studies (in addition to the biological variation introduced by the age of the parents used in each study; Table <ref type="table">1</ref>). Here, we provide guidelines for each step in DNM calling and rate estimation. However, we note that sample quality, reference genomes, and other technical factors differ across studies and thus require study-or species-specific thresholds. Therefore, it is advised to report the methodology used in a standardized way. It would also be helpful to release the .vcf files, which would allow reproducibility and further comparisons on larger datasets. Table <ref type="table">3</ref> proposes a checklist of parameters that should be reported in studies of germline mutation rates.</p><p>Moreover, some benchmarks could be helpful to ease the comparison between studies such as:</p><p>&#8226; the transition-to-transversion ratio (ti/tv),</p><p>Table <ref type="table">3</ref>. Information that should ideally be reported when presenting results on de novo mutations (DNMs).</p><p>See Table <ref type="table">2</ref>-source data 1 for an example of this table filled out for the five pipelines used to analyze the trio of rhesus macaques.</p><p>Step of the analysis Information to report False-negative rate estimation method: simulation? Filters? Probability?</p><p>&#8226; the spectrum of mutations (see Figure <ref type="figure">3</ref>-figure supplement 1 for an example from the Mutationathon), &#8226; the percentage of mutations in CpG locations,</p><p>&#8226; the base composition (percentage of A/T or C/G),</p><p>&#8226; the nucleotide heterozygosity in unrelated individuals,</p><p>&#8226; if population data are available, the number of DNMs that are in known SNPs of the population,</p><p>&#8226; the contribution of each sex to the total number of mutation bias when phasing of mutations is possible, &#8226; the transmission rate to the next generation when extended trios are available,</p><p>&#8226; the average age of the parents at the time of reproduction, if known &#8226; the distribution of the allelic balance of true heterozygotes, candidate DNMs after all filters except the allelic balance, and the final set of candidate DNMs.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Conclusion and perspectives</head><p>Different filters can lead to differences in estimated rates, which emphasizes the difficulty in comparing pedigree-based germline mutation rates estimated from different studies. The variation observed could be partially due to the biology and life-history traits of species, but some of the variations will also be caused by methodological differences. Here, we provided some best practices that can be used when estimating germline mutation rates from pedigree samples. However, it is hard to provide hard cutoffs of filters that apply to every situation, and we advise choosing appropriate filters depending on the data available. We have also raised some points that should be addressed in individual studies, such as estimation of the FDR, FNR, and the CG size. Nevertheless, more exploration should be done to understand the best strategy for the different steps required in every study of the mutation rates. Without a clear consensus on approaches for estimating the germline mutation rate, it seems that the best strategy will be to carefully report all methods and parameters used. The trio of rhesus macaque used in this analysis is publicly available, along with the validated candidate DNMs, and could serve as a resource for testing new strategies. On a more positive note, it is important to point out that two recent, independent studies of the per-generation mutation rate in rhesus macaque reported rates that were within 5% of each other for individuals of the same age <ref type="bibr">(Bergeron et al., 2021;</ref><ref type="bibr">Wang et al., 2020)</ref>. We hope that careful studies using a variety of methods will be able to similarly arrive at accurate estimates of important biological parameters. With the growing number of studies on pedigree-based estimation of germline mutation rate, some directions that have been neglected could be explored. For instance, even when the sample size is large, most studies use samples originating from small geographic regions; it would be of great interest to further explore potential variation in mutation rates across diverse populations (e.g., <ref type="bibr">Kessler et al., 2020)</ref>. A large study with many trios sequenced using the same protocol also provides more information about the features that separate true and false variant calls. If the number of sequenced samples is sufficiently large, it might even become feasible to estimate a site-specific error rate for each position in the genome. Such improved error rate estimates would further improve the ability to avoid FP DNM calls.</p><p>Most studies are conducted on genomic DNA collected from somatic tissues. As a result, if samples come from only a single trio, one cannot distinguish early postzygotic mutations occurring in the offspring from germline mutations in the parents. While mutations occurring early enough in offspring development will be passed on to the next generation -and should therefore still be considered DNMs -they will behave differently from mutations arising in the parental generation. For instance, we will not expect an increase of these mutations with parental age <ref type="bibr">(J&#243;nsson et al., 2018)</ref>. Therefore, it is of interest to distinguish between these two types of mutation, especially for biomedical research. A possible way to discard those mutations would be to compare somatic and germline cells from the same individual. However, extracting DNA directly from sperm and eggs can be challenging, especially for nonhuman species, limiting the application of this strategy. Another area for additional future work is to look at de novo structural variants. As they are even rarer than SNPs, it is hard to detect them over a single generation. Yet, with the growing number of trios and generations considered in recent studies, it would be of interest to quantify and describe those DNMs as well (e.g., <ref type="bibr">Belyeu et al., 2021;</ref><ref type="bibr">Thomas et al., 2021)</ref>. The development of accurate long-read sequencing technologies also offers opportunities for better detection of DNMs and de novo structural variants. Finally, most studies on nonhuman species only explore the autosomal chromosomes, largely because important filters such as allelic balance cannot be used on the sex chromosomes in both sexes. However, given the consistent differences observed between species in the rate of evolution on autosomes and sex chromosomes (e.g., Wilson <ref type="bibr">Sayres and Makova, 2011)</ref>, it would be very interesting to look more closely at the per-generation mutation rate on sex chromosomes.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Materials and methods</head></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Mutationathon sequences</head><p>The pedigree used for the Mutationathon was previously sequenced as part of a larger project on the mutation rate of rhesus macaques (BioProject: PRJNA588178; <ref type="bibr">Bergeron et al., 2021)</ref>. Nine lanes were used in this analysis (three lanes for the father and two lanes for the other individuals) and are publicly available on NCBI:</p><p>1. CL100066413_L01 (SRA run SRR10426295), mother M 2. CL100089164_L01 (SRA run SRR10426294), mother M 3. CL100078308_L01 (SRA run SRR10426275), father Noot 4. CL100078335_L01 (SRA run SRR10426264), father Noot 5. CL100078335_L02 (SRA run SRR10426253), father Noot 6. CL100066412_L02 (SRA run SRR10426291), offspring Heineken 7. CL100095002_L02 (SRA run SRR10426290), offspring Heineken 8. CL100066408_L01 (SRA run SRR10426256), next-generation offspring Hoegaarde 9. CL100094917_L01 (SRA run SRR10426255), next-generation offspring Hoegaarde A trimming step was done on all sequences to remove the adaptors (allowing a mismatch of two bases), the low-quality reads (with more than 5% of N bases or a base quality score &lt; 10 in more than 20% of the read), and the reads smaller than 60 bases after the quality control. Trimming was done using SOAPnuke (RRID:SCR_015025) version 1.5.6 <ref type="bibr">(Chen et al., 2018)</ref>, with the following command: &gt;SOAPnuke filter -f AAGT CGGA GGCC AAGC GGTC TTAG GAAGACAA -r AAGT CGGA TCGT AGCC ATGT CGTT CTGT GAGC CAAG GAGTTG -1 sequence_read_1-2 sequence_read_2 -Q 2l 10 -q 0.2 -E 60-5 0M 2 -o sequence_clean -C sequence_read_1_clean -D sequence_read_2_clean.</p><p>Each group implemented its pipeline to estimate a rate (details are provided in Table <ref type="table">2</ref>-source data 1).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Data analysis</head><p>The comparison of each individual filter was done using LB pipeline, changing one filter at a time and recalculating the number of candidates DNMs detected, the potential FP candidates with the manual curation method, the CG, the FNR on the allelic balance filter and site filters, and the mutation rate per site per generation. The comparison of the site filters was also done on the SNPs found by LB pipeline.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>PCR experiment and Sanger resequencing</head><p>We designed multiple sets of primers for the 43 candidate sites on NCBI primer blast tool <ref type="bibr">(Ye et al., 2012:</ref> <ref type="url">https://www.ncbi.nlm.nih.gov/tools/primer-blast/</ref>, RRID:SCR_003095). In some cases, sequencing primers were adjusted to avoid sequencing failure due to poly-AAA or TTT runs. PCRs were carried out in 25 &#956;L volumes (2.5 units Dream Taq DNA Polymerase [Thermo Scientific], 1X Dream Taq Green Buffer, 0.2 mM dNTPs, 2-3 mM MgCl 2 , 2.5-44 ng DNA template, filled to 25 &#956;L with double-distilled [ddH 2 O] water). Thermocycling was performed in a Bio-Rad PTC-100 thermocycler. The cycle program comprised an initial denaturation at 95&#176;C for 2 min, followed by 35 cycles of 15 s at 95&#176;C, 15 s at 52-55&#176;C, and 30 s at 72&#176;C. Cycling was terminated with a 5 min extension at 72&#176;C. PCR products were purified using commercially available spin columns (Invitek) or PureIT ExoZap PCR Clean-up (Ampliqon). Sanger sequencing was conducted at Eurofins Genomics, Europe, using the primers of the amplification procedure using both forward and reverse primers. In Figure <ref type="figure">3</ref>-source data 2, the chromatograms with the best base quality value are provided. Supplementary file 1d provides details about the primers and accession number of the sequences on GenBank.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>Data and code availability</head><p>All the sequences used for the Mutationathon were previously generated and released in NCBI <ref type="bibr">(Bergeron et al., 2021)</ref>. The sequences used were for the mother M (BioSample SAMN13230631): lanes CL100066413_L01 (SRA run SRR10426295) and CL100089164_L01 (SRA run SRR10426294); for the father Noot (BioSample SAMN13230623): lanes CL100078308_L01 (SRA run SRR10426275), CL100078335_L01 (SRA run SRR10426264), and CL100078335_L02 (SRA run SRR10426253); for the offspring Heineken (BioSample SAMN13230633): lanes CL100066412_L02 (SRA run SRR10426291) and CL100095002_L02 (SRA run SRR10426290); and for the second-generation offspring Hoegaarde (BioSample SAMN13230649): lanes CL100066408_L01 (SRA run SRR10426256) and CL100094917_ L01 (SRA run SRR10426255). The Sanger sequences generated during the PCR validation were deposited on GenBank under the accession numbers MZ661796-MZ662076.</p><p>The scripts used by the participants of the Mutationathon are publicly available:</p><p>&#8226; CV: <ref type="url">https://github.com/PfeiferLab/mutationathon</ref> (Versoza, 2021)</p><p>&#8226; RW: <ref type="url">https://github.com/Wang-RJ/mutationathon</ref>  <ref type="bibr">(Wang, 2021)</ref> &#8226; TT: <ref type="bibr">Wilfert et al., 2021</ref> &#8226; LB: <ref type="url">https://github.com/lucieabergeron/germline_mutation_rate</ref>  <ref type="bibr">(Bergeron, 2021)</ref> &#8226; SB: <ref type="url">https://github.com/besenbacher/GreatApeMutationRate2018</ref>  <ref type="bibr">(Besenbacher, 2019)</ref> </p></div><note xmlns="http://www.tei-c.org/ns/1.0" place="foot" xml:id="foot_0"><p>Bergeron et al. eLife 2022;11:e73577. DOI: https://doi.org/10.7554/eLife.73577</p></note>
		</body>
		</text>
</TEI>
