Robust sampling for weak lensing and clustering analyses with the Dark Energy Survey

DES Collaboration

Research output: Contribution to journalArticlepeer-review

19 Scopus citations

Abstract

Recent cosmological analyses rely on the ability to accurately sample from high-dimensional posterior distributions. A variety of algorithms have been applied in the field, but justification of the particular sampler choice and settings is often lacking. Here, we investigate three such samplers to motivate and validate the algorithm and settings used for the Dark Energy Survey (DES) analyses of the first 3 yr (Y3) of data from combined measurements of weak lensing and galaxy clustering. We employ the full DES Year 1 likelihood alongside a much faster approximate likelihood, which enables us to assess the outcomes from each sampler choice and demonstrate the robustness of our full results. We find that the ellipsoidal nested sampling algorithm MULTINEST reports inconsistent estimates of the Bayesian evidence and somewhat narrower parameter credible intervals than the sliced nested sampling implemented in POLYCHORD. We compare the findings from MULTINEST and POLYCHORD with parameter inference from the Metropolis–Hastings algorithm, finding good agreement. We determine that POLYCHORD provides a good balance of speed and robustness for posterior and evidence estimation, and recommend different settings for testing purposes and final chains for analyses with DES Y3 data. Our methodology can readily be reproduced to obtain suitable sampler settings for future surveys.

Original languageEnglish
Pages (from-to)1184-1199
Number of pages16
JournalMonthly Notices of the Royal Astronomical Society
Volume521
Issue number1
DOIs
StatePublished - May 1 2023

Funding

Based in part on observations at Cerro Tololo Inter-American Observatory at NSF’s NOIRLab (NOIRLab Prop. ID 2012B-0001; PI: J. Frieman), which is managed by the Association of Universities for Research in Astronomy (AURA) under a cooperative agreement with the National Science Foundation. This work was supported through computational resources and services provided by the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231; and by the Sherlock cluster, supported by Stanford University and the Stanford Research Computing Center. Funding for the DES Projects has been provided by the U.S. Department of Energy, the U.S. National Science Foundation, the Ministry of Science and Education of Spain, the Science and Technology Facilities Council of the United Kingdom, the Higher Education Funding Council for England, the National Center for Supercomputing Applications at the University of Illinois at Urbana-Champaign, the Kavli Institute of Cosmological Physics at the University of Chicago, the Center for Cosmology and Astro-Particle Physics at the Ohio State University, the Mitchell Institute for Fundamental Physics and Astronomy at Texas A&M University, Financiadora de Estudos e Projetos, Fundação Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro, Conselho Nacional de Desenvolvimento Científico e Tecnológico and the Ministério da Ciência, Tecnologia e Inovação, the Deutsche Forschungsgemeinschaft and the Collaborating Institutions in the Dark Energy Survey. PL acknowledges STFC Consolidated Grants ST/R000476/1 and ST/T000473/1. NW is supported by the Chamberlain fellowship at Lawrence Berkeley National Laboratory. This manuscript has been authored by Fermi Research Alliance, LLC under Contract No. DE-AC02-07CH11359 with the U.S. Department of Energy, Office of Science, Office of High Energy Physics. PL acknowledges STFC Consolidated Grants ST/R000476/1 and ST/T000473/1. NW is supported by the Chamberlain fellowship at Lawrence Berkeley National Laboratory. The analysis used the software tools SCIPY (Jones et al. 2001), NUMPY (Oliphant 2006), MATPLOTLIB (Hunter 2007), CAMB (Lewis et al. 2000; Howlett et al. 2012), GETDIST (Lewis 2019), MULTINEST (Feroz & Hobson 2008; Feroz et al. 2009, 2019), POLYCHORD (Handley et al. 2015a, b), ANESTHETIC (Handley 2019), and COSMOSIS (Zuntz et al. 2015). Elements of the DES modelling pipeline additionally use COSMOLIKE (Krause & Eifler 2017), HALOFIT (Bird, Viel & Haehnelt 2012; Takahashi et al. 2012), FAST-PT (McEwen et al. 2016), and NICAEA (Kilbinger et al. 2009). This work was supported through computational resources and services provided by the National Energy Research Scientific Computing Center (NERSC), a U.S. Department of Energy Office of Science User Facility operated under Contract No. DE-AC02-05CH11231; and by the Sherlock cluster, supported by Stanford University and the Stanford Research Computing Center. Funding for the DES Projects has been provided by the U.S. Department of Energy, the U.S. National Science Foundation, the Ministry of Science and Education of Spain, the Science and Technology Facilities Council of the United Kingdom, the Higher Education Funding Council for England, the National Center for Supercomputing Applications at the University of Illinois at Urbana-Champaign, the Kavli Institute of Cosmological Physics at the University of Chicago, the Center for Cosmology and Astro-Particle Physics at the Ohio State University, the Mitchell Institute for Fundamental Physics and Astronomy at Texas A&M University, Financiadora de Estudos e Projetos, Fundação Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro, Conselho Nacional de Desenvolvimento Científico e Tecnológico and the Ministério da Ciência, Tecnologia e Inovação, the Deutsche Forschungsgemeinschaft and the Collaborating Institutions in the Dark Energy Survey. The Collaborating Institutions are Argonne National Laboratory, the University of California at Santa Cruz, the University of Cambridge, Centro de Investigaciones Energéticas, Medioambientales y Tecnológicas-Madrid, the University of Chicago, University College London, the DES-Brazil Consortium, the University of Edinburgh, the Eidgenössische Technische Hochschule (ETH) Zürich, Fermi National Accelerator Laboratory, the University of Illinois at Urbana-Champaign, the Institut de Ciències de l’Espai (IEEC/CSIC), the Institut de Física d’Altes Energies, Lawrence Berkeley National Laboratory, the Ludwig-Maximilians Universität München and the associated Excellence Cluster Universe, the University of Michigan, NSF’s NOIRLab, the University of Nottingham, The Ohio State University, the University of Pennsylvania, the University of Portsmouth, SLAC National Accelerator Laboratory, Stanford University, the University of Sussex, Texas A&M University, and the OzDES Membership Consortium. Based in part on observations at Cerro Tololo Inter-American Observatory at NSF’s NOIRLab (NOIRLab Prop. ID 2012B-0001; PI: J. Frieman), which is managed by the Association of Universities for Research in Astronomy (AURA) under a cooperative agreement with the National Science Foundation. The DES data management system is supported by the National Science Foundation under Grant Numbers AST-1138766 and AST-1536171. The DES participants from Spanish institutions are partially supported by MICINN under grants ESP2017-89838, PGC2018-094773, PGC2018-102021, SEV-2016-0588, SEV-2016-0597, and MDM-2015-0509, some of which include ERDF funds from the European Union. IFAE is partially funded by the CERCA program of the Generalitat de Catalunya. Research leading to these results has received funding from the European Research Council under the European Union’s Seventh Framework Program (FP7/2007-2013) including ERC grant agreements 240672, 291329, and 306478. We acknowledge support from the Brazilian Instituto Nacional de Ciência e Tecnologia (INCT) do e-Universo (CNPq grant 465376/2014-2). This manuscript has been authored by Fermi Research Alliance, LLC under Contract No. DE-AC02-07CH11359 with the U.S. Department of Energy, Office of Science, Office of High Energy Physics. The DES data management system is supported by the National Science Foundation under Grant Numbers AST-1138766 and AST-1536171. The DES participants from Spanish institutions are partially supported by MICINN under grants ESP2017-89838, PGC2018-094773, PGC2018-102021, SEV-2016-0588, SEV-2016-0597, and MDM-2015-0509, some of which include ERDF funds from the European Union. IFAE is partially funded by the CERCA program of the Generalitat de Catalunya. Research leading to these results has received funding from the European Research Council under the European Union’s Seventh Framework Program (FP7/2007-2013) including ERC grant agreements 240672, 291329, and 306478. We acknowledge support from the Brazilian Instituto Nacional de Ciência e Tecnologia (INCT) do e-Universo (CNPq grant 465376/2014-2).

FundersFunder number
ANESTHETIC
Brazilian Instituto Nacional de Ciência e Tecnologia
CAMB2012, 2015a
Collaborating Institutions are Argonne National Laboratory
Collaborating Institutions in the Dark Energy Survey
FAST-PT
Fermi Research Alliance, LLCDE-AC02-07CH11359
HALOFIT
Institut de Ciències de l’Espai
Mitchell Institute for Fundamental Physics and Astronomy at Texas A&M University
NICAEA2009
Science and Technology Facilities Council of the United Kingdom
National Science FoundationAST-1138766, AST-1536171
U.S. Department of Energy
University of Illinois at Urbana-Champaign
Stanford University
Office of ScienceDE-AC02-05CH11231
High Energy Physics
Fermilab
Lawrence Berkeley National Laboratory
University of California, Santa Cruz
University of Pennsylvania
Ohio State University
University of Chicago
University of Michigan
Texas A and M University2012B-0001
University of Portsmouth
National Centre for Supercomputing Applications
Seventh Framework Programme
SLAC National Accelerator Laboratory
Higher Education Funding Council for England
National Energy Research Scientific Computing Center
Stanford Research Computing Center, Stanford University
Science and Technology Facilities CouncilST/R000476/1, ST/T000473/1
University College London
European Commission
European Research Council240672, 306478, 291329
University of Nottingham
University of Sussex
University of Edinburgh
Deutsche Forschungsgemeinschaft
Generalitat de Catalunya
Eidgenössische Technische Hochschule Zürich
Ministério da Ciência, Tecnologia e Inovação
Conselho Nacional de Desenvolvimento Científico e Tecnológico465376/2014-2
Fundação Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro
Financiadora de Estudos e Projetos
Ministerio de Ciencia e InnovaciónSEV-2016-0588, SEV-2016-0597, MDM-2015-0509, PGC2018-094773, PGC2018-102021, ESP2017-89838
Ludwig-Maximilians-Universität München
Instituto Nacional de Ciência e Tecnologia para Excitotoxicidade e Neuroproteção
Ministry of Education and Science of Ukraine
European Regional Development Fund
Neurosciences Foundation
Institut de Física d'Altes Energies

    Keywords

    • cosmological parameters
    • cosmology: observations
    • large-scale structure of the Universe
    • methods: statistical

    Fingerprint

    Dive into the research topics of 'Robust sampling for weak lensing and clustering analyses with the Dark Energy Survey'. Together they form a unique fingerprint.

    Cite this