No abstract

Large language models have been shown to achieve remarkable performance across a variety of natural language tasks using few-shot learning, which drastically reduces the number of task-specific training examples needed to adapt the model to a particular application. To further our understanding of the impact of scale on few-shot learning, we trained a 540-billion parameter, densely activated, Transformer language model, which we call Pathways Language Model (PaLM).We trained PaLM on 6144 TPU v4 chips using Pathways, a new ML system which enables highly efficient training across multiple TPU Pods. We demonstrate continued benefits of scaling by achieving state-ofthe-art few-shot learning results on hundreds of language understanding and generation benchmarks. On a number of these tasks, PaLM 540B achieves breakthrough performance, outperforming the finetuned stateof-the-art on a suite of multi-step reasoning tasks, and outperforming average human performance on the recently released BIG-bench benchmark. A significant number of BIG-bench tasks showed discontinuous improvements from model scale, meaning that performance steeply increased as we scaled to our largest model. PaLM also has strong capabilities in multilingual tasks and source code generation, which we demonstrate on a wide array of benchmarks. We additionally provide a comprehensive analysis on bias and toxicity, and study the extent of training data memorization with respect to model scale. Finally, we discuss the ethical considerations related to large language models and discuss potential mitigation strategies. * Equal Contribution. Author contributions and ordering details are listed in Appendix A.

The Greenland and Antarctic Ice Sheets cover ~\n10% of global land surface, but are rarely considered as active components of the global iron cycle. The ocean waters around both ice sheets harbour highly productive coastal ecosystems, many of which are iron limited. Measurements of iron concentrations in subglacial runoff from a large Greenland Ice Sheet catchment reveal the potential for globally significant export of labile iron fractions to the near-coastal euphotic zone. We estimate that the flux of bioavailable iron associated with glacial runoff is 0.40–2.54 Tg per year in Greenland and 0.06–0.17 Tg per year in Antarctica. Iron fluxes are dominated by a highly reactive and potentially bioavailable nanoparticulate suspended sediment fraction, similar to that identified in Antarctic icebergs. Estimates of labile iron fluxes in meltwater are comparable with aeolian dust fluxes to the oceans surrounding Greenland and Antarctica, and are similarly expected to increase in a warming climate with enhanced melting.

Background In laboratory animals, exposure to most general anaesthetics leads to neurotoxicity manifested by neuronal cell death and abnormal behaviour and cognition. Some large human cohort studies have shown an association between general anaesthesia at a young age and subsequent neurodevelopmental deficits, but these studies are prone to bias. Others have found no evidence for an association. We aimed to establish whether general anaesthesia in early infancy affects neurodevelopmental outcomes. Methods In this international, assessor-masked, equivalence, randomised, controlled trial conducted at 28 hospitals in Australia, Italy, the USA, the UK, Canada, the Netherlands, and New Zealand, we recruited infants of less than 60 weeks' postmenstrual age who were born at more than 26 weeks' gestation and were undergoing inguinal herniorrhaphy, without previous exposure to general anaesthesia or risk factors for neurological injury. Patients were randomly assigned (1:1) by use of a web-based randomisation service to receive either awake-regional anaesthetic or sevoflurane-based general anaesthetic. Anaesthetists were aware of group allocation, but individuals administering the neurodevelopmental assessments were not. Parents were informed of their infants group allocation upon request, but were told to mask this information from assessors. The primary outcome measure was full-scale intelligence quotient (FSIQ) on the Wechsler Preschool and Primary Scale of Intelligence, third edition (WPPSI-III), at 5 years of age. The primary analysis was done on a per-protocol basis, adjusted for gestational age at birth and country, with multiple imputation used to account for missing data. An intention-totreat analysis was also done. A difference in means of 5 points was predefined as the clinical equivalence margin. This completed trial is registered with ANZCTR, number ACTRN12606000441516, and ClinicalTrials.gov, number NCT00756600. Findings Between Feb 9, 2007, and Jan 31, 2013, 4023 infants were screened and 722 were randomly allocated: 363 (50%) to the awake-regional anaesthesia group and 359 (50%) to the general anaesthesia group. There were 74 protocol violations in the awake-regional anaesthesia group and two in the general anaesthesia group. Primary outcome data for the per-protocol analysis were obtained from 205 children in the awake-regional anaesthesia group and 242 in the general anaesthesia group. The median duration of general anaesthesia was 54 min (IQR 41-70). The mean FSIQ score was 99•08 (SD 18•35) in the awake-regional anaesthesia group and 98•97 (19•66) in the general anaesthesia group, with a difference in means (awake-regional anaesthesia minus general anaesthesia) of 0•23 (95% CI-2•59 to 3•06), providing strong evidence of equivalence. The results of the intention-to-treat analysis were similar to those of the per-protocol analysis. Interpretation Slightly less than 1 h of general anaesthesia in early infancy does not alter neurodevelopmental outcome at age 5 years compared with awake-regional anaesthesia ...

After birth, preterm infants face a stressful environment, which may negatively impact early brain development and subsequent neurobehavioral outcomes. This randomized controlled trial involving 45 women with infants Ͻ30-wk gestation, assessed the effectiveness of training parents in reducing stressful experiences. Intervention consisted of 10 sessions in the Neonatal Intensive Care Unit (NICU). Postintervention, at term-equivalent (40-wk postmenstrual age), magnetic resonance imaging (MRI) was performed to evaluate brain structure and development. Quantitative volumetric techniques were used to estimate overall and regional brain volumes for different tissue types including CSF, CGM, DNGM, UWM, and MWM. DTI was used to evaluate the integrity and maturation of white matter by ADC and FA. Maturation and connectivity of white matter, characterized by diffusion MR measures of ADC and FA, were significantly enhanced in the intervention group, who displayed greater restriction in ADC and increase in FA. There were no significant effects on either brain volumes or on short-term medical outcomes. Thus, sensitivity training for parents in the NICU is associated with improved cerebral white matter micro-structural development in preterm infants. (Pediatr Res 67: 330-335, 2010)