Author: Cole Wyeth

  • The next two AIXI Labs fellows have been selected: Michele Vannucci and Ravi Deedwania. Congratulations to both! Other applicants will automatically be reconsidered for future fellowship rounds (the next starts in December).

  • Rubi Hudson will talk about his AI safety research on the corrigibility transformation at the weekly UAI research meeting tomorrow, Monday Sept. 7th at 3 pm EDT. We will use the regular meets link (also in the calendar description). Bio: Rubi is a 5th year PhD student at the University of Toronto and research lead…

  • This is a guest post by Iliad. Our thanks to Marcus Hutter for the invitation to post here. TL;DR: Iliad runs funded training and research programs in mathematical AI alignment, and we think the UAI community is well prepared for them. Applications for the October and November Intensives are open (apply here). If the programs…

  • Aram Ebtekar, a returning speaker and founding research scientist at AIXI Labs, will present his (new) justification for Solomonoff induction at tomorrow’s regular research meeting, Monday July 13th at 3 pm EDT. Aram discusses the obstacle that No Free Lunch poses for developing a theory of generalization, and a practical sense in which Solomonoff induction,…

  • Anthony DiGiovanni, a researcher at the Center on Long-Term Risk, will talk to us about his Safe Pareto Improvements research agenda during an extra meeting tomorrow (Monday, July 6th), 3 pm EDT. We will use the regular zoom link. The Safe Pareto Improvements (SPI) agenda is intended to reduce the risks of catastrophic cooperation failures…

  • The first two AIXI Labs fellows have been selected: Yegon Kim and Gabriel Leuenberger. Congratulations to both! Yegon continues his work on model-free AIXI, while Gabriel studies embedded agency and Occam’s razor. Other applicants will automatically be reconsidered for future fellowship rounds (the next starts in September).

  • Marcus Hutter describes this new paper as “a short recap of the last ~15 publications over 5 years of the Universal Artificial Intelligence team” (at Google DeepMind): https://www.mdpi.com/1099-4300/28/6/596 Abstract: The success of large neural networks trained for sequential prediction via log-loss minimization over massive and diverse datasets has sparked debate regarding the fundamental limits of…

  • I am excited to announce that we are now offering fellowships at our new ASI safety org, AIXI Labs! Apply here: https://docs.google.com/forms/d/e/1FAIpQLSdpKSZKcMUZCkMaBncmbDSSdVcHKodDmdALUTOOheGF_NMHuQ/viewform?usp=publish-editor Focus. If you have been closely engaged with this community (or AIT, AIXI, and/or ML), you should consider applying! There is a good chance we can find a research match, since we are…

  • Professor Francesca Zaffora Blando will present her work on weak merging of opinions at the regular research meeting tomorrow, Monday April 27th, at 3 pm EDT. Francesca Zaffora Blando is an Assistant Professor in the Department of Philosophy at Carnegie Mellon University specializing in logic, formal epistemology, and the philosophy of science – particularly the…

  • Sven Neth will discuss his paper “Against Optimization” at an extra research meeting tomorrow, April 13th at 3 pm EDT, using the regular zoom link. This will be our second consecutive talk on AI safety (related topics)! Indeed, Sven’s paper was inspired by the limitations of “Consequences of Misaligned AI” by Zhuang and Hadfield-Menell, and…