Machine Learning Blog | ML@CMU | Carnegie Mellon University

machine learning natural language processing Research

Differentiable Reasoning over Text

by Bhuwan Dhingra / May 15, 2020

We all rely on search engines to navigate the massive amount of online information published every day. Modern search engines not only retrieve a list of pages relevant to a query but often try to directly answer our questions by analyzing the content of those pages. One area they currently struggle at, however, is multi-hop Question Answering that requires reasoning with information taken from multiple documents to arrive at the answer. For example, suppose that we want to find out What is the size of the COVID-19 virus?.…

18 6644 1
Read More

machine learning reinforcement learning Research

Unsupervised Meta-Learning: Learning to Learn without Supervision

May 1, 2020

The history of machine learning has largely been a story of increasing abstraction. In the dawn of ML, researchers spent considerable effort engineering features. As deep learning gained popularity, researchers then shifted towards tuning the update rules and learning rates…

31 3097 1

machine learning Research

Learning DAGs with Continuous Optimization

April 10, 2020

Can we build a bridge between the left and right hand side? As datasets continually increase in size and complexity, our ability to uncover meaningful insights from unstructured and unlabeled data is crucial. At the same time, a premium has…

43 13786

machine learning natural language processing Research

Are Sixteen Heads Really Better than One?

March 20, 2020

Since their inception in this 2017 paper by Vaswani et al., transformer models have become a staple of NLP research. They are used in machine translation, language modeling, and in general in most recent state-of-the-art pretrained models (Devlin et al.…

39 4650 1

Educational

Questions to Ask a Prospective Ph.D. Advisor on Visit Day, With Thorough and Forthright Explanations

March 2, 2020

These are my (@andrewkuznet) opinions, formed by being a SCS PhD student at Carnegie Mellon University in the US. This post is meant as a followup to a poster I made in 2019 with the help of many people. Following…

59 9641 1

machine learning Research

Inherent Tradeoffs in Learning Fair Representations

February 28, 2020

With the prevalence of machine learning applications in high-stakes domains (e.g., criminal judgment, medical testing, online advertising, etc.), it is crucial to ensure that these decision-support systems do not propagate existing bias or discrimination that might exist in historical data.…

47 3956

machine learning Research

RL for Planning and Planning for RL

February 13, 2020

The figure above illustrates the method:(a) Goal-conditioned RL often fails to reach distant goals, but can successfully reach the goal if starting nearby (inside the green region). (b) Our goal is to use observations in our replay buffer (yellow squares)…

51 4937 1

machine learning Research

RoboNet: A Dataset for Large-Scale Multi-Robot Learning

November 26, 2019

In the last decade, we’ve seen learning-based systems provide transformative solutions for a wide range of perception and reasoning problems, from recognizing objects in images to recognizing and translating human speech. Recent progress in deep reinforcement learning (i.e. integrating deep…

73 6037

machine learning Research

ARUBA: Learning-to-Learn with Less Regret

November 22, 2019

In the classical machine learning setup, we aim to learn a single model for a single task given many training samples from the same distribution. However, in many practical applications, we are in fact exposed to several distinct yet related…

76 5478

Educational federated learning machine learning

Federated Learning: Challenges, Methods, and Future Directions

November 12, 2019

What is federated learning? How does it differ from traditional large-scale machine learning, distributed optimization, and privacy-preserving data analysis? What do we understand currently about federated learning, and what problems are left to explore? In this post, we briefly answer…

72 13743

Older Posts

Machine Learning Blog | ML@CMU | Carnegie Mellon University

Statistics:

Categories: