Uploaded February 2022 | Updated September 2026, 2 weeks ago

---

#mlnews #muzero #nerf

Your regularly irregular updates on everything new in the ML world!
Merch: store.ykilcher.com

OUTLINE:
0:00 - Intro
0:15 - Sponsor: Weights & Biases
2:15 - Uber switches from XGBoost to Deep Learning for ETA prediction
5:45 - MuZero advances video compression
10:10 - Learned Soft Prompts can steer large language models
12:45 - Block-NeRF captures entire city blocks
14:15 - Neural Architecture Search considers underlying hardware
16:50 - Mega-Blog on Self-Organizing Agents
18:40 - Know Your Data (for Tensorflow Datasets)
20:30 - Helpful Things

Sponsor: Weights & Biases
wandb.me/yannic

References:
docs.wandb.ai/guides/integrations/other/openai
colab.research.google.com/github/wandb/examples/blob/master/colabs/openai/Fine_tune_GPT_3_with_Weights_%26_Biases.ipynb#scrollTo=rJdQqrC8Ablo
wandb.ai/borisd13/GPT-3/reports/Fine-Tuning-Tips-and-Exploration-on-OpenAI-s-GPT-3---VmlldzoxNDYwODA2

Uber switches from XGBoost to Deep Learning for ETA prediction
eng.uber.com/deepeta-how-uber-predicts-arrival-times/?utm_source=pocket_mylist

MuZero advances video compression
deepmind.com/blog/article/MuZeros-first-step-from-research-into-the-real-world
storage.googleapis.com/deepmind-media/MuZero/MuZero%20with%20self-competition.pdf

Learned Soft Prompts can steer large language models
ai.googleblog.com/2022/02/guiding-frozen-language-models-with.html
aclanthology.org/2021.emnlp-main.243

Block-NeRF captures entire city blocks
arxiv.org/abs/2202.05263
arxiv.org/pdf/2202.05263.pdf
waymo.com/intl/zh-cn/research/block-nerf

Neural Architecture Search considers underlying hardware
ai.googleblog.com/2022/02/unlocking-full-potential-of-datacenter.html
openaccess.thecvf.com/content/CVPR2021/papers/Li_Searching_for_Fast_Model_Families_on_Datacenter_Accelerators_CVPR_2021_paper.pdf

Mega-Blog on Self-Organizing Agents
developmentalsystems.org/sensorimotor-lenia
https://flowers.inria.fr/

Know Your Data (for Tensorflow Datasets)
knowyourdata-tfds.withgoogle.com/#dataset=pass&filters=kyd%2Fcloud_vision%2Fface_probability:9&tab=RELATIONS&item=train%5B89%25%3A91%25%5D_27143&expanded_groups=cloud_vision
knowyourdata.withgoogle.com

Helpful Things
twitter.com/casualganpapers/status/1490318575873241091
reddit.com/r/MachineLearning/comments/snmtzn/r_phd_thesis_on_neural_differential_equations
arxiv.org/abs/2202.02435
github.com/vicariousinc/PGMax
vicarious.com/posts/pgmax-factor-graphs-for-discrete-probabilistic-graphical-models-and-loopy-belief-propagation-in-jax/?utm_content=197542312&utm_medium=social&utm_source=twitter&hss_channel=tw-204185426
diambra.ai/tournaments
github.com/diambra/diambraArena
youtube.com/watch?v=dw72POyqcqk&t=271s
gitlab.com/deepcypher/python-fhez
python-fhez.readthedocs.io/en/latest
joss.theoj.org/papers/10.21105/joss.04101?s=09&utm_source=pocket_mylist
github.com/PyTorchLightning/metrics
torchmetrics.readthedocs.io/en/latest
twitter.com/alanyttian/status/1492027524909449221?utm_source=pocket_mylist
github.com/google/evojax
arxiv.org/abs/2202.05008
reddit.com/r/MachineLearning/comments/snod8f/n_gym_now_has_a_documentation_website/?utm_source=dlvr.it&utm_medium=twitter
https://www.gymlibrary.ml/pages/api/#initializing-environments

Links:
TabNine Code Completion (Referral): bit.ly/tabnine-yannick
YouTube: youtube.com/c/yannickilcher
Twitter: twitter.com/ykilcher
Discord: discord.gg/4H8xxDF
BitChute: bitchute.com/channel/yannic-kilcher
LinkedIn: linkedin.com/in/ykilcher
BiliBili: space.bilibili.com/2017636191

If you want to support me, the best thing to do is to share out the content :)

If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar: subscribestar.com/yannickilcher
Patreon: patreon.com/yannickilcher
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n