​​Are Pop Lyrics Getting More Repetitive?

Well-written article on pop music analysis. Is the repetitiveness in songs rising? Does it influence song popularity?

Article contains well-designed and illustrated research.

Link: https://pudding.cool/2017/05/song-repetition/

#popularDS #researh #statistics #vizualization

​​Measuring the Effects of Data Parallelism on Neural Network Training

Important paper from Google on large batch optimization. They do impressively careful experiments measuring iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises.

There is rather long and throughtful twitter thread about the paper.

Twitter thread: https://twitter.com/RogerGrosse/status/1066392375570894849
ArXiV: https://arxiv.org/abs/1811.03600
Telegra.ph for instant view: https://telegra.ph/Roger-Grosses-thread-on-Measuring-the-Effects-of-Data-Parallelism-on-Neural-Network-Training-11-24

🎓 Free «Advanced Deep Learning and Reinforcement Learning» course.

#DeepMind researchers have released video recordings of lectures from «Advanced Deep Learning and Reinforcement Learning» a course on deep RL taught at #UCL earlier this year.

YouTube Playlist: https://www.youtube.com/playlist?list=PLqYmG7hTraZDNJre23vqCGIVpfZ_K2RZs

#course #video #RL #DL

Beard length A/B testing on #Tinder


https://appsciencing.wordpress.com/2018/11/19/beard-studies/

#abtest #statistics #practicalML

🎓Amazon have released its Free Machine Learning #course.

Course consits of 30+ digital ML classes totaling 45+ hours, aiming for improving skills of different roles: from Data Platform Engineer to Business Decision Maker.

Link: https://aws.amazon.com/ru/training/learning-paths/machine-learning/

#Amazon #ML #MOOC

QUESTION ANSWER ARCHITECTURES – SQUAD 2.0 + U-NET

Stanford Question Answering Dataset (SQuAD) is a reading comprehension dataset, consisting of questions posed by crowdworkers on a set of Wikipedia articles, where the answer to every question is a segment of text, or span, from the corresponding reading passage, or the question might be unanswerable.

Artilce provides easy intro into NLP, covering very basic methods and defenitions.


Link: https://betterlearningforlife.com/2018/11/16/question-answer-architectures-squad-2-0-u-net/

#NLP #QA #SQuAD #novice

Google’s open source Active Question Reformulation with Reinforcement Learning


Project: https://ai.googleblog.com/2018/10/open-sourcing-active-question.html
Github: https://github.com/google/active-qa
Publication: https://ai.google/research/pubs/pub46733

#nlp #qa #google #opensource

Visual Model-Based Reinforcement Learning as a Path towards Generalist Robots

Model-based RL, from pixels, controlling a robot and generalizing to new objects (clothing, toys, etc.). All trained with unsupervised interaction!

Article: https://bair.berkeley.edu/blog/2018/11/30/visual-rl/

#RL #CV

Deep Counterfactual Regret Minimization

Modification to the tabular CFR algorithm popular for games like poker to use deep learning function approximation.

ArXiV: https://arxiv.org/abs/1811.00164

#NIPS2018 #RL #GamesTheory

​​STACL: Simultaneous Translation with Integrated Anticipation and Controllable Latency

Baidu technology presented at #NIPS2018

Website: https://simultrans-demo.github.io
ArXiV: https://arxiv.org/abs/1810.08398

#NLP #translation #Baidu

​​🔥 AlphaFold: Using AI for scientific discovery.

#DeepMind has significally improved protein folding prediction.

Protein folding is important because it allows to predict function along with the functioning mechanism.

Website: https://deepmind.com/blog/alphafold/
Guardian: https://www.theguardian.com/science/2018/dec/02/google-deepminds-ai-program-alphafold-predicts-3d-shapes-of-proteins

#bioinformatics #alphafold #genetics

Optimizing Siri on HomePod in Far‑Field Settings

New post by #Apple ML team

https://machinelearning.apple.com/2018/12/03/optimizing-siri-on-homepod-in-far-field-settings.html

#Siri #DL #homeassistant

The Data Science Workflow

Article giving a full setup for #DS #workflow. How to train, evaluate, deploy and monitor performance of a model

Medium link: https://medium.com/@kt.era.ee/the-data-science-workflow-43859db0415

#practicalML

​​Live demo of GAN paint brush

Now you can paint with textures on any images, drawing buildings, doors and complex objects by selecting an area where you want to draw an object. The #GAN takes care of merging part into the picture.

Link: http://gandissect.res.ibm.com/ganpaint.html

​​Dimensionality reduction for visualizing single-cell data using UMAP

UMAP is an t-SNE replacement for #visualization.

UMAP is being increasingly accepted as a powerful tool for visualizing single cell datasets. This paper compares UMAP to #TSNE

While UMAP is unquestionably better than default t-SNE in preserving global structure, it's worth mentioning that (very recently) it was shown that this limitation of t-SNE appears to be addressable with better parameters/initialization.

Article link: https://www.nature.com/articles/nbt.4314

​​Papers from #DeepMind panel at #NIPS2018

Work on radiotherapy planning: https://arxiv.org/abs/1809.04430
Triaging eye diseases: https://www.nature.com/articles/s41591-018-0107-6
Probabilistic U-net: https://arxiv.org/abs/1806.05034

#segmentation #CV #Unet

FAIR turns five: What we’ve accomplished and where we’re headed

#Facebook AI Research group report on the work done.

Link: https://code.fb.com/ai-research/fair-fifth-anniversary/

​​Probabilistic Image Segmentation

Re-implementation of the model described in «A Probabilistic U-Net for Segmentation of Ambiguous Images».

ArXiV: https://arxiv.org/abs/1806.05034
Github: https://github.com/SimonKohl/probabilistic_unet

Imitation by watching YouTube

Learning features from YouTube videos through self-supervision allows us to solve hard exploration games in Atari.

Paper: https://papers.nips.cc/paper/7557-playing-hard-exploration-games-by-watching-youtube.pdf
Youtube: https://www.youtube.com/watch?v=s8ZSVfYmtpc&feature=youtu.be

#RL #YouTube

Forensic Deep Learning: Kaggle Camera Model Identification Challenge

Report on Kaggle solution on camera model identification.

Link: https://towardsdatascience.com/forensic-deep-learning-kaggle-camera-model-identification-challenge-f6a3892561bd

#CV #Kaggle