While 2021 was a difficult year due to the pandemic, it was also a year full of advancements in the field of AI. Louis Bouchard has compiled a great list with the best research papers that were published during the year.
2021 saw the trend of tele-working and studying remotely, prompting a number of institutions and academics to open up their research and classes to the wide public and not just their students. Examples of free content that I reported on include:
Stanford's Introduction to Robotics
Stanford's Natural Language Processing with Deep Learning
Stanford- Machine Learning with Graphs using PyTorch and NetworkX
University of Wisconsin Madison-STAT 453 Introduction to Deep Learning and Generative Models
Heinrich Heine Universität Düsseldorf - Machine Learning Lecture WS 2021/22
Memorial University - Computer Science 3200 Fall 2021 - Intro to Artificial Intelligence
Making Friends with Machine Learning - a previously internal-only Google course specially created to inspire beginners and amuse experts
You'll find all the links listed under Relevant Articles.
When going through research papers, on arXiv or otherwise, most of the time you have to go through hoops to get to the accompanying source code. For that I looked at CatalyzeX, a browser extension, available for Chrome and Firefox, that does that for you.
There's no need to worry though about Louis's list since, for each paper, he links to the related code. That aside, he's also made videos explaining the concepts behind the research. This one is for this first in the list:
The list is comprised of 38 papers:
 DALL·E: Zero-Shot Text-to-Image Generation from OpenAI
 VOGUE: Try-On by StyleGAN Interpolation Optimization
 Taming Transformers for High-Resolution Image Synthesis
 Thinking Fast And Slow in AI
 Automatic detection and quantification of floating marine macro-litter in aerial images
 ShaRF: Shape-conditioned Radiance Fields from a Single View
 Generative Adversarial Transformers
 We Asked Artificial Intelligence to Create Dating Profiles. Would You Swipe Right?
 Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
 Image GANS meet differentiable rendering for inverse graphics and interpretable 3d neural rendering
 Deep nets: What have they ever done for vision?
 Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Image
 Portable,Self-Contained Neuroprosthetic Hand with Deep Learning-Based Finger Control
 Total Relighting: Learning to Relight Portraits for Background Replacement
 LASR: Learning Articulated Shape Reconstruction from a Monocular Video
 Enhancing Photorealism Enhancement
 DefakeHop: A Light-Weight High-Performance Deepfake Detector
 High-Resolution Photorealistic Image Translation in Real-Time: A Laplacian Pyramid Translation Network
 Barbershop: GAN-based Image Compositing using Segmentation Masks
 TextStyleBrush: Transfer of text aesthetics from a single example
 Animating Pictures with Eulerian Motion Fields
 CVPR 2021 Best Paper Award: GIRAFFE - Controllable Image Generation
 GitHub Copilot & Codex: Evaluating Large Language Models Trained on Code
 Apple: Recognizing People in Photos Through Private On-Device Machine Learning
 Image Synthesis and Editing with Stochastic Differential Equations
 Sketch Your Own GAN
 Tesla's Autopilot Explained
 Styleclip: Text-driven manipulation of StyleGAN imagery
 TimeLens: Event-based Video Frame Interpolation
 Diverse Generation from a Single Video Made Possible
 Skillful Precipitation Nowcasting using Deep Generative Models of Radar
 The Cocktail Fork Problem: Three-Stem Audio Separation for Real-World Soundtracks
 ADOP: Approximate Differentiable One-Pixel Point Rendering
 (Style)CLIPDraw: Coupling Content and Style in Text-to-Drawing Synthesis
 SwinIR: Image restoration using swin transformer
 DALL·E: Zero-Shot Text-to-Image Generation from OpenAI OpenAI successfully trained a network able to generate images from text captions.
 VOGUE: Try-On by StyleGAN Interpolation Optimization Google used a modified StyleGAN2 architecture to create an online fitting room where you can automatically try-on any pants or shirts you want using only an image of yourself.
 Image GANS meet differentiable rendering for inverse graphics and interpretable 3d neural rendering This promising model called GANverse3D only needs an image to create a 3D figure that can be customized and animated!
 Portable,Self-Contained Neuroprosthetic Hand with Deep Learning-Based Finger Control With this AI-powered nerve interface,the amputee can control a neuroprosthetic hand with life-like dexterity and intuitiveness:
 CVPR 2021 Best Paper Award: GIRAFFE - Controllable Image Generation Using a modified GAN architecture, they can move objects in the image without affecting the background or the other objects
 GitHub Copilot & Codex: Evaluating Large Language Models Trained on Code Generates Code From Words!
 Sketch Your Own GAN Make GANs training easier for everyone by generating Images following a sketch! Control your GAN’s outputs based on the simplest type of knowledge you could provide it: hand-drawn sketches.
You can literally spend hours going through that list watching the videos and skimming through the papers. A great list indeed.
In closing up I would like to suggest another free resource that appeared on GitHub at the end of 2021, a free book called The Deep Learning Interviews book: Hundreds of fully solved job interview questions from a wide range of key topics in AI.
To mark 25 years since it was first released on March 20, 1998 curl 8.0.0 has shipped today, something that its originator and lead maintainer Daniel Stenberg, aka Badger, had said would never ha [ ... ]
I have to admit I have a small passion for freaky clocks. They used to be hard to make, but now with powerful single-board computers and low cost displays they are not so difficult and the fun is inve [ ... ]