333K subscribers • 5 videos on Hallway
Intermediate. Assumes working knowledge.
104K views5 years ago1 recommendation
AI and machine learningNeural networks and deep learningTransformers and LLMsComputer vision
Yannic Kilcher provides an in-depth explanation of OpenAI's DALL-E model, covering its architecture, VQ-VAE, and text-to-image generation.
#openai #science #gpt3 OpenAI's newest model, DALL·E, shows absolutely amazing abilities in generating high-quality images from arbitrary text descriptions. Like GPT-3, the range of applications and the diversity of outputs is astonishing, given that this is a single model, trained on a purely autoregressive task. This model is a significant step towards the combination of text and images in future AI applications. OUTLINE: - Introduction - Overview - Dataset - Comparison to GPT-3 - Model Architecture - VQ-VAE - Combining VQ-VAE with GPT-3 - Pre-Training with Relaxation - Experimental Results - My Hypothesis about DALL·E's inner workings - Sparse Attention Patterns - DALL·E can't count - DALL·E can't global order - DALL·E renders different views - DALL·E is very good at texture - DALL·E can complete a bust - DALL·E can do some reflections, but not others - DALL·E can do cross-sections of some objects - DALL·E is amazing at style - DALL·E can generate logos - DALL·E can generate bedrooms - DALL·E can combine unusual concepts - DALL·E can generate illustrations - DALL·E sometimes understands complicated prompts - DALL·E can pass part of an IQ test - DALL·E probably does not have geographical / temporal knowledge - Reranking dramatically improves quality - Conclusions & Comments Blog: openai.com/blog/dall-e/ Links: TabNine Code Completion (Referral): bit.ly/tabnine-yannick YouTube: youtube.com/c/yannickilcher Twitter: twitter.com/ykilcher Discord: discord.gg/4H8xxDF BitChute: bitchute.com/channel/yannic-kilcher Minds: minds.com/ykilcher Parler: parler.com/profile/YannicKilcher LinkedIn: linkedin.com/in/yannic-kilcher-488534136/ If you want to support me, the best thing to do is to share out the content :) If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this): SubscribeStar: subscribestar.com/yannickilcher Patreon: patreon.com/yannickilcher Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2 Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4nWhat people say. Recommended as a detailed, in-depth explanation of the inner workings of OpenAI's DALL-E model.
u/oORocketOoin r/programming • Recommends
On “OpenAI's DALL·E - Generate images from just text descriptions, but how good is it?”