Latent Space
Latent Space
  • 107
  • 280 710
Beating Google at Search with Neural PageRank and $5M of H200s — with Will Bryk of Exa.ai
Building a new search engine on neural PageRank, why search should take 1 day, and why nap pods are important.
Timestamps
00:00:00 Introductions
00:01:12 ExaAI's initial pitch and concept
00:02:33 Will's background at SpaceX and Zoox
00:03:45 Evolution of ExaAI (formerly Metaphor Systems)
00:05:38 Exa's link prediction technology
00:09:20 Meaning of the name "Exa"
00:10:36 ExaAI's new product launch and capabilities
00:13:33 Compute budgets and variable compute products
00:14:43 Websets as a B2B offering
00:19:28 How do you build a search engine?
00:22:43 What is Neural PageRank?
00:27:58 Exa use cases
00:35:00 Auto-prompting
00:38:42 Building agentic search
00:44:19 Is o1 on the path to AGI?
00:49:59 Company culture and nap pods
00:54:52 Economics of AI search and the future of search technology
มุมมอง: 1 356

วีดีโอ

AI Engineering for Art - with comfyanonymous
มุมมอง 3.9K19 ชั่วโมงที่ผ่านมา
Full show notes: www.latent.space/p/comfyui Happy new year friends! Thanks for all the love on the Latent Space Live and 100th Episode End of Year recap. Your support has boosted us 30 places in the Podcast charts, and that always helps us book great guests and organize more industry events for you! We don't say this enough but thank you to everyone who has left a review on Apple Podcasts or su...
The State of Reasoning - from Nathan Lambert, Interconnects/AI2 [LS Live @ NeurIPS 2024]
มุมมอง 2.1Kวันที่ผ่านมา
We could not end LS Live coverage of 2024 without a special focus on Reasoning Models, so Nathan kindly stepped in at the last minute to offer his takes and recaps of the literature. We highly recommend Nathan's popular body of work on o1 and o1 likes: - www.interconnects.ai/p/openais-o1-using-search-was-a-psyop - www.interconnects.ai/p/openais-o3-the-2024-finale-of-ai - www.interconnects.ai/p/...
2024 Year in Review: The Big Scaling Debate, the Four Wars of AI, Top Themes and the Rise of Agents
มุมมอง 2.8Kวันที่ผ่านมา
00:00 Welcome to the 100th Episode! 00:19 Reflecting on the Journey 00:47 AI Engineering: The Rise and Impact 03:15 Latent Space Live and AI Conferences 09:44 The Competitive AI Landscape 21:45 Synthetic Data and Future Trends 35:53 Creative Writing with AI 36:12 Legal and Ethical Issues in AI 38:18 The Data War: GPU Poor vs. GPU Rich 39:12 The Rise of GPU Ultra Rich 40:47 Emerging Trends in AI...
Best of 2024 in Agents (from #1 on SWE-Bench Full, Prof. Graham Neubig of OpenHands/AllHands)
มุมมอง 10K14 วันที่ผ่านมา
latent.space/p/2024-agents Today, we have Graham Neubig’s return to the pod (his ICLR episode here!), now sitting at #1 on SWE-Bench Full, with his highly anticipated talk on the State of Agents! x.com/gneubig/status/1867207072464670999?s=46 Our next keynote covers The State of LLM Agents, with the triumphant return of Professor Graham Neubig of CMU and OpenDevin, now a startup known as AllHand...
Best of 2024: Synthetic Data / Smol Models, Loubna Ben Allal, HuggingFace [LS Live! @ NeurIPS 2024]
มุมมอง 1.4K14 วันที่ผ่านมา
latent.space/2024-syndata-smolmodels Loubna Ben Allal, who works on synthetic data and Smol Language Models at Huggingface, dropped by to drop knowledge on all the work of the year. Timestamps 00:00 Introduction and Overview 00:18 Synthetic Data in 2024 01:09 Synthetic Data in Pre-Training 02:57 Model Collapse Concerns 04:11 Synthetic Data Quality and Benchmarks 08:51 Rephrasing and Textbook Ge...
2024 in Post-Transformer Architectures: State Space Models, RWKV [Latent Space LIVE! @ NeurIPS 2024]
มุมมอง 13K14 วันที่ผ่านมา
latent.space/p/2024-post-transformers Eugene Cheah of Recursal/Featherless and Dan Fu of Together bring a concise 30 mins updating all the work on RWKV and State Space Models this year, and riff on some hot takes on long context vs RAG
Best of 2024: Open Models [LS LIVE! at NeurIPS 2024]
มุมมอง 2.2K21 วันที่ผ่านมา
latent.space/p/2024-open-models Our next keynote covers The State of Open Models in 2024 with Luca Soldani and Nathan Lambert of the Allen Institute for AI, with a special appearance from Dr. Sophia Yang of Mistral. Our first hit episode of 2024 was with Nathan Lambert on RLHF 201 back in January, where he discussed both reinforcement learning for language models and the growing post-training a...
Best of 2024 in Vision [LS Live @ NeurIPS]
มุมมอง 1.2K21 วันที่ผ่านมา
Peter Robicheaux and Isaac Robinson of Roboflow and Vik Korrapati at Moondream recap the best work of 2024 in frontier/open model vision work! slides and show notes: latent.space/p/2024-vision Recorded live with 200 in-person and 2200 online attendees at NeurIPS 2024, this keynote kicks off our mini-conference series exploring different domains of AI development in 2024.
The State of AI Startups in 2024 [LS Live @ NeurIPS]
มุมมอง 2.5K21 วันที่ผ่านมา
Latent Space LIVE presents our first keynote from NeurIPS 2024 in Vancouver - 'The State of AI Startups in 2024'. Sarah Guo (Conviction founder, No Priors host) and Pranav Reddy (Conviction partner) examine the evolving AI landscape and what it means for startups, enterprises, and the industry as a whole. slides and show notes: latent.space/p/2024-startups Recorded live with 200 in-person and 2...
Windsurf: The Enterprise AI IDE
มุมมอง 1.9K28 วันที่ผ่านมา
Our second podcast guest ever in March 2023 was Varun Mohan, CEO of Codeium; at the time, they had around 10,000 users and how they vowed to keep their autocomplete free forever: Today, over a million developers use their products, they still have their free tier, and they recently launched Windsurf, an AI IDE. 00:00:00: Introductions & Catchup 00:03:52: Why they created Windsurf 00:05:52: Limi...
[Paper Club] Weight Streaming on Wafer-Scale Clusters (w/ Sarah Chieng of Cerebras)
มุมมอง 322หลายเดือนก่อน
join us every wednesday lu.ma/ls Paper: f.hubspotusercontent30.net/hubfs/8968533/Virtual Booth Docs/CS Weight Streaming White Paper 111521.pdf
0 to over $8M ARR in 2 months as a Claude Wrapper (Bolt.new, Qodo)
มุมมอง 2.6Kหลายเดือนก่อน
0 to over $8M ARR in 2 months as a Claude Wrapper (Bolt.new, Qodo)
[Paper Club] Embeddings in 2024: OpenAI, Nomic Embed, Jina Embed, cde-small-v1 - with swyx
มุมมอง 846หลายเดือนก่อน
[Paper Club] Embeddings in 2024: OpenAI, Nomic Embed, Jina Embed, cde-small-v1 - with swyx
[Paper Club] DocETL: Agentic Query Rewriting + Eval for Complex Document Processing w Shreya Shankar
มุมมอง 234หลายเดือนก่อน
[Paper Club] DocETL: Agentic Query Rewriting Eval for Complex Document Processing w Shreya Shankar
The new Claude 3.5 Sonnet, Computer Use, and Building SOTA Agents - with Erik Schluntz, Anthropic
มุมมอง 3.2Kหลายเดือนก่อน
The new Claude 3.5 Sonnet, Computer Use, and Building SOTA Agents - with Erik Schluntz, Anthropic
[Paper Club] BERT: Bidirectional Encoder Representations from Transformers
มุมมอง 427หลายเดือนก่อน
[Paper Club] BERT: Bidirectional Encoder Representations from Transformers
Why Compound AI + Open Source will beat Closed AI - with Lin Qiao, CEO of Fireworks AI
มุมมอง 950หลายเดือนก่อน
Why Compound AI Open Source will beat Closed AI - with Lin Qiao, CEO of Fireworks AI
Agents @ Work: Lindy.ai (with live demo!)
มุมมอง 3.9Kหลายเดือนก่อน
Agents @ Work: Lindy.ai (with live demo!)
Agents @ Work: Dust.tt - with Stanislas Polu
มุมมอง 1.1K2 หลายเดือนก่อน
Agents @ Work: Dust.tt - with Stanislas Polu
[Paper Club] Intro to Diffusion Models and OpenAI sCM: Simple, Stable, Scalable Consistency Models
มุมมอง 4022 หลายเดือนก่อน
[Paper Club] Intro to Diffusion Models and OpenAI sCM: Simple, Stable, Scalable Consistency Models
In the Arena: How LMSys changed LLM Benchmarking Forever
มุมมอง 6012 หลายเดือนก่อน
In the Arena: How LMSys changed LLM Benchmarking Forever
[Paper Club] Upcycling Large Language Models into Mixture of Experts
มุมมอง 4392 หลายเดือนก่อน
[Paper Club] Upcycling Large Language Models into Mixture of Experts
How NotebookLM Was Made
มุมมอง 2.3K2 หลายเดือนก่อน
How NotebookLM Was Made
Singapore: the AI Engineer Nation - with Minister Josephine Teo
มุมมอง 1.9K2 หลายเดือนก่อน
Singapore: the AI Engineer Nation - with Minister Josephine Teo
[Paper Club] SWE-Bench [OpenAI Verified/Multimodal] + MLE-Bench with Jesse Hu
มุมมอง 3492 หลายเดือนก่อน
[Paper Club] SWE-Bench [OpenAI Verified/Multimodal] MLE-Bench with Jesse Hu
Building the Silicon Brain - Drew Houston of Dropbox
มุมมอง 1.1K2 หลายเดือนก่อน
Building the Silicon Brain - Drew Houston of Dropbox
[Paper Club] Molmo + Pixmo + Whisper 3 Turbo - with Vibhu Sapra, Nathan Lambert, Amgadoz
มุมมอง 4722 หลายเดือนก่อน
[Paper Club] Molmo Pixmo Whisper 3 Turbo - with Vibhu Sapra, Nathan Lambert, Amgadoz
Production AI Engineering starts with Evals
มุมมอง 2.3K3 หลายเดือนก่อน
Production AI Engineering starts with Evals
[Paper Club] Berkeley Function Calling Paper Club! - Sam Julien, Writer
มุมมอง 4333 หลายเดือนก่อน
[Paper Club] Berkeley Function Calling Paper Club! - Sam Julien, Writer

ความคิดเห็น

  • @ishangoswami9462
    @ishangoswami9462 วันที่ผ่านมา

    🔥🔥🔥

  • @rotors_taker_0h
    @rotors_taker_0h วันที่ผ่านมา

    So many tools in that direction. Many focused on specific aspects (mostly scientific research, probably because it has somewhat higher quality sources by default and also more difficult questions), Elicit already mentioned, another one is undermind, which I find absolutely awesome and they have exactly that interface: you talk with LLM first which helps you to narrow down your request and then set it off to crawl the papers for minutes and come back to a whole report with timeline, sources, citations, key people, etc. Also, what I always wanted from search and what was mentioned briefly: citation graphs, i.e. when we have some influential piece, like Founder Mode, I would like to see reactions to that, scientific literature style -- who mentions it, criticizes it, builds upon it, etc. Another, aspect that wasn't touched: how much of information is in the videos. Like, will Exa (or any other tool) will be able to ever find the list of emails Swyx once flashed on a stream when I ask to find his contact information? Will it be smart enough to try to find it if I ask for contacts of people who interviewed people who like search? :) Will exa ever find me as a person interested in search based on that comment to add to a pool of recruits? Anyway, great interview, great work and hope we'll get to yes to all the above questions and superhuman search :)

  • @SearchingForSounds
    @SearchingForSounds วันที่ผ่านมา

    When you fire up ComfyUi , during the book sequence you will eventually hit a quote. These quotes speak about the pursuit of art, being an artist, being brave and taking action. Reading them, I knew this software was special.

  • @sabuein
    @sabuein 2 วันที่ผ่านมา

    Thank you.

  • @explorer945
    @explorer945 2 วันที่ผ่านมา

    I just did a search on looking for specific posts on both Perplexity and Exa API, I got exactly what I am looking on Perplexity but 0 on Exa API. So, I am not sure how much I can trust this neural search. Maybe keyword is probably better search which even costs less. Even DeepSeek V3 chat was better. It seems like the limitation is what does their search index have at this point.

  • @sucim
    @sucim 3 วันที่ผ่านมา

    Great great talk and discussion! I'm excited to see what the triumvirate of Tri Dao, Albert Gu and Dan Fu are up to in the future. To me they are the next generation of Ilya, Alec and Vasvani et al.

  • @chrisellis-ai
    @chrisellis-ai 3 วันที่ผ่านมา

    Did you post that doc somewhere?

  • @MegaAbecedarian
    @MegaAbecedarian 4 วันที่ผ่านมา

    This was great. I'm amazed by how quickly the open source democratization of AI is going. A lot of people are investing a lot of money in AI to control something that is not controllable.

    • @xaviermagnus8310
      @xaviermagnus8310 3 วันที่ผ่านมา

      We thought that about the internet but looked at how they massacred our boy.

  • @KiWelten
    @KiWelten 4 วันที่ผ่านมา

    Now i want to see how automatic1111 kohya and forgeui looks like :D

    • @lefourbe5596
      @lefourbe5596 2 วันที่ผ่านมา

      FORGEui (also the mind behind controlnet and IC light) is illyasviel. he have his own website profile were you see his photo

  • @nekodificador
    @nekodificador 5 วันที่ผ่านมา

    Wait, is not an anime girl?

  • @JasminUwU
    @JasminUwU 5 วันที่ผ่านมา

    Perhaps the solution is to combine all the architectures into one big Frankenstein model, and name the paper Diversity Is All You Need. I'm just spitballing, but it seems funny enough to be true.

    • @xaviermagnus8310
      @xaviermagnus8310 3 วันที่ผ่านมา

      Individually none of us is as crappy as all of us combined.

  • @ChanhDucTuong
    @ChanhDucTuong 5 วันที่ผ่านมา

    Thank you very much man. I love ComfyUI.

  • @jorgenolck897
    @jorgenolck897 6 วันที่ผ่านมา

    AMD, hook this guy up with some hardware.

  • @BlackMita
    @BlackMita 6 วันที่ผ่านมา

    Comfortable

  • @canchem9825
    @canchem9825 6 วันที่ผ่านมา

    I myself too got addicted to generating "images" back in the automatic1111 days.

  • @imresomodi4961
    @imresomodi4961 6 วันที่ผ่านมา

    Thank you for your service, comfy. Love your project, and after investing some time, I got used to it after 1111. : ) Hope it will be around for years to come.

  • @DanielE-s1t
    @DanielE-s1t 6 วันที่ผ่านมา

    Amazing! Thank you for the interview.

  • @Adam-kx9gi
    @Adam-kx9gi 6 วันที่ผ่านมา

    now that Comfy has been on camera, i wonder if he would ever consider doing his own videos about comfyui?

    • @JohnSane
      @JohnSane 6 วันที่ผ่านมา

      May be only me but i prefer him to work on comfy and let others do the pr.

    • @noisylatent
      @noisylatent 3 วันที่ผ่านมา

      not everyone needs to be a streamer... what is wrong with this culture... yuck, groomer

  • @noodlesunreal
    @noodlesunreal 6 วันที่ผ่านมา

    Thank you for the interview. Too bad the lack of preparation from the interviewers. It could be more informative with better questions and knowledge from them. But thank you!!

    • @LatentSpacePod
      @LatentSpacePod 5 วันที่ผ่านมา

      Any specific questions you wish we asked? Any specific part where you think we didn't have the right knowledge? That'd help us be better. Thanks!

    • @noodlesunreal
      @noodlesunreal 5 วันที่ผ่านมา

      @@LatentSpacePod Hi yes!i BTW my comment was without hate, just constructive criticism. For example: where is the platform going?, what is happening this year in relation to comfy?also thoughts about how to keep the Open source AI movement alive, what new things are happening? Thank You

  • @KingTine724
    @KingTine724 6 วันที่ผ่านมา

    Synatic data works from .... synthetic capability haha get it ...

  • @TSCspeedruns
    @TSCspeedruns 6 วันที่ผ่านมา

    This guy is a legend.

  • @baheth3elmy16
    @baheth3elmy16 6 วันที่ผ่านมา

    Finally, we see the big brain behind Comfy.. Thank you very much for the interview...

  • @Warley.Araujo
    @Warley.Araujo 7 วันที่ผ่านมา

    Great Interview

  • @tenofaz
    @tenofaz 7 วันที่ผ่านมา

    Amazing interview!! Thanks!!

  • @draken5379
    @draken5379 7 วันที่ผ่านมา

    Gradio also seems to send way to many http requests, like if you change a single drop down, often it would need a whole http request. Which kinda totally defeats the concept of a frontend UI.

  • @natecodesai
    @natecodesai 7 วันที่ผ่านมา

    That was revealing ^^ nice to put a personality to the name I type into my terminal so often. This interview feels historic.

  • @burnytech
    @burnytech 8 วันที่ผ่านมา

    <3

  • @simonstrandgaard5503
    @simonstrandgaard5503 8 วันที่ผ่านมา

    Great interview.

  • @RyanWilliams1729
    @RyanWilliams1729 9 วันที่ผ่านมา

    Long time podcast listener but am loving the TH-cam versions, the extra work is appreciated!

    • @LatentSpacePod
      @LatentSpacePod 8 วันที่ผ่านมา

      thanks for watching! trying ot figure out this youtube game lol

  • @user-pt1kj5uw3b
    @user-pt1kj5uw3b 9 วันที่ผ่านมา

    A coding forward agent will scale much better as models get better too.

  • @GNARGNARHEAD
    @GNARGNARHEAD 9 วันที่ผ่านมา

    the RWKV approach makes so much sense with what we're seeing with distillations, why not just run in through an RNN

  • @KevinKreger
    @KevinKreger 9 วันที่ผ่านมา

    Great coverage. More of these shorter pieces

  • @EkShunya
    @EkShunya 10 วันที่ผ่านมา

    where can i get a hold of the google docs ?, it would be really helpful

  • @jeanpaulniko
    @jeanpaulniko 10 วันที่ผ่านมา

    Consciousness is. We’ve got it backwards. Consciousness is the thing that exists and the stuff in the World is all properties of it. There is only one consciousness and we are an outcropping of it. The thing that animates us is consciousness. Consciousness is life. They are one and the same. Consciousness has amassed the stuff of this observable universe by layering that spark, by stacking it. The steps taken at each point of transition or stage are neither geometric nor exponential. Logarithms will not suffice to describe it, nor the complex field or fractal dimensions. That is because there is an inner quality that is doubling- and for the word doubling, which is a specific quantization, we may substitute an overflow of life energy(or call it probability distributions), if you want to call it that. Life-consciousness has been compounding while we transit or go through the process of something that we perceive as temporal flow. The metric for this compounding, this complexification is determined entirely by the medium under the knife. It is a meta level operator. We experience it as Darwinian evolution in the context of motile organic molecules and the compounding of these. Time and space are models built by consciousness stepwise, but these steps are more like the drag of a snail because they are continuous, not discreet. We have to re-root our conceptual reality. The things we think we are and have are just projections of what actually is. So it is clear we are a unitary thing like sprites growing on a giant stalk. There is no graviton. Gravity is the lowest rung on the ladder, it is the first step of consciousness. Gravity is the shape of the universe. It is the simplest, most direct, most fundamental exposition of life-consciousness. So now we see that it is gravity-life-consciousness, because these are one and the same. They are like the incarnations of Hindu gods- all manifestations of the same essential being. Reasoning itself is the emergent property. Where did the desire to reason come from. And how do you explain the feeling of the experience.? How this works is beyond the human brain‘s ability to understand, and one has the bear in mind, that the mind has to harness the brain into its creative acts. Biology or technology, it’s beyond dimensionality. Try to imagine if the Meta level of things had a Meta itself. We are talking about something orthogonal to dimensionality. Nevertheless we can make sense of the observable universe. The Social mind is more powerful than the other minds combined because it can override them with the weight of its conclusions against theirs. What the Sociel mind decides is final until extenuating circumstances intervene.

  • @AlexJohnson-g4n
    @AlexJohnson-g4n 10 วันที่ผ่านมา

    Nathan's recap is impressive. His focus on the nuances of o1 and o3 iterations, and reinforcement finetuning, truly enriches our understanding. Check out his work on Interconnects!

  • @ShresthShukla-h9n
    @ShresthShukla-h9n 11 วันที่ผ่านมา

    how can we collaborate

  • @rolandgraser523
    @rolandgraser523 12 วันที่ผ่านมา

    hey guys, you mentioned 1:02:00 that we can find the slides in the description. however, they're not there rn. can you share the link? thanks!! awesome wrap!

    • @LatentSpacePod
      @LatentSpacePod 11 วันที่ผ่านมา

      our editor got it wrong a bit - no slides but a prep doc docs.google.com/document/d/1fvx5Bj6osG3dCPnLxtq4PLG-lSqJ4Up7Kb6tveYpJ1U/edit?usp=sharing docs.google.com/document/d/1iWKxONNW3t3moTzPknbE6p4c3ldEf-fArIDdP_2icVY/edit?usp=sharing

    • @rolandgraser523
      @rolandgraser523 10 วันที่ผ่านมา

      @@LatentSpacePod that's perfect, thanks!

  • @AlexJohnson-g4n
    @AlexJohnson-g4n 12 วันที่ผ่านมา

    Congrats on 100 episodes! Reflecting on AI's rise is crucial. The journey of AI engineering and legal/ethical issues sets the stage for future trends.

  • @KingTine724
    @KingTine724 12 วันที่ผ่านมา

    15.25 what about R1 from deepseek and their latest version o deepseek 3?

  • @KingTine724
    @KingTine724 12 วันที่ผ่านมา

    Hey what about the R1 from Deepseek 😅

  • @LatentSpacePod
    @LatentSpacePod 12 วันที่ผ่านมา

    audio and newsletter: www.latent.space/p/2024-review

  • @praxis22
    @praxis22 12 วันที่ผ่านมา

    First! 😊

    • @LatentSpacePod
      @LatentSpacePod 10 วันที่ผ่านมา

      and nobody can take that away from you

  • @odanabunaga2505
    @odanabunaga2505 12 วันที่ผ่านมา

    ah weeding out those quadratic time functions from the codebase

  • @odanabunaga2505
    @odanabunaga2505 12 วันที่ผ่านมา

    great interview, guys. It's a true pleasure listening to Erik talk in very human terms about the subject. also big props to the interviewers for not interrupting ;)

  • @austin917
    @austin917 13 วันที่ผ่านมา

    very cool

  • @NimaRazavi
    @NimaRazavi 14 วันที่ผ่านมา

    Here after Sam Altman's tweet about Alex Radford.

  • @gregoryguytarr
    @gregoryguytarr 16 วันที่ผ่านมา

    super talk!

  • @coolsebz
    @coolsebz 16 วันที่ผ่านมา

    really good talk, thanks! Super helpful to see the whole recap of what got us here and what's next on the horizon!

  • @Δέλτα-ε7ν
    @Δέλτα-ε7ν 17 วันที่ผ่านมา

    22:45😂

  • @hailrider8188
    @hailrider8188 17 วันที่ผ่านมา

    Long context is absolutely needed for software code bases. Alternative is RAG but there are still issues with RAG when it comes to software.