- 7
- 34 097
Antoine Guédon
เข้าร่วมเมื่อ 6 มี.ค. 2023
Edit and Animate Your Own 3D Captures with The SuGaR x Frosting Blender Add-On
Using our methods SuGaR (CVPR 2024) or Gaussian Frosting (ECCV 2024), you can reconstruct editable meshes from RGB images or RGB videos, and render them using realistic Gaussian Splatting rendering.
We now provide a Blender Add-On to edit, sculpt, combine or animate 3D scenes reconstructed with SuGaR of Frosting and render them with Gaussian Splatting without a single line of code.
Please take a look at the following pages for downloading the code and get more information about the add-on:
SuGaR webpage: anttwo.github.io/sugar/
Gaussian Frosting webpage: anttwo.github.io/frosting/
Blender Add-On GitHub page: github.com/Anttwo/sugar_frosting_blender_addon
Thank you!
We now provide a Blender Add-On to edit, sculpt, combine or animate 3D scenes reconstructed with SuGaR of Frosting and render them with Gaussian Splatting without a single line of code.
Please take a look at the following pages for downloading the code and get more information about the add-on:
SuGaR webpage: anttwo.github.io/sugar/
Gaussian Frosting webpage: anttwo.github.io/frosting/
Blender Add-On GitHub page: github.com/Anttwo/sugar_frosting_blender_addon
Thank you!
มุมมอง: 2 043
วีดีโอ
CVPR 2024 - SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction
มุมมอง 2.5K7 หลายเดือนก่อน
Official video presenting our work for the virtual platform of CVPR 2024. Please visit our dedicated webpage for further information about our paper SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering. anttwo.github.io/sugar/ Authors: Antoine Guédon and Vincent Lepetit.
Gaussian Frosting: Editable Complex Radiance Fields with Real-Time Rendering
มุมมอง 8K9 หลายเดือนก่อน
Official presentation video for Gaussian Frosting: Editable Complex Radiance Fields with Real-Time Rendering. Authors: Antoine Guédon and Vincent Lepetit
Viewer Presentation - SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction
มุมมอง 3.6K11 หลายเดือนก่อน
Presentation video for the viewer built for SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering. Code is available (please check Anttwo on GitHub). Authors: Antoine Guédon and Vincent Lepetit
SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction
มุมมอง 17Kปีที่แล้ว
Official presentation video for SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering. Authors: Antoine Guédon and Vincent Lepetit
CVPR 2023 - MACARONS: Mapping And Coverage Anticipation with RGB ONline Self-supervision
มุมมอง 338ปีที่แล้ว
Official video presenting our work for the virtual platform of CVPR 2023. Please visit our dedicated webpage for further information about our paper MACARONS: Mapping And Coverage Anticipation with RGB ONline Self-supervision by Antoine Guédon, Tom Monnier, Pascal Monasse and Vincent Lepetit: imagine.enpc.fr/~guedona/MACARONS/
MACARONS: Mapping And Coverage Anticipation with RGB ONline Self-supervision
มุมมอง 945ปีที่แล้ว
A video that illustrates how our approach MACARONS explores and reconstructs large 3D structures. Paper: MACARONS: Mapping And Coverage Anticipation with RGB ONline Self-supervision Authors: Antoine Guédon, Tom Monnier, Pascal Monasse and Vincent Lepetit
SUPER TRAVAIL ANTOINE !! mais comment installer Sugar sur windows,?
Is there a way you can make a video game out of this?
Very cool. Is it possible to get shadows in Sugar or would that have to be composited in after rendering? That's really the main thing that makes the renders look less convincing. Thanks for the tools
nice development
This is a game changer
Amazing! Can you elaborate about the license of this addon? Can I use it for commercial use?
which app to scan?
The park bench with the bike looks like the same test render that’s been used in a bunch of papers about Gaussian Splatting so that’s my guess for how they made the meshes
Wow!
Really neat!
bien sympa comme vidéo :)
can we make the dancing buzz a meme?
Definitely, you have my full support
Excellent work!
Thanks !!
cool! thanks for this
could you wrap it up in a colab file?
There is an exellent detalization!!!
I didn't test Sugar yet. But I compared JawSet PostShot and 3DF Zephyr. Zephyr gives higher texture resolution, but have great troubles with the surface without pattern. Jawset PostShot glithes sometimes, but it is official beta. So, the main request: extracting mesh for mirror and glass surfaces and surfaces without pattern. 3DF Zephyr makes high quality mesh with rough textured surfaces. So, with the example at 1:39 3DF Zephyr should work well.
But the algorithm from this video is very interesting. I hope, it helps me to make perfect reconstruction of architecture.
Wonderful hopefuly the code will availabel soon 😊
Thank you so much! Yes, the code is finally available along with a Blender add-on for editing scenes and render them using Frosting ☺
Thank you for adding good lofi mix to this, I think this should become the standard for abstract videos 😎
great contribution!
Whats the best settings for the camera for SuGar
very nice work!😀
Hi Antoine! One question? what is the better way to import to blender? with the OBJ? is possible to have this process as an addon inside blender?
th-cam.com/video/xHNTS41RkXg/w-d-xo.htmlsi=sZEh33YrEimP-H_2
Amazing guys! Great work! I was waiting this for long!
Very nice work guys 👏🏻👌🏻
amazing!!
Hi Antoine, what phone did you use?
What camera did you use?
wow!! awesome
Impressive
The problem with this video is that we can't really see clearly the result, everything is spinning too fast, the frame rate is too low to be clear and then the scene is over in just a few seconds
oh wow great 3d mesh from Gausion Splatting
An app of the dream!
Bravo. Est ce qu'il est possible d'extraire le fichier hybride afin de l'importer dans UNREAL ou un software 3D afin de le combiner à d'autres éléments 3D sans les inconvénients du fichier Gaussian original (trandparence ect...)? 🙏
how can i edit and use glaussian splats in blender ??
gallantmon looking fine af
A man of culture! Indeed 👌
awesome!
is there any way to make this mesh extraction through google colab? i don't have a gpu with cuda on my computer.
Let me just humely rais my hand and ask for your Attention so taht i may express my out most respected. Is it just me but did you guys just make 3DGS not just a pretty face but actually usefull. Amazing. I wish i was smart enough to understand how this work but for me its black macic. 🎉
Thanks for this!!
Hmm, but you end up losing the advantage of Spherical Harmonics, right? This brings it back down to polygonal rendering, if I'm understanding it correctly. (Not to undermine the work as it's probably still going to be far better than photogrammetry in casual captures).
Hi @tmibtruemakers, that's an interesting question! Actually, we do not lose any advantage of Gaussian Splatting rendering, and we still use Spherical Harmonics. Our hybrid representation is somewhat a new rendering method for polygons, which uses thin 3D Gaussians equipped with Spherical Harmonics to reproduce view-dependency. Indeed, we first designed an algorithm to extract surfaces (in other words, polygons, you're right) from Gaussian Splatting representations. After that, we propose a refinement strategy that builds a hybrid representation "Mesh + 3D Gaussians on the surface", as we suggest in the video. This hybrid representation includes 3D Gaussians that are rendered with the Gaussian Splatting rasterizer: Just like vanilla 3D Gaussian Splatting, each Gaussian has a set of Spherical Harmonics that helps to reproduce view dependency in colors. The cool thing is, if you move or animate the mesh, the Gaussians will follow! Because meshes make sculpting, rigging and segmenting easier, we believe this can help animation and edition in Gaussian Splatting scenes.
@@antoineguedon Thanks for answering, and now that you mention it, it's actually clarified in the video, too. I guess I wasn't paying enough attention. If you've already accounted for it, that makes this technique so robust. Great work! Hope you continue to pioneer such contributions!
Les choses se passent plus vite que prévu.
Please make a tutorial
We released the code a few days ago! The GitHub page provides some help to install and run the model, but I will add detailed tutorials in a near future
yeah baby make them move
Awesome work!
Love it! Is there/will there be a paper describing this work? Looking forward to it.
Thank you for your nice words! Yes, we actually published the paper on arXiv a few weeks ago, and released the code a few days ago. There is also a dedicated webpage, feel free to check it out! Just look for "sugar antoine guedon" on Google ☺
wow... compliments!!
Does anyone know if it has already been released? If not, does anyone know when it will be released? :o
We released the code a few days ago (just look for "sugar antoine guedon" on Google)! The scripts for composition/animation are still missing right now, as I have some cleaning to do. But for reconstructing scenes and extracting 3D meshes, everything is here!
really interested to see how system resource hungry this well be ! super exciting news !! thanks !!
You're joking! Oh, man. Brilliant work. Thanks for showing it.