Huge ChatGPT Upgrade - Introducing “Canvas”
ฝัง
- เผยแพร่เมื่อ 4 ต.ค. 2024
- Here's a breakdown and some testing of ChatGPT's new Canvas feature.
Try Vultr by visiting getvultr.com/berman and use promo code "BERMAN300" for $300 off your first 30 days.
Join My Newsletter for Regular AI Updates 👇🏼
www.matthewber...
My Links 🔗
👉🏻 Main Channel: / @matthew_berman
👉🏻 Clips Channel: / @matthewbermanclips
👉🏻 Twitter: / matthewberman
👉🏻 Discord: / discord
👉🏻 Patreon: / matthewberman
👉🏻 Instagram: / matthewberman_ai
👉🏻 Threads: www.threads.ne...
👉🏻 LinkedIn: / forward-future-ai
Media/Sponsorship Inquiries ✅
bit.ly/44TC45V
Will you use this feature?
There are a few more days left to win the Dell Monitor in our giveaway: gleam.io/q8wkK/dell-nvidia-monitor-2
NA only
Already have. Be warned about broad rules based changes on large text blocks. I had a handful of mis capitalized sentences and it went crazy after asking it to "go through the text and correct capitalization errors".
I am actually super excited. This will make it soo much more easy to use. I remember my frustrations about trying to write out my thoughts and how chatgpt kept missing details. I feel like this feature will make it easier for me to add and change. And the models themselves should also get better at paying attention to details and formulate with less mistakes and asking the user more and stuff like that
Unfortunately it actually can't handle large code snippets, after a few code changes (about 500 lines) it starts to truncate the output inside the Canvas and there is no button like "Continue Creating", chat sure everything is ok. So I had to work in the old mode.
You knew it was coming...
AND They STILL cannot see socialism yet
thank you for not making a cut every 2s, this makes watching your videos much more enjoyable !
I couldn't help but notice some blinding transitions though...
Agree
8:13 the the mysterious hand appears over you shoulder, love it
Well... Time to write a science fiction book with Canvas! 😎🤖
Hey! What are you up to? I am in the same mood! Actually some weeks ago I started to sketch something similar to this canvas feature for writing and now I feel a bit frustrated with this but it is what it is. Now hands on!
Platform risk is everywhere ... If you build a large Twitter following but then get banned. If you run an eBay business and your account is closed. If you work on any of the freelancer platforms. If you are a popular TH-camr and you get shadow banned or shut down.
this is just fire.. thanks for keeping us updated in the rapid exponential growth of AI space.
This building on platform in a way is why Zuckerberg is so intent of building his own platform after being out maneuvered
True words regarding "platforms"
Key Takeaways:
1. OpenAI has introduced "Canvas," a new feature designed to improve collaboration with ChatGPT, particularly for writing and coding projects.
2. Canvas offers real-time editing by allowing users to open a separate window where they can request targeted changes to text or code, moving beyond a single chat interface.
3. Currently available to pro and enterprise users, Canvas will be extended to free users once the beta phase is over.
4. Canvas is tailored for both writing and coding, offering features like editing suggestions, adjusting reading levels, fixing bugs, and converting code into different languages.
5. GPT-4 has been specially trained to recognize when and how to use Canvas for these tasks, enhancing its effectiveness.
6. The video demonstrates Canvas being used for testing, bug fixing, adding logs, and creative writing, including making edits like adjusting length or complexity.
7. The creator highlights a potential concern for companies relying on OpenAI’s platform, as Canvas might pose a competitive challenge to AI-based businesses built on its technology.
8. During testing, Canvas is shown to handle bug fixing and log adding but occasionally modifies more code than necessary.
9. It also supports creative writing by offering options for refining text, adjusting tone, and even adding emojis or final polish.
10. Viewers are encouraged to share their thoughts on Canvas and the potential platform risks for AI companies dependent on OpenAI’s API.
Nice AI summary!
@@cycologist8615 you are very welcome
In terms of risks. I think it depends on what you build. If you just add AI capabilities into your own application that is just enhanced by it, you're fine.
But if you want to build an app when you literally just chat with it, I don't see much future
Great comment about the risk of using platforms! Thanks for sharing!
Claude 3.5 sonnet is still the superior coder. This is a band-aid to drum up excitement. The underlying model is still 4o and still less adept at coding than 3.5 sonnet.
I can see this getting expensive for them, for every single new change request it appears to me that their model re-reads the entire chat history and I can already see loads of people doing request over request without starting a new chat. One could already see the latency going up after several changes...
They will either have to heavily restrict the maximum number of questions per day, heavily subsidise this or start a scheme were they charge you for each question. But maybe I'm wrong and they developed something that is able to kompress the old messages efficiently or they aggressively delete older changes (for the LLM not the user) and only bring them back if a user specifically interacts with them again.
If I were a cynical person I would say they are working towards a future where users get hooked on those models and can no longer work without them and then the payday begins, I mean there has to be some reason why the entire ethical department left OpenAI together with many other key people in OpenAI. From the outside it looks like every person with a conscience leaves them and goes to competitors like Anthropic.
It’s the chance when you build off a platform companies technology stack. Sam Altman has been addressing this very subtly for several years now. It’s not just about features; it’s about the whole package that a company offers. Including presentation and customer service. Small companies needs to find ways to deferential themselves from the pack.
The platform bit in the beginning truly should be on everyones mind - providing "just an API" and see the internet build on top has the highest risk of over-night competition anywhere... You build in secret everything that you know your API is asked and as you enhance your API, you know what works and what doesn't.
I love ai so much, especially knowing how fast its improving!
it does generate the whole code again ( with new fancy fx that shows the part you marked changing in live mode ), just like Cursor, no new technology in here, it's same as you copied your whole code to gpt and asked it the same question, it will generate the whole code with ONLY the part you mentioned
Totally agree about platform risk. I've lived through the same storyline.
It’s the chance when you build off a platform companies technology stack. Sam Altman has been addressing this very subtly for several years now. It’s not just about features; it’s about the whole package that a company offers. Including presentation and customer service. Small companies needs to find ways to deferential themselves from the pack.
the thing you mentioned, that OpenAi would steal the data and be a competitor, is the exact same thing, which amazon has done in the past and is still doing, copying and rebranding ..... so yeah, the fear is justified
ChatGPT is becoming better and better. Very impressive
That was quick
Canvas is a great update for a starter. I'm looking forward to re-working the whole context window.
Canvas is a huge step in the right direction! Can’t wait to see what it is in 12 months!
The trick to reducing risk of platform changes is to always create your own API that sits between your code and theirs. Then you write some simple test code using your API that only lightly tests the basic features, and make sure it works. This is not a replacement for unit tests. Rather think of it as part of your API. Finally, implement your own version of that API that produces the same results as the platform you are wrapping. If the platform ever disappears, you will have a fixed target for the functionality you need to recover, and can easily farm out that work if needed. And perhaps best of all, even if you never need to move away from the platform, you will have an easy way to prove who is responsible when your product suddenly breaks. If it's still broken when you use your test implementation, it's your bug; but if that fixes it, it's the platform's bug and you can prove it without even giving them your code.
So this canvas functionality is a supervised fuctionality, where basically we are now giving even more feedback to openai to help them improve on what chatgpt does not do well enough initially. Let s see where that goes
I'm a big fan of formal software requirements. I'd really like to see that capability added. It should take a general description of what I want and make formal "the system shall..." or "the page shall...." etc. It should maintain that list and write the code against it. It should be able to write tests that verify the requirements, iterate when they fail, and refactor code if requirements change.
Love Canvas 🎉 Coding is so much fun now
Great contents, as always. Thank you. I may be that with Canvas built-in the system will use less token comparing to the classic chat conversation one.
The functionality may be basic but I suspect that for many of us, it will be all we need.
This is an awesome feature!
Being able to switch to Turtle like that, with a UI like that, is nothing I've ever seen before. Ugh, I might have to use ChatGPT again...
Wow, openAI decided that the way Anthropic does things is better. I guess the best for of flattery "IS" mimicry. :-D
I'm skeptical about canvas (though version 1 has a few good parlor tricks). How many apps are realistically 1 file? When I wrote my screenplay(years ago), I worked in a file per act. Until the very end. Curious if canvas can handle the hollywood screenplay standard format (which native gpt can't). More anxious to get my Pythagora account turned on. But if that doesn't happen soon... Keep up the good work, MB!
Platform risk is at an all time high. If you aren't prepared to create and leverage your own platform, you're definitely at risk of going out of style.
That's actually sick
OMG canvas is soo good. However using gpt-4o with canvas has way less reasoning ability than o1-preview. I tried making a python program and canvas/4o was consistently not able to correct a mistake where it called a function before it declared it. I copied the program into a new instance of o1 preview and it fixed it immediately and like a boss. I liken it to trying to explain a complex issue to someone with a different first language. I can't wait until o1 and canvas are combined!
I literally find out about the new features because all my ChatGPT tabs have to re-auth lol
Currently, this sucks. If you don’t say ‘open the document’ it will insist that that’s not a feature in ChatGPT. If you ask how to open it in the canvas, it’ll also insist that’s not a feature. It attempts to edit what you want and fails, to the point where it can no longer edit anything anymore. I ended up starting 3 new chats because it wouldn’t edit and failed to let me open it in canvas too.
It might be a good idea to discuss corporate governance laws. It's annoying for the platform to compete against their own customers but is it within the scope of governmental power to prevent them from doing it?
I loved your story about strawberries with intelligence 😝🍓
Other plateform like cursor should finetune their own model or else they will lose
OpenAI has moved to a for-profit company, so yeah, building on top of them is exactly like your experience building on an API company. Bill Gates has already said that in the near future AI models will be worthless. There will be so many options, and the physical constraints (energy / $ to train) will be so large that they will all reach the same level. The value won't be in the models themselves, but in what you do with the models. If OpenAI wants to make money, they will definitely use their software to that end.
Sam has warned that if you are just building a wrapper around OpenAI you may not be successful longterm.
It's like an out of control jr. dev...
Was just playing with this its great
OpenAI is a massive platform risk! There is a reason why Google did not build on Microsoft Windows in the 90s.
I like it, but I want the ability to have different tabs open for different code files. Similar to how an IDE or text editor works
I hope they update the Mac app to use it also soon. I like working in the Mac app much better than in the webapp.
Your content is so good.
Love from India 🇮🇳
They call it sherlocking
This is part amazing and part frustrating because this feature of a canvas is very helpful and has an enormous potential, however, it is frustrating for those small software developing agencies that come up with great ideas and are quickly surpassed or burned by open AI resources. What they are doing is to compete with openAI, at the end, from my point of view, small developing agencies will only be training playgrounds for talented people that in the future will be bought by openAI mergers
How close are we to graphic designer end users being able to edit source code to make GIMP UI and features to be a useful alternative to Photoshop
Reverse Engineering System will be here soon in full force
I like this new feature. You'd obviously like it to write the code as you want the first time but that's just not realistic even with humans. It got tedious and cluttered having to copy the code or sections of code back into your conversation without canvas. Good to see the conversation separate from what you're working on.
What tools do you use to manage your entire code base. GPT-4o and Claude can’t keep track of changes across multiple modules over time
nice
im concerned about model fragmentation. 4o series has canvas and advanced voice. o1 series has reasoning fine tune. they need to converge all their capabilities under one model.
When is the desktop app for Windows going to be released?
We need +5D workforce now😅
The UX design of the canvas mode here doesn't look right... E.g., language translation - why is it not a dropdown list?
so far this seems a mess to me. I've put 350line php form page, and asked to add a simple button to switch values of two fields, and it just skipped large portions of my code, and after several prompts restored lenght of the code but still parts missing and page wasn't working any more. For now I'll stick with o1, though it's silly to always reupload several files that need updating on every prompt, but at least is quite reliable output, much better than 4o
I've heard it called "digital sharecropping" … building your product/company on or heavily relying on someone else's platform. Bad juju all 'round!
Does getvultr see what we're doing with the compute we rent?
One thing you left out that it can do is it can actually use o1-preview so it will "think more" EDIT: Type / before starting your prompt and choose "Reason"
😮 Can you explain how? Couldn't see that option
@@drcharleyLGO Type / it will show you options such as picture/search/ and the one your looking for reason.
@@drcharleyLGO You have to type / before starting your prompt and choose the option "Reason" there are other options as well.
This For Writing Scrips ? ... Yea
Claude had this already?
For me o1preview is much better in help with coding, so not sure if this will be better with canvas and 4o model. What do you experience?
Changing code when it is not asked to is definitely NOT OK... How can you say it is??
Pretty soon you'll be having AI make these videos for you.
Tried it, can't render JavaScript or whatever in browser like Claude, lots of mistakes. Cooler than original but nothing special.
Does anyone know if this would benefit those who are looking to build a website with no coding knowledge? I know Claude can manage projects efficiently. Could I have multiple interacting code files, like one for java, one for css, one for html?
Matthew, Matthew, Matthew- does it actually run the f****** snake game correctly?
@matthew_berman I haven't seen anyone cover this yet but 4o has taken on a more inquisitive approach to answering questions ever since O1 came out. Instead of simply providing a one-shot answer, it's first response is sometimes a clarifying question. I'm not sure if this is a personal setting based on my managed memories or if it's a new standard that seems to be taking a page from O1 thinking. Have you recognized this behavior at all?
The first time I used canvas, it only gave me 19 lines of code and called it a complete UI. GPT is so bad compared to Sonnet.
why would anyone use this canvas thing when cursor exists? this was released as a lesser product already
Why with the namaste 🙏 thumbnails bro?
Can it edit 2 files at the same time?
Goodbye Ms. Word.
Should cursor be nervous
you mean cloud storage and SaaS wasn't? yeesh, been screaming about this since early 2k's. thought people got a clue when ai was caught training on data and copying websites they weren't supposed to. it's not a privacy violation if you put it on the interweb. it's even in their EULA's. that and the fact that your crowd sourcing their debugging, market research and development. free labor and I.P. baby.
super lame it wont show you the output of simple html unlike calude
that's funny lol. it's not `Platform Risk` it's simply `Poor Product Development Selection Risk` ;) why build something that anyone with brains knows the API Service company might themselves likely build. It's not rocket science-some people just are not very good at intuiting what is to come and so they choose business ideas that are in the obvious path for development
Im amazed how important animations are… its the same random bullshit generator, but looks like an ide, so people feel like its doing real software development😅
are you unwell if you are get well soon
if not put it down to a crazy online dog
Yet it is a huge failure too! I tried it and it made me miss the 3.5 chatgpt 😅 ... not good at all!
Canvas is sh-t for refactoring even simple code like VBA. I can prove it. I fed it some sloppy VBA code that works but needs to be cleaned up because it is just easier for future coders (or future you) to follow. In one module, Canvas took 1,167 lines of code in and "refactored" it down to 193 lines of worthless code. Several more attempts to tweak the prompts to get Canvas to perform simple refactoring still could not get Canvas to refactor simple VBA code. Dev jobs are safe.
Dude, let VBA die.
It's not about VBA. Maybe AI can summarize it for you.
With Sam Altman’s history like with Elon Musk and it being open source, what’s not to trust? 😅
I knew it and I have messages to father saying listen the 3 models of what I would do as EU funded young enteprenuer, he said ok yes, I said no no when you come home I will show you I made everything on paper, he asks why, I say maybe I'm paranoid but whatsapp is Metas company and if they or when my chats get exported every7 day vased on preferences see those models as something they can do in fingersnap with money they have while I need to convince 17 institutions in Croatia as they like decide to co-fund me when I say look I said on project request like year ago to a person that is not you miss and co-funding is like nothing for that example so...here I now hear you and stuff siits and my mind connects now also putting channels with quality over politics, and how to make trillions by doing nothing...btw you are the one rare person I watch every-time but mostly learning to code again so...just give us great news like you always do i mean continue the good work. regards from Croatia
With Sam Altman’s history like with Elon Musk and it being open source, what’s not to trust? 😅
No difference between Zuck, Elon, and Sam, all are too bad and evil! Don't be fooled wih their so called open source!