Wednesday, May 8, 2024

Dall-E 3: AI image generator unveils major new upgrades and ChatGPT integration

For several major artificial intelligence (AI) art companies, 2023 has been a year of dodging copyright lawsuits and dealing with users’ attempts to prompt their models into showing the most extreme content possible. Clearly, OpenAI is tired of that. Announcing its third iteration of Dall-E – the AI image generator that started way back in January 2021 – OpenAI has implemented a range of key changes, ranging from finer details in images to detailed safety checks.

When will Dall-E 3 become available?

Dall-E 3 will become available to ChatGPT Plus users in October this year. It is yet to be announced whether the model will eventually become available to free users of the chatbot.

Dall-E Key updates

A key update is to the quality of images. Dall-E 2 had a tendency to misunderstand prompts, confusing descriptions, context, or even the order of colors mentioned.

Combatting confused prompts and lack of detail, OpenAI claims that Dall-E 3 is better able to understand details and the text that users provide. Even if a prompt contains multiple objects or references.

With the meteoric rise of ChatGPT, it comes as no surprise that OpenAI has also decided to pair the two models together. Dall-E 3 will only be available to use via ChatGPT Plus – a pay-to-use tier of ChatGPT with added benefits.

An AI-generated image of an Avocado missing its inside saying "I feel so empty inside"

Dall-E 3: AI image generator unveils major new upgrades and ChatGPT integration
Dall-E 3 images are more detailed and better understand the context – Dall-E 3

This, in theory, allows ChatGPT to act like “a brainstorming partner”, working on prompts to utilize Dall-E 3. This will be especially helpful for those who need help with prompts or don’t know how to best utilize Dall-E.

If you appreciate a generated image but find it not quite perfect, you can request ChatGPT to modify it or ask for guidance on aligning the image with a specific style.

By combining the two, OpenAI aims to get the brains and logic of ChatGPT with the creativity of Dall-E. However, as both models have been prone to make mistakes in the past, there is likely to be a learning curve as the models learn to communicate.

Copyright and safety updates

While the latest Dall-E model has made significant improvements in image quality and integration with ChatGPT, it has also placed a strong emphasis on safety. It will decline requests for images of public figures by name and will equally decline prompts that are harmful or violent in content.

OpenAI is actively developing a model to identify when its model has generated a piece of art. AI art has faced backlash for its involvement in generating misinformation. As images become increasingly realistic, more companies are striving to develop the capability to identify the origin of the produced work.

The final major change to the Dall-E system is for existing artists. Dall-E, like most other AI image generators, trains on artwork sourced from the internet. This ignited a substantial copyright lawsuit, with artists accusing the use of their work without consent.

Dall-E now lets creators opt out of their images being used in the training of future models. This requires filling out a form with details of your artwork and agreeing that you are the owner of the work.

In addition to addressing their copyright concerns, OpenAI has also implemented a feature where Dall-E actively rejects image-style requests from living artists. This contrasts with the previous capability present in both original versions of Dall-E.

Read more: What is The Butterfly Effect Theory?

Related Stories