Apple Unveils MGIE, Its Own AI-Based Image Editing Model

Apple, the renowned tech giant, has made a significant move in the field of artificial intelligence (AI) by launching its own AI-based image editing model called MGIE (short for MLLM-Guided Image Editing). This model allows users to easily edit images using natural language instructions.

Harnessing the Power of MLLM Technology

MGIE leverages multimodal large language models (MLLMs), a cutting-edge AI technology that combines various types of information, such as text, photos, and videos, to understand and generate human-like language.

While studies on MLLMs have shown promising results in understanding and generating images, their implementation has not yet been widespread. Apple, with its MGIE, becomes one of the pioneers in applying this technology to enhance user experience in image editing.

MGIE Features and Capabilities

MGIE allows users to give instructions to the model using natural language. For example, users can ask MGIE to “make the sky bluer,” and MGIE will automatically adjust the saturation of the sky region based on that instruction. The model can be used for various types of image editing, from simple color adjustments to complex image manipulations, such as generating or removing parts of an image.

Availability and Accessibility

MGIE is open-source and freely available on GitHub, allowing anyone to try and use the model. Users can download the code, data, and trained model from the GitHub page. The speed of image generation with MGIE will vary depending on the hardware performance. It’s important to note that such models require large RAM to run their functions.

Apple’s Efforts in AI and New Feature Generation

Apple has long been working on AI-assisted features behind the scenes. In January, code within the iOS 17.4 beta revealed that Apple is working on a new AI-powered version of Siri. Recently, Apple CEO Tim Cook stated that Apple is investing significant time and effort into developing AI features to be announced in the coming months. He also noted that Apple has been working on generative AI internally.

Conclusion

The launch of MGIE demonstrates Apple’s commitment to developing innovative and user-friendly AI technologies. This model has the potential to revolutionize the way we edit images and open new possibilities for creativity and visual expression.