Decart

An AI research lab that aims to change the way we experience digital worlds

Decart is an AI research lab that aims to change the way we experience digital worlds. Imagine stepping into a game where everything adapts to your actions in real-time, thus creating a unique adventure every time you play. That’s what Decart is all about.

Founded in 2023 by Dean Leitersdorf and Moshe Shalev, Decart focuses on making AI models more efficient — allowing for faster training and real-time interactions. Their flagship project, Oasis, showcases this by offering an open-world environment that evolves based on player input to provide a dynamic and immersive experience.

Decart excels at enhancing the training and inference of large generative models, making them ten times more efficient. For instance, when developing Oasis, Decart’s platform processed over 1 million hours of training data, moving 1.5 petabytes of data daily, and achieved a 75% reduction in AI operation costs. This efficiency speeds up development while making real-time AI applications more accessible and cost-effective.

Another cool aspect is Decart’s real-time generative AI capabilities. In that sense, Oasis can create fully interactive, real-time open-world experiences inspired by games like Minecraft. Players can move, interact with objects, and see the environment change instantly based on their actions. And that’s a significant leap from traditional game designs, offering a more engaging and personalized experience.

Decart has made Oasis’s code and a 500-million parameter model available to developers and researchers on platforms like GitHub. This move is meant to encourage innovation and allow others to build upon Decart’s work,

To sum it up, Decart is at the forefront of real-time generative AI, offering tools and platforms that transform how interactive digital content is created and experienced. While there are challenges to address, their innovative approach holds a promise for different industries looking to leverage AI for dynamic and personalized applications. And in the meantime, you can enjoy their Oasis game.

Homepage Screenshot 📸

Video Overview 🎬

What are the key features? ✨

Efficient platform: Decart's AI platform enhances the training and inference of large generative models, making them ten times more efficient.
Real-time generative AI: Its technology enables the creation of interactive environments that respond instantly to user actions, providing a more dynamic and immersive experience.
Open-source: By sharing their code and models, Decart fosters a community of developers and researchers to encourage further innovation in AI-generated content.
Scalable infrastructure: Decart's platform can handle massive datasets, processing over 1 million hours of training data and moving 1.5 petabytes daily.
Cost reduction: Through its efficient AI solutions, Decart has achieved a 75% reduction in AI operation costs, making advanced AI applications more accessible.

Who is it for? 🤔

With its offering and technology, Decart primarily targets game developers, AI researchers, and content creators looking to harness real-time generative AI for interactive applications. Their platform is also valuable for industries requiring dynamic content generation, such as virtual reality and education. By providing efficient and scalable AI solutions, Decart enables these professionals to push the boundaries of what's possible in digital experiences.

Examples of what you can use it for 💡

Game developers can create dynamic game worlds that adapt in real-time to player actions
Immersive VR environments can be generated on-the-fly to enhance user engagement and realism
Educators can develop interactive simulations that adjust scenarios based on student input
Artists and creators can use Decart's tools to generate unique visuals and animations
AI researchers can leverage Decart's open-source models to explore new applications and advancements in AI technology

Pros & Cons ⚖️

High efficiency platform that significantly reduces training and operational costs
Real-time interaction that allows for immediate responsiveness
It's open-source and scalable!

As the tech is still evolving, users may encounter unexpected behaviors in AI-generated environments

FAQs 💬

What does Decart primarily do?

Decart provides a developer-focused API platform for real-time generative video and image AI, allowing live transformation of video streams, text-to-video, image-to-video, and editing with ultra-low latency.

Who is Decart built for?

It targets developers and teams building interactive apps, live streaming tools, AR/VR experiences, gaming overlays, or any product needing instant AI video generation and editing.

What makes Decart different from other AI video tools?

Unlike most video AI that generates short clips with noticeable delay, Decart specializes in real-time processing, often under 100ms latency, enabling continuous, infinite video transformation without interrupting the feed.

Can I test Decart models without coding right away?

Yes, the platform includes a playground where you can try models like MirageLSD or Lucy directly in the browser with sample inputs before integrating via API.

What kinds of inputs does Decart support for generation?

It handles live camera feeds, pre-recorded videos, images, and text prompts to produce or transform content in real time, including restyling scenes or adding effects.

Does Decart work for live streaming or interactive video calls?

Absolutely, models like Mirage are designed for live applications, letting you alter Zoom calls, streams, or gameplay visuals instantly while keeping motion and coherence intact.

How fast is the real-time performance really?

Many operations hit sub-100ms end-to-end latency, with some frame generation as low as 40ms, making it suitable for fluid, responsive experiences rather than offline batch processing.

Is Decart focused only on video or does it include images too?

It covers both, with dedicated models for text-to-image, image-to-image editing, and seamless integration between image and video workflows in real time.

Can Decart handle custom styles or specific artistic changes?

Yes, you apply text prompts to guide transformations, such as converting reality to anime, cyberpunk, or any described aesthetic, while preserving original structure and movement.

What hardware or setup do I need to use Decart effectively?

No special local hardware is required since it runs via cloud API, though fast internet helps for live streaming use cases to keep latency minimal on your end.