VoxPals: An entirely new way to interact with our Sandbox Avatars!

Hey Sandbox Community, my team has been working on a prototype for an interactive version of our Voxel Avatars that live on top of our screens for over a year now. We’ll be submitting a SIP to implement this further, but Sebastien & Cyril recommended to gauge interest from the community here first and gather some ideas on future expansions!

The easiest way to see what we’re creating, is through our prototype video here

VoxPals: Thinking Outside The Sandbox

VoxPals are voxel-based browser companions that offer an interactive, personalized metaverse experience outside of the traditional gameplay of The Sandbox. Through our custom-built browser extension game engine, we’re combining The Sandbox’s VoxEdit technology to bring 3D pixelated avatars to life as companions on users’ browser screens, adding a layer of engagement and utility to our daily experience with The Sandbox.

Objective
To introduce VoxPals, (Prototype Video HERE) engaging 3D companions that enhance user experience by offering assistance, interaction, and customization through MetaPals’ browser extension. We hope to expand The Sandbox’s reach and interactivity, bringing the metaverse into everyday digital experiences!

Details
VoxPals are intended to be more than mere digital beings; they will serve as companions and assistants, enriching the user’s browser activities with features such as summarization of web pages, useful tips, reminders, and personalized greetings.


The interactivity is not limited to passive engagement; users will have the option to utilize VoxEdit to customize their companions, expressing their creativity and reinforcing their attachment to The Sandbox metaverse.

Feature Breakdown for V1

User Interaction:

  • Assistant Animations (Gestures, Nods, Waving):
    To give VoxPals a communicative presence on the screen, enhancing the interactive nature of the assistant and making the interactions feel more personal and responsive.
  • Task-Based Animations (Organizing, Reminding):
    To provide visual cues associated with scheduled reminders or organizational tasks, linking VoxPals to productivity which can encourage users to rely on them for daily digital routines.
  • Idle Animations (Thinking, Processing):
    To indicate when VoxPals are in a ‘standby’ mode or processing user requests. It gives a visual representation of ‘thought,’ mirroring a companion’s attentive presence.
  • Special Animations (Search, Summarize, Alert):
    Unique animations for specific actions such as conducting a web search, summarizing a page, or alerting to notifications make the functionalities of VoxPals more tangible and expressive.
  • Customization and Personalization:
    Users can adjust the appearance and interface of their VoxPal using VoxEdit, fostering a deeper connection as they can tailor their companion to reflect their personal style and preferences.

Functional Features:

  • Content Summarization:
    VoxPals can automatically summarize the content of a webpage, providing users with quick insights and saving time, which is a valuable asset for users with busy schedules.

  • Scheduling and Reminders:
    Integrating a scheduling system within VoxPals helps users keep track of their tasks and commitments without needing to leave their browser, streamlining productivity.

  • Health and Wellness Reminders:
    Incorporating reminders for breaks, hydration, or exercise.

  • AI Assistance:
    We’re also experimenting with the integration of AI models like ChatGPT so that your VoxPal can also be an easier way to access an AI model for tasks.

Integration:

  • The Sandbox Portal:
    A quicklink portal to take users directly back into The Sandbox metaverse by opening a new tab on their browser.
  • VoxEdit Link:
    A design interface that takes users into the VoxEdit character editing page.

Impact

Engagment: Our users interact with their desktop companions an average of 42 times a day, with a 46% 7-Day retention rates. By operating on browsers, VoxPals keep The Sandbox ecosystem top-of-mind, driving user retention and daily interaction.

Community: Our onboarding process takes less than 2 minutes and requires zero blockchain or crypto knowledge. In this manner, VoxPals can attract new users and cater to various demographics, expanding the community beyond the early adopters.

Brand: Companions stay on screens for an average of 5 hours per day, leading to
a very high visual word-of-mouth effect. VoxPals act as brand ambassadors, showcasing The Sandbox’s creative tools and features to a broader audience publicly through everyone’s screens.

Creativity: Providing tools for user-generated content that now come to life in
entirely interactive and functional ways through your on-screen VoxPal!

Background
My team consists of 15 gaming/blockchain/AI veterans from across the globe, and we’ve been building this browser extension game engine for over two years. My name is Max Giammario (https://www.linkedin.com/in/maxgiammario/) and my Masters research was focused on the future of how we interact with AI. I have also been in the blockchain space for over 7 years now, which has allowed me to work in the unique intersection of blockchain and AI through several projects. I’ve been connected with Sebastien for over a year now, and we thought it was a great opportunity to kickstart this project once the DAO was live.

Data Privacy
This one is quite important to us, especially dealing with a browser extension. Beyond the basic data collection to allow the companion to function, all other data is on an ‘opt-in’ basis and explicitly stated when a user decides to allow such collection. My CTO also has an extensive background in cybersecurity, and follows strict protocols to iron out any vulnerabilities. Browser extensions are also a very touchy subject in the crypto community, so we are happy to answer any questions here and open to discussions on ways we can optimise this aspect.

Timeline

The great thing is, we’ve already got the underlying infrastructure in-place, so it’s a matter of integration with the Vox engine and optimisation of key functionalities and behaviors. This means we’re able to potentially launch a first pilot within 3 months of SIP approval.

Future Plans

This is where the community can help us with exploring some cool integrations and features we can expand into. Some of the ones my team are actively exploring are:

  1. VoxPals integrating with platforms like Twitch, to allow streamers and viewers to interact through their VoxPal.
  2. VoxPals rewarding users for posting UGC, accessing The Sandbox on a daily basis, or engaging with the community through X.
  3. Cross-promotions through your VoxPal, as they can deliver notifications directly to users, we can send alerts about the latest Sandbox news, Sandbox game experience, or video trailer etc.
  4. AI Integration with ChatGPT/Claude so that your VoxPal can actually engage in a two-way dialogue with you, and you can command it to conduct tasks e.g. ‘Can you schedule a meeting with xxx on my google calendar for tomorrow at 6’.

I see this as an entirely new way for people to experience and onboard themselves into The Sandbox ecosystem, so let me know what you think!

9 Likes

This is amazing, I’m so excited! I am looking forward to seeing an integration of MetaPals into our ecosystem!!

having voxpal to represent twitch chat would be really funny lol

This actually looks really promising.

look really cool, i am very excited for ai growth era

This sounds really cool!! Looking foward to it :hushed:

Looking forward to this awesome collab!

You make me curious , really interesting. I wasn’t ready for that. Need time to integrate this Idea on my mind now

3 thoughts from end on the idea:

  • I like very much the idea but at the moment I see more this as an extension in real world of the sandbox mainly targetting current community. I would love to see it as a way to bring new people to the sandbox.
  • We will need to secure some mid-tems/long term collaboration terms so that if SIP is approved this is not only used as a funding or as an advertsing for your project/company
  • On the cool side I would love to see that extension on mobile informing you about events, land sales, opensea listing.

So if I understand #1 correctly, this will also be a Twitch plugin that a VoxPal will be able to be seen on my twitch stream?

When I’m doing SANDDAO Podcast episodes live with my guests, what canI have the VoxPal do? What commands can I give it?

Hey Lanzer, thanks for the comment! In regards to the Twitch plugin, beyond the normal functionality of the VoxPal, our integration with Twitch contains very similar features to https://www.streamavatars.com/ . The idea behind it is that it gives your audience (SANDAO Podcast listeners in this case) a new way to interact with you during streams, and allows you to engage with them through your VoxPal. Additionally, we’re exploring options so that Bits/SAND can even be convertable/transferable to distribute as rewards to VoxPal viewers mid-stream!

Got it. I’m still having trouble understanding what it does other than the stream avatars. He grabs youtube videos and walks across the screen?

Thanks!