I guess this is kind of cheating since Nvidia software engineers have already shown that it's a supported feature set of the t239 soc, but cameras + Nvidias AI camera/video feed analysis features enabled by tensor cores.
Combined with the accelerometer/gyro nintendos already been using since wii, this.... this can enable some serious shit.
Motion control Drift would be ridiculously real time mitigated, to the extent it might become completely inconsequential even over hours of play, as it can turn basically whatever static objects it sees into reference points, which can be used to auto correct and null drift from the accelerometers missing axis. The main one undoubtedly being the big rectangle with 4 corners that is the TV itself.
Assuming a camera is put in the joycon(s) again, Effectively pointer controls would be back, on steroids, as in 3d spatial accurate, with no need for a sensor bar (any fixed structure in the room)
If you are playing handheld, it can use eye tracking to let you aim by looking.....
Return of 3ds augmented reality stuff, except completely nuts in capability compared to what the 3ds could do.....
And considering it's original use case as a feature for an automotive gpu, who KNOWS what bonkers nonsense they could do with that neat but ridiculously niche Mario kart RC peripheal thing now.
I guess this is kind of cheating since Nvidia software engineers have already shown that it's a supported feature set of the t239 soc, but cameras + Nvidias AI camera/video feed analysis features enabled by tensor cores.
Combined with the accelerometer/gyro nintendos already been using since wii, this.... this can enable some serious shit.
Motion control Drift would be ridiculously real time mitigated, to the extent it might become completely inconsequential even over hours of play, as it can turn basically whatever static objects it sees into reference points, which can be used to auto correct and null drift from the accelerometers missing axis. The main one undoubtedly being the big rectangle with 4 corners that is the TV itself.
Assuming a camera is put in the joycon(s) again, Effectively pointer controls would be back, on steroids, as in 3d spatial accurate, with no need for a sensor bar (any fixed structure in the room)
If you are playing handheld, it can use eye tracking to let you aim by looking.....
Return of 3ds augmented reality stuff, except completely nuts in capability compared to what the 3ds could do.....
And considering it's original use case as a feature for an automotive gpu, who KNOWS what bonkers nonsense they could do with that neat but ridiculously niche Mario kart RC peripheal thing now.