leapward-koex / maitouchsensoremulator

Touch sensor emulator for SDEZ/SDEZ触摸传感器模拟器

WpfMaiTouchEmulator

A WPF C# app meant to emulate the touch sensor hardware for SDEZ MaiMai using software on a touchscreen.

README in Other Languages

• 简体中文
• 日本語

How it works

The app uses com0com to install a virtual COM port pairing of COM3 - COM23. The app then connects to COM23 and emulates how the hardware touch sensor works, sending data over this port.

Demo

InGameDemo.mp4

PanelDemo.mp4

Setup

Disable Three- and four-finger touch gestures in windows (on W11 Settings -> Bluetooth & devices -> Touch)

COM3 needs to be free for this app to work as that is the port used by SDEZ. By default most people will find that COM3 is already in use by a USB Serial device. This will need to be uninstalled via Device Manager,

1. Open Device Manager
2. Show hidden devices. "View" -> "Show Hidden Devices" -> "Ports (COM & LPT)" -> Right click the COM3 device and uninstall.

Set DummyTouchPanel=0 in the [AM] section of your maimai .ini file.

Open the WpfMaiTouchEmulator.exe app, Install the virtual port via the "Install COM port" button, either tick the "Automatic port connecting" for the app to connect to the COM23 port on start up or press the "Connect to port" button.

If you have issues where the app can't bind to COM23 after installing the virtual port I find that restarting my PC normally fixes it.

Start SDEZ and use your touchscreen as normal.

[Optional] To avoid having to manually open the application each time, you can enable "Automatic port connecting" and add this line after @echo off in your MaiMai's start.bat file. start "" "<your path to WpfMaiTouchEmulator.exe>"

[Optional] If you're on W11 and find that left swipes sometimes open the "widgets" pane you can remove the pane by running this command as administrator winget uninstall "windows web experience pack" and following the onscreen instructions.

Installing the virtual COM ports without using the included com0com program

If you don't want to use the included install/remove virtual com actions in the app because you don't want to give admin access to this unknown app then you can achieve the same outcome by manually downloading Null-modem com0com online (version 2.2.2.0 required!) and then running this command. cd "C:\Program Files (x86)\com0com" && setupc.exe install Portname=COM3 Portname=COM23 to install the virtual port and cd "C:\Program Files (x86)\com0com" && setupc.exe uninstall to uninstall the virtual ports.

Why?

Most SDEZ don't work very will with the built in touchscreen and require either someone else to modify the SDEZ source code to get the inbuilt touch controls to work or for you to edit and recompile the .dll files. This app should work with all SDEZ versions (afaik) out of the box.

Another reason is sourcing a ITO etched panel for use as a touch sensor can be difficult and reasonable expensive.

Performance

Its ok, the app polls the touch sensor window at up to 1Khz but its running in C# so it may or may not actually be running at this speed, depending on the performance of the host machine.

As for accuracy. I'm not that good so I can't say how well it works at high levels of play but in my experience it works pretty well.

Thanks

Thanks to whowechina - mai_pico and Sucareto - Mai2Touch for the basic serial data format and touch implementation research.

maitouchsensoremulator's Issues

Cannot install the com port

The touch screen can work fine in my device (lenovo miix720) , but it throws error when I click install com button.

Here is the log.

2024-02-15 01:46:52 [INFO] Main window loaded, creating touch panel
2024-02-15 01:46:57 [FATAL] App encountered a fatal exception
Exception: Test exception for crash dump generation
StackTrace:    at WpfMaiTouchEmulator.MainWindow.buttonInstallComPort_Click(Object sender, RoutedEventArgs e) in D:\a\MaiTouchSensorEmulator\MaiTouchSensorEmulator\MainWindow.xaml.cs:line 206
   at System.Threading.Tasks.Task.<>c.<ThrowAsync>b__128_0(Object state)
   at System.Windows.Threading.ExceptionWrapper.InternalRealCall(Delegate callback, Object args, Int32 numArgs)
   at System.Windows.Threading.ExceptionWrapper.TryCatchWhen(Object source, Delegate callback, Object args, Int32 numArgs, Delegate catchHandler)

2024-02-15 01:46:59 [INFO] Disconnecting from COM port
2024-02-15 01:51:01 [INFO] Main window loaded, creating touch panel
2024-02-15 01:51:05 [INFO] Disconnecting from COM port
2024-02-15 01:51:05 [FATAL] App encountered a fatal exception
Exception: Cannot set Visibility to Visible or call Show, ShowDialog, Close, or WindowInteropHelper.EnsureHandle while a Window is closing.
StackTrace:    at System.Windows.Window.VerifyNotClosing()
   at System.Windows.Window.InternalClose(Boolean shutdown, Boolean ignoreCancel)
   at WpfMaiTouchEmulator.MainWindow.MainWindow_Closing(Object sender, CancelEventArgs e) in D:\a\MaiTouchSensorEmulator\MaiTouchSensorEmulator\MainWindow.xaml.cs:line 88
   at System.Threading.Tasks.Task.<>c.<ThrowAsync>b__128_0(Object state)
   at System.Windows.Threading.ExceptionWrapper.InternalRealCall(Delegate callback, Object args, Int32 numArgs)
   at System.Windows.Threading.ExceptionWrapper.TryCatchWhen(Object source, Delegate callback, Object args, Int32 numArgs, Delegate catchHandler)

Btw there's don't have com3 in my device manager, so I don't know whether com3 is in use.

After using software to use iPad as a display, it can only respond to sliding gestures

It has been confirmed that touching in other software is normal, and the same problem will occur after changing to different streaming software.

2024-04-14.10-26-49.mp4

Because of the translation software, I didn’t know if I could explain the question correctly, so I recorded a video

Crash when starting sinmai

The program immedietely crashes when starting sinmai
everything is working (connect to port, sensor values and stuff) prior to starting sinmai
using SDEZ 1.35