Hardware Encoding, Zero-Copy Capture & Virtual Displays
1. Zero-Copy D3D11 Capture-to-Encode Pipeline
OmegaDesk eliminates CPU-to-GPU memory roundtrips on Windows:
- DXGI Desktop Duplication (
omegadesk-capture): Acquires the desktop frame directly as anID3D11Texture2Don the GPU, composites hardware cursors, and handles rotated displays (90°,180°,270°). - GPU Color Conversion (
ID3D11VideoProcessor): ConvertsBGRA8desktop textures toNV12entirely on the GPU. - Media Foundation Hardware H.264 (
omegadesk-codec): Wraps theNV12texture viaMFCreateDXGISurfaceBufferand feeds it directly into Intel Quick Sync, NVIDIA NVENC, or AMD AMF hardware encoders (--encoder auto|hardware|software), falling back toOpenH264when no GPU encoder is available.
2. Adaptive Video QoS (Congestion Control)
Every video frame is acknowledged by omegadesk-client. When RTT rises or frame acknowledgments lag:
- The agent dynamically lowers the target H.264 bitrate first.
- If congestion persists, it reduces frame rate while respecting
--bitrate-mbpsand--fpsceilings. - As soon as network congestion clears, bitrate and FPS ramp back up smoothly.
3. Signed IddCx Virtual Display Driver & Privacy Screen Blanking
- Virtual Monitors (
drivers/idd): Pass--virtual-display 1920x1080@60to create headless virtual displays on machines without physical monitors attached. - Privacy Mode (
--privacy): Renders a fullscreenWDA_EXCLUDEFROMCAPTUREblackout overlay on the physical monitor so local bystanders cannot view or control the screen while the remote operator works.