Nativescript video stream manipulation and transformation



I would like some advice on how to approach the following scenario:
We want to apply some live transformation/transparent overlay to the camera stream while the camera is open, displaying drawings/coloring depending on what the camera is capturing. For example, capture an object and color it green while the camera is pointing at it.
We will have a library to handle the algorithmic of it, but how can we overlay/change the live stream that is seen on the camera?
I saw overlay plugins to display grid/buttons on and around the screen, but here I want to interfere with the stream itself.
Thank you!