FIGURED IT OUT!
base.accept('mouse3-up', lambda: taskMgr.remove('MyTaskName'))
seems i needed to set the task name as what i called it when i set the task.
base.accept('mouse3', lambda: taskMgr.add(exampleTask, 'MyTaskName', extraArgs=[dummy], appendTask=True))
so put MyTaskName as the .remove since i called it that when i set the task.
Thanks All!!!
Now just got to adjust the camera a bit to make it run smoother!