more interplay and resolving between 2d and 3d data would be nice. In particular, it would be nice to be able to blow away a particular marker for a time period out of 3d, and then have it be reconstructed again from the 2d data for that period, with new point cloud settings and camera inclusions and exclusions and perhaps even marking up the 2d data to tell it which markers are good and bad for particularly rough spots.
It would be even cooler if you could have it blend the new solved marker segment into the old one by specifying the number of frames to use as handles.