+thanks to all responses.
Based on several tips to the spot healing brush, and number of spots healed vs performance, I realized that I was doing a similar thing.
LR, auto mask, has great potential, but most of the times, even in a hard dark vs highlight selection criteria, it will miss just a tad and leave a bright edge to the image. You can many times tweak this away by coming in @ 100% and using the auto mask and re selecting by attempting to click on just the white line. LR gets it right for me about 50% of the time, the rest, you have undo and try again. But all of these attempts I guess add up in memory. In the same image I finally gave up allowing auto mask to make the selection and instead started to make a lot of small erases. The subject was a dead tree with a lot of branches against the sky, so I just started to erase manually. But each of these little brushes appears to act to LR similar to the spotting tool, in that they add up over time and eventually basically shut the program down at least on that particular image.
What is strange is you can close/restart LR, even power off the PC, but the file in question still has the same slow speed as I guess all of those individual brush strokes, never seem to go away and give you a clear start, even by erasing the history, something I finally tried.
It really all goes back to one of the main complaints to Adobe, in that please stop producing new tools, but instead spend a bit of time on the programming around the current tools, improve the performance.
The image in question was a short pano of 3 K1 raw, 36MB files, and it in it's own right did not clog up LR, but once I started to really tweak the auto mask errors, then that really blogged things down to the point of it would have been faster to just delete and start over, which I would do next time. As cameras get larger in MP (soon 50MP will just be the standard) these issues will continue to happen.
It's also clear to me that my machine environment of a Asus board, and GTX970 all with latest firmware and a Intel i7 3.2GHz is not going to work well with LR with larger files if I am needing to make a lot of minor corrections to a large file.
After all this happened, I went back to a file from last fall, D750, single but one that has the same dreadful deathly slow down, and it was the same problem, attempted to use auto mask on a girder bridge, but again auto mask left a slight light edge around some of the girders, thus I had to make repeated manual brushing attempt to fix it. These manual small brushing seem to add up just like the spot tool and created a eventual slow down with LR, that really can't be fixed without a deletion. On this D750, this is what I ended up doing and brought it into C1, where their Auto mask handles straight lines very well, (just not areas around leaves).
Thanks again to all who helped out.
Paul C