After talking with a few other teams about this issue, we still do not have a definite fix. A handful of players have talked to me in game and we have tried various different things to resolve this. Today I had a player note that they disabled the Pando Media Booster and their issues had went away. I suggest to try this as well and see if this helps.
I do not think this is the "smoking gun" but it may help a majority of you to have a much better player experience.
Are there any similar programs to Pando which I should search for and disable?
Furthermore, I'd like to note that I haven't seen many people discussing one of the issues this lag seems to be causing for me, which is that while spectating games, over time I fall seconds, and eventually minutes, behind "Live" despite running at 1x. It doesn't seem implausible to me that this issue of running at, say ~0.95x speed is what is occurring in game, but whenever the client falls to far behind, a small warp occurs, creating the lag we see despite the low ping. Does this seem at all likely to anyone with tech experience?