So the issue was the lower shifter cable that is attached to the transmission was pretty rusted and was causing the issues. The boot looked to be in good condition so I don't know how moisture got in. Anyway I took some emery paper to it to get rid of the rust and put a layer of lithium grease on it to help prevent it from rusting. A friend recommended using some Anti-Seize lubricant instead so I will be doing that as It should be a longer lasting option.