I've ordered a new shift drum and shift drum bearing since it had a small amount of play in it. I've narrowed the problem down and I'm pretty sure its either the drum or its (not sure of the actual part name) the star mechanism that has springs and little levers on it and sits in the shift drum. I'm waiting on parts now.