My ANA came back boarder like positive with a speckled pattern - What does this mean? Should I be worried?

It's possible. The speckled pattern is seen in some people with no autoimmune disease, though. With the rest of your symptoms, I think it warrants further investigation. You should discuss this with your primary care physician and see if he/she recommends you see a rheumatologist.