Everyone struggles learning a new language. At one point in time, you even struggled to learn English as a babbling, grammatically challenged toddler. Since no one joins the world as a master of even their native tongue, you can take heart in the biological fact that we are hard-wired for linguistic domination.
If you're passionate about studying new languages, you will achieve fluency with time and effort -- and by applying practical strategies to the common problems you're destined to come across. In my own experience, I've studied Spanish, Latin, Chinese, and Arabic and at some point picked up smatterings of Portuguese and Amharic, so I feel your pain.
Persist through these natural challenges on the road to fluency and you'll someday gain all the benefits of being bilingual.