Here's a quick primer:
NSAIDS (Aspirin, Aleve, Ibuprofen, Celebrex, basically everything except tylenol) all work about just as well, but aspirin is the least well tolerated for long periods.
NSAIDS will reduce pain and swellings. They will not prevent joint damage from arthritis! You're joints might feel better but are being eaten up still.
Tylenol is not an NSAID. But it will reduce pain. It also does not protect joints from degeneration.
DMARDS (Disease modifying anti rheumatoid drugs) like MTX help damp down the auto immune problem, but will also not preserve joints and are very harsh. MTX requires routine liver biopsies. Serious med.
Biologics improve joint function, reduce pain, and are the only drugs that stop the joint from further deterioration. They also have very few day-to-day side effects. There are some potential serious long term side effects but they are very very rare.
I have taken a biologic for the past 10 years. It's the closest thing to a cure that exists today.
Unfortunately they can be very expensive depending on quite a few variables.