Combine rhubarb, sugar, orange juice, and candied ginger in a large glass or ceramic jar. Let stand, 8 hours to overnight.
Move rhubarb mixture into a pot and bring to a boil over medium-low heat, about 15 minutes. Sweeten with more sugar to taste and pour into a clean jar. Close with a lid and store in the refrigerator for up to 1 week.