What are the methods to raise pH of well water?

I am a homeowner in rural Maine with a dug well with 24 inch tiles. The pH of the water is approximately 6.2. Is it possible to raise the pH by placing a block of marble (calcium carbonate) in the well, or will I need to install a system that has to be backwashed? Water use is a concern as the well gets low during dry spells.

I would like to raise pH as the water appears to be slowly dissolving the pipes in my home. (blue-green staining, pinhole leaks) . Your help will be highly appreciated. Regards.