I purchased a device that will let my raspberry pi control power to my water softener. It is called a power switch tail and only cost about $20. Here is a link to their technical page. It looks like exactly what I need.
The company was closed for the last few days but the device should ship tomorrow. Maybe I can take it to the Makers meeting next week.
Thanks Matt Dovin for finding this for me.