Step 4: Circuit Diagram
Above is a circuit diagram for this project. It's designed so that the solar cell is always charging the batteries and the toggle switch turns the USB circuit on/off.
A diode has been put in place to prevent power from flowing the wrong direction into the solar cell. This is a very common diagram for solar.
This basic setup can easily be scaled up or down depending on the project.