Three suggestions:
-
Use data export via the web app to pull hourly data, for each day, month or year you want. No scraping needed. Just go to the time period you want in the Trends/Usage window and hit the export icon on the upper right.
-
There’s already a significant R-based solar simulation package called SolarR. I have done a little exploring with it. I have gotten it to work nicely up to the point where I have to have it compute Global (G0), diffuse (D0), and direct (B0) irradiance components.
solaR: Solar Radiation and Photovoltaic Systems with R -
Some interesting experiments with solar simulation and prediction on this thread:
Varying goals for solar