Trying to download SOHO MDI magnetic data from VSO using Sunpy's fido

searching_vso.ipynb

I will leave addressing the underlying issues to the sunpy issue tracker, but I have some suggestions for your workarounds.

Firstly, It's not size=-1 you should be filtering by it's the start_time: None thing. They do happen to correlate perfectly here though so it's ok.

You can activate debug logging of VSO queries by doing import sunpy; sunpy.log.setLevel("DEBUG"), it get's very verbose but it can be useful sometimes.

Using this, it seems that the results that have start_time = None are actually coming from the SHA provider in VSO, so you can filter them out easily at search time with :

attrs_time = a.Time('2005/01/01 00:10', '2005/01/02 00:15') 
result = Fido.search(attrs_time, a.Instrument('mdi'), 
              a.Wavelength(6768*u.angstrom) & a.vso.Physobs('LOS_magnetic_field'), a.vso.Provider("SDAC")) 

We should work out why they are broken on a new sunpy issue and see if the VSO team can help us with that one.

Also can you open an issue with the details of:

If I download data from JSOC of SDO HMI, existence of broken data in the dataset pushes me to use their web interface instead of downloading using Sunpy.

please 😄

Hope that helps!