[MSNoise] msnoise compute_cc problems

Tue Apr 7 07:20:31 UTC 2015

https://github.com/ROBelgium/MSNoise/issues/51

Thomas

Le 02/04/2015 17:40, Thomas Lecocq a écrit :
> Aurélien,
>
> actually, there shouldn't be any rounding involved when merging... but 
> an issue could come from the sample alignment procedure, when samples 
> are not aligned on the sampling grid (a file starting at 0.005 seconds 
> for a 100Hz data)..
>
> Thomas
>
> Le 2/04/2015 17:23, Aurélien Mordret a écrit :
>> Hi all,
>>
>> I observed the same error from time to time to, and I think it has 
>> already
>> been rised in previous discussions.
>>
>> My guess (but I never checked) is that it is a rounding error which 
>> leads
>> to have 1 extra or missing sample when merging or resampling. You then
>> obtain a sampling frequency which is not exactly the expected one, and
>> obspy refuses to merge the traces.
>>
>> Aurelien
>> Le 2 avr. 2015 17:12, "Thomas Lecocq" <thomas.lecocq at seismology.be> a 
>> écrit
>> :
>>
>>> Hi Silvio,
>>>
>>> I have noticed this error too... I haven't had time to check it, but it
>>> happens when we try to merge two traces that need merging...
>>>
>>> it's definitively a bug :-)
>>>
>>> Tom
>>>
>>> Le 2/04/2015 17:07, De Angelis, Silvio a écrit :
>>>
>>>> Hi everyone,
>>>>
>>>> I am testing release 1.3.1 on Ubuntu 64bit (12.04). Things went pretty
>>>> smooth for a first attempt with some CCF being calculated. Except 
>>>> every now
>>>> and again the msnoise compute_cc stops working delivering the error 
>>>> message
>>>> below, apparently linked to sampling rate issues?
>>>>
>>>> Here’s a link to a SDS data structure with data (two stations/two 
>>>> days)
>>>> that generated the error:
>>>>
>>>> https://copy.com/blzIarTs4QrAllNr
>>>>
>>>> I have kept most options in the config default, just for testing
>>>> purposes, except start and end date to match my data. I also added 
>>>> a filter
>>>> in the config window (0.1 (low)- 0.3 (mwcs low)- 0.9 (mwcs high) -1.1
>>>> (high) Hz, 100 (RMS threshold), 1 (window), 0.5 (step)).
>>>>
>>>> msnoise compute_cc did not work unless a filter was defined in the
>>>> configuration. I had 27 days worth of CCF's computed that I could 
>>>> plot,
>>>> thus, I suppose the general config was ok? The computed CCF’s were 
>>>> what i
>>>> expected (matched another workflow I use for ambient noise).
>>>>
>>>> Any hints?  The data files look ok as far as I can tell but there 
>>>> may be
>>>> something I am missing?
>>>>
>>>> I am now testing with a different dataset to see whether problems are
>>>> with data files.
>>>>
>>>> Thank you.
>>>> Ciao,
>>>> Silvio
>>>> Silvio De Angelis
>>>>
>>>> Lecturer in Geophysics
>>>> University of Liverpool
>>>> Jane Herdman Building
>>>> 4 Brownlow Street,
>>>> Liverpool, Merseyside, L69 3GP
>>>> United Kingdom
>>>> email: silvioda at liverpool.ac.uk<mailto:silvioda at liverpool.ac.uk>
>>>>
>>>>
>>>>
>>>> 2015-04-02 15:22:48 [INFO] *** Starting: Compute CC ***
>>>> 2015-04-02 15:22:48 [INFO] Will compute ZZ
>>>> 2015-04-02 15:22:48 [INFO] New CC Job: 2006-01-25 (1 pairs with 2
>>>> stations)
>>>> 2015-04-02 15:22:55 [INFO] Pre-Whitening Traces
>>>> 2015-04-02 15:22:56 [INFO] Processing CC
>>>> 2015-04-02 15:22:56 [INFO] Job Finished. It took 7.45 seconds
>>>> 2015-04-02 15:22:56 [INFO] New CC Job: 2006-01-26 (1 pairs with 2
>>>> stations)
>>>> 2015-04-02 15:23:03 [INFO] Pre-Whitening Traces
>>>> 2015-04-02 15:23:03 [INFO] Processing CC
>>>> 2015-04-02 15:23:03 [INFO] Job Finished. It took 7.37 seconds
>>>> 2015-04-02 15:23:03 [INFO] New CC Job: 2006-01-27 (1 pairs with 2
>>>> stations)
>>>> 2015-04-02 15:23:10 [INFO] Pre-Whitening Traces
>>>> 2015-04-02 15:23:11 [INFO] Processing CC
>>>> 2015-04-02 15:23:11 [INFO] Job Finished. It took 7.30 seconds
>>>> 2015-04-02 15:23:11 [INFO] New CC Job: 2006-01-28 (1 pairs with 2
>>>> stations)
>>>> Traceback (most recent call last):
>>>>     File "/home/silvio/anaconda/bin/msnoise", line 9, in <module>
>>>>       load_entry_point('msnoise==1.3.1', 'console_scripts', 
>>>> 'msnoise')()
>>>>     File 
>>>> "/home/silvio/anaconda/lib/python2.7/site-packages/msnoise/scripts/msnoise.py",
>>>> line 393, in run
>>>>       cli(obj={})
>>>>     File 
>>>> "/home/silvio/anaconda/lib/python2.7/site-packages/click-4.0-py2.7.egg/click/core.py",
>>>> line 664, in __call__
>>>>       return self.main(*args, **kwargs)
>>>>     File 
>>>> "/home/silvio/anaconda/lib/python2.7/site-packages/click-4.0-py2.7.egg/click/core.py",
>>>> line 644, in main
>>>>       rv = self.invoke(ctx)
>>>>     File 
>>>> "/home/silvio/anaconda/lib/python2.7/site-packages/click-4.0-py2.7.egg/click/core.py",
>>>> line 991, in invoke
>>>>       return _process_result(sub_ctx.command.invoke(sub_ctx))
>>>>     File 
>>>> "/home/silvio/anaconda/lib/python2.7/site-packages/click-4.0-py2.7.egg/click/core.py",
>>>> line 837, in invoke
>>>>       return ctx.invoke(self.callback, **ctx.params)
>>>>     File 
>>>> "/home/silvio/anaconda/lib/python2.7/site-packages/click-4.0-py2.7.egg/click/core.py",
>>>> line 464, in invoke
>>>>       return callback(*args, **kwargs)
>>>>     File 
>>>> "/home/silvio/anaconda/lib/python2.7/site-packages/msnoise/scripts/msnoise.py",
>>>> line 174, in compute_cc
>>>>       main()
>>>>     File 
>>>> "/home/silvio/anaconda/lib/python2.7/site-packages/msnoise/s03compute_cc.py",
>>>> line 271, in main
>>>>       basetime, tramef_Z = preprocess(db, stations, comps, goal_day,
>>>> params, tramef_Z)
>>>>     File 
>>>> "/home/silvio/anaconda/lib/python2.7/site-packages/msnoise/s03compute_cc.py",
>>>> line 130, in preprocess
>>>>       stream[gap[0]] = stream[gap[0]].__add__(stream[gap[1]], 
>>>> method=0,
>>>> fill_value="interpolate")
>>>>     File "/home/silvio/anaconda/lib/python2.7/site-packages/obspy-
>>>> 0.10.1-py2.7-linux-x86_64.egg/obspy/core/trace.py", line 681, in 
>>>> __add__
>>>>       raise TypeError("Sampling rate differs")
>>>> TypeError: Sampling rate differs
>>>> _______________________________________________
>>>> MSNoise mailing list
>>>> MSNoise at mailman-as.oma.be
>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>
>>> _______________________________________________
>>> MSNoise mailing list
>>> MSNoise at mailman-as.oma.be
>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>
>> _______________________________________________
>> MSNoise mailing list
>> MSNoise at mailman-as.oma.be
>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>
> _______________________________________________
> MSNoise mailing list
> MSNoise at mailman-as.oma.be
> http://mailman-as.oma.be/mailman/listinfo/msnoise