[MSNoise] Error to run compute_cc

Thomas Lecocq thomas.lecocq at oma.be
Tue Oct 14 12:03:10 UTC 2014 

Carmelo,

Yes, that is what is expected if you set config values:

keep_all = False
keep_days = True

which are default values.

The "daily" stacks will be stored in the STACKS/001_DAY folder.

Thomas


Le 10/10/2014 17:43, Sammarco, Carmelo a écrit :
> Dear Thomas,
>
> Now the script 'compute_cc' run. I did what you say.
>
> In the end of the process I have only one folder called 'STACK'. I have not the folder called 'CROSS_CORRELATION'. I have also a deprecation error..  the screen show this:
>
> "DeprecationWarning: using a non-integer number instead of an integer will result in an error in the future"
>
> could be this the problem?? This error appears many times on the line 86,102 and 100 in the file whiten.py.
>
> And in which way can I plot the cross correlation function between two station? (Maybe I need to have the CROSS_CORRELATION folder.... ) I am trying to replicate what you explain on your paper 'Msnoise, a Python Package for monitoring....' Please can you help me?? Thank you very much for all the support that you give us.. it is very precious!! thank you for your patience too. I admire a lot your work and i want find a way to use it.. but i am meeting many difficulties ( i am a beginner).
>
> Cheers,
>
> -----------
> Mr Carmelo Sammarco MSc  BSc  FGS
> PhD student in Geology and Petroleum Geology
> University of Aberdeen
>
> ________________________________________
> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
> Sent: 09 October 2014 11:49
> To: msnoise at mailman-as.oma.be
> Subject: Re: [MSNoise] Error to run compute_cc
>
> Carmelo,
>
> 1/ it should not be empty, so you have to find the reason it has been
> identified "empty" when the scan_archive process analysed your files.
> Are the meta data in the files properly set ? This is essential.
>
> 2/ did you delete all "jobs" from the "jobs" table, mark all
> data_availability lines "N" and launch s02new_jobs.py ?
>
> You should maybe try to do a fresh install of MSNoise (delete the
> database content) and restart from the beginning. Ensuring that all
> steps are OK .
>
> Thomas
>
> Le 09/10/2014 12:46, Sammarco, Carmelo a écrit :
>> Thomas,
>>
>> I check and all the info are correct. As I told before I add the name of the network into 'net' in  the Data_availability table (before was empty).
>> Now it is all correct. So what is the other problem??
>>
>> cheers,
>>
>> -----------
>> Mr Carmelo Sammarco MSc  BSc  FGS
>> PhD student in Geology and Petroleum Geology
>> University of Aberdeen
>>
>> ________________________________________
>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
>> Sent: 09 October 2014 11:29
>> To: msnoise at mailman-as.oma.be
>> Subject: Re: [MSNoise] Error to run compute_cc
>>
>> Carmelo,
>>
>> as long as the network name is not correct, this step will never work.
>> So, please, check the data_availability table and the station tables and
>> control all elements are OK. If yes, there must be another problem, but
>> don't re-run the code that is not going to work, and don't paste again
>> the same error.
>>
>> Thomas
>>
>> Le 09/10/2014 12:19, Sammarco, Carmelo a écrit :
>>> Dear Thomas,
>>>
>>> I try again but it doesn't works.
>>>
>>>
>>>     File "s03compute_cc.py", line 313, in <module>
>>>        X0 = s1.X
>>> AttributeError: 'NoneType' object has no attribute 'X'
>>>
>>>
>>> I was thinking that the problem was the 3). So Now i want to ask.. if i write :
>>>
>>> s1 = get_station(db, networks[0], station1.split('.')[1])
>>>     s2 = get_station(db, networks[0], station2.split('.')[1])
>>>
>>> in this way works... I can see a new folder 'STACK' but i don't see the folder 'Cross_correlation'. Could explain me if is it ok? If it is ok i can process the data.. if not i need to find another solution..
>>> Thanks.
>>>
>>> Cheers,
>>> -----------
>>> Mr Carmelo Sammarco MSc  BSc  FGS
>>> PhD student in Geology and Petroleum Geology
>>> University of Aberdeen
>>>
>>> ________________________________________
>>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Sammarco, Carmelo <carmelosammarco at abdn.ac.uk>
>>> Sent: 09 October 2014 10:53
>>> To: msnoise at mailman-as.oma.be
>>> Subject: Re: [MSNoise] Error to run compute_cc
>>>
>>> Thomas,
>>>
>>> 1) The data structure is ok.
>>>
>>> 2) >> Populating the Station table
>>>
>>> Adding: YB 4623
>>> Adding: YB 4706
>>> Adding: YB 4711
>>> Adding: YB 4752
>>> Adding: YB 4903
>>> Adding: YB 5333
>>> Adding: YB 5432
>>> Adding: YB 5446
>>> Adding: YB 5478
>>> Adding: YB 5480
>>> Adding: YB 5481
>>> Adding: YB 5485
>>>
>>>
>>> 3) The content in 'net' is empty!!! Could be this the problem!!!
>>>
>>> thank you very much. Let me know what do you think..
>>>
>>> cheers,
>>> -----------
>>> Mr Carmelo Sammarco MSc  BSc  FGS
>>> PhD student in Geology and Petroleum Geology
>>> University of Aberdeen
>>>
>>> ________________________________________
>>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
>>> Sent: 09 October 2014 10:15
>>> To: msnoise at mailman-as.oma.be
>>> Subject: Re: [MSNoise] Error to run compute_cc
>>>
>>> Carmelo,
>>>
>>> The network code is empty, that is the problem !
>>>
>>> 1/ Please make sure your data archive is properly defined (SDS, BUD, other).
>>> 2/ When you ran the "populate station table" code, did it mention
>>> "network.station" (eg. BE.SKQ, BE.ZEV) codes ?
>>> 3/ What does the data_availability table look like (the content), are
>>> "net, sta, comp, path, file" parameters referring to existing files ?
>>>
>>> Thomas
>>>
>>>
>>> Le 09/10/2014 10:58, Sammarco, Carmelo a écrit :
>>>> Dear Thomas,
>>>>
>>>> the line says: 2014-10-09 09:35:37,178 [DEBUG] Processing pair: .5333 vs .5432
>>>>
>>>> I change s1=.. and s2=...  like this:  please tell me what you think..
>>>>
>>>> s1 = get_station(db, networks[0], station1.split('.')[1])
>>>> s2 = get_station(db, networks[0], station2.split('.')[1])
>>>>
>>>>
>>>> my correction is ok ?? Now run!!! but I don't know if in this way it is correct. I thought to add info about station.. because in the old one there wasn't this information. Now my computer is working and I have  a new folder called 'stack' but no folder called Cross_Correlation. is it normal?? let me know..
>>>>
>>>> cheers,
>>>>
>>>> Carmelo
>>>>
>>>>
>>>>
>>>> -----------
>>>> Mr Carmelo Sammarco MSc  BSc  FGS
>>>> PhD student in Geology and Petroleum Geology
>>>> University of Aberdeen
>>>>
>>>> ________________________________________
>>>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
>>>> Sent: 09 October 2014 08:56
>>>> To: msnoise at mailman-as.oma.be
>>>> Subject: Re: [MSNoise] Error to run compute_cc
>>>>
>>>> Carmelo,
>>>>
>>>> I asked you about the *output* of the line "logging.debug('Processing
>>>> pair: %s' % pair.replace(':', ' vs '))", when you run the code, in the
>>>> command window, the line should say which pais is being used, something
>>>> like:
>>>>
>>>> "[2014-10-09 ...] Processing pair: BE.SKQ vs BE.ZEV"
>>>>
>>>> This would help understanding the reasons of s1 being "None"...
>>>>
>>>> Thomas
>>>>
>>>>
>>>>
>>>> ps : please refrain from "begging" for help in your messages.
>>>>
>>>>
>>>> Le 08/10/2014 10:43, Sammarco, Carmelo a écrit :
>>>>> Dear Thomas and all,
>>>>>
>>>>> I don't find a way to resolve the problem( you can read below if you don't remember). I have the same line that you write below. The problem I think could be in the following expression:
>>>>>
>>>>> s1= ....
>>>>> s2=....
>>>>>
>>>>> when I print s1 or s2 they are 'None'. If before  's1=...' and 's2=...' I  write 'print pair' the terminal show me (0,1) that it is correct.
>>>>>
>>>>> what do you think?? Could be useful delete the station table and create again with the script (Populate station table)??  I hope that you will let me know..
>>>>> anyway thank you all guys to help me.
>>>>>
>>>>> cheers,
>>>>>
>>>>> Carmelo
>>>>> ________________________________________
>>>>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
>>>>> Sent: 07 October 2014 16:13
>>>>> To: msnoise at mailman-as.oma.be
>>>>> Subject: Re: [MSNoise] Error to run compute_cc
>>>>>
>>>>> Carmelo,
>>>>>
>>>>> 0,1 seems OK
>>>>>
>>>>> what does this line say ?
>>>>>
>>>>> logging.debug('Processing pair: %s' % pair.replace(':', ' vs '))
>>>>>
>>>>> Thomas
>>>>>
>>>>> ps: yes, I said before, the __version__ tag is not correct, don't worry.
>>>>>
>>>>> Le 07/10/2014 17:10, Sammarco, Carmelo a écrit :
>>>>>> Dear Thomas,
>>>>>>
>>>>>> I did it. With the replacement of all the file nothing change. I wrote what you say.('print pair' in line 309 before s1=.. and s2=..)
>>>>>> The result of this print was '(0 , 1)'. I also notice that in the new init file the version is still 1.0.1.. is it normal?? I think that what show the 'print pair'  is wrong because I don't see the name of the station, right?? Let me know what you think. In the mean time I will try and try again to find a solution. thank you.
>>>>>>
>>>>>> cheers,
>>>>>>
>>>>>> Carmelo
>>>>>>
>>>>>>
>>>>>>
>>>>>> ________________________________________
>>>>>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
>>>>>> Sent: 07 October 2014 15:50
>>>>>> To: msnoise at mailman-as.oma.be
>>>>>> Subject: Re: [MSNoise] Error to run compute_cc
>>>>>>
>>>>>> yeah, the __version__ tag is not correct.
>>>>>>
>>>>>> to be sure, overwrite the python files with those
>>>>>> https://github.com/ROBelgium/MSNoise/archive/1.2.5.zip and test.
>>>>>>
>>>>>> then if the error persists:
>>>>>>
>>>>>> add at line 309
>>>>>> (https://github.com/ROBelgium/MSNoise/blob/1.2.5/s03compute_cc.py#L309)
>>>>>>
>>>>>>           print pair
>>>>>>
>>>>>> and check that the stations do exist in the database?
>>>>>>
>>>>>> Thomas
>>>>>>
>>>>>> Le 07/10/2014 16:47, Sammarco, Carmelo a écrit :
>>>>>>> Dear Thomas,
>>>>>>>
>>>>>>> I am running the 1.0.1.  It is so an old version... I see this info on the init file(2013 version). I try also to print s1 and s2 in the script before the line where there is the error (line 313) and as you told like result I have 'none'. So in this case what do you suggest to me? Could be a bug of an old version? thank you very much for your time and support.
>>>>>>>
>>>>>>> cheers,
>>>>>>>
>>>>>>> Carmelo
>>>>>>> ________________________________________
>>>>>>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
>>>>>>> Sent: 07 October 2014 14:57
>>>>>>> To: msnoise at mailman-as.oma.be
>>>>>>> Subject: Re: [MSNoise] Error to run compute_cc
>>>>>>>
>>>>>>> Carmelo,
>>>>>>>
>>>>>>> Looking at it in more details, the error you face is because "s1 is
>>>>>>> None", which should NEVER happen. Could you tell me which version you
>>>>>>> are using ? is it the latest tagged version ? (1.2.5) ?
>>>>>>>
>>>>>>> Thomas
>>>>>>>
>>>>>>> Le 06/10/2014 16:13, Sammarco, Carmelo a écrit :
>>>>>>>> Dear Thomas,
>>>>>>>>
>>>>>>>> Now i am going to correct Lat and Long.. but the components are as you told me.. the only 'Y' is in ZZ.
>>>>>>>> The coordinates are in degree..so there is'DEG' and no 'UTM' in the field 'coordinates' where all the stations are. Thank you very much for your help and sorry if i maybe ask too much.. but i am in the beginning..
>>>>>>>>
>>>>>>>> cheers,
>>>>>>>>
>>>>>>>> Carmelo
>>>>>>>> ________________________________________
>>>>>>>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
>>>>>>>> Sent: 06 October 2014 14:56
>>>>>>>> To: Python Package for Monitoring Seismic Velocity Changes using Ambient Seismic Noise
>>>>>>>> Subject: Re: [MSNoise] Error to run compute_cc
>>>>>>>>
>>>>>>>> Carmelo,
>>>>>>>>
>>>>>>>> first= X=Lon and Y=Lat, usually.. but that's not your problem. I suspect
>>>>>>>> the components to be checked (="Y") in the configurator, while only "ZZ"
>>>>>>>> should be set equal to "Y", the other 8 (ZR,RT,...) set to "N" !
>>>>>>>>
>>>>>>>> Thomas
>>>>>>>>
>>>>>>>> Le 06.10.2014 15:28, Sammarco, Carmelo a écrit :
>>>>>>>>> Dear Thomas,
>>>>>>>>>
>>>>>>>>> As you told me I check all the parameters in the configurator. The X
>>>>>>>>> and Y are well populated(X=LAT / Y=LONG), I have only the ZZ job to do
>>>>>>>>> and I check it on the Configurator options. The error still happens. I
>>>>>>>>> don't know what could be.. very strange.
>>>>>>>>>
>>>>>>>>> cheers,
>>>>>>>>>
>>>>>>>>> Carmelo
>>>>>>>>> ________________________________________
>>>>>>>>> From: msnoise-bounces at mailman-as.oma.be
>>>>>>>>> <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq
>>>>>>>>> <thomas.lecocq at oma.be>
>>>>>>>>> Sent: 06 October 2014 12:26
>>>>>>>>> To: msnoise at mailman-as.oma.be
>>>>>>>>> Subject: Re: [MSNoise] Error to run compute_cc
>>>>>>>>>
>>>>>>>>> Carmelo,
>>>>>>>>>
>>>>>>>>> it looks like:
>>>>>>>>> * You are computing something else than ZZ (other components of the
>>>>>>>>> tensor, requiring horizontal components)
>>>>>>>>> * You have at least one station with no station coordinates defined in
>>>>>>>>> the database
>>>>>>>>>
>>>>>>>>> Check the configurator to edit the stations and ensure they have X,Y
>>>>>>>>> coordinates properly entered.
>>>>>>>>>
>>>>>>>>> If this is your case, are you sure you do have horizontal components
>>>>>>>>> for
>>>>>>>>> all your stations ? do files exist ?
>>>>>>>>>
>>>>>>>>> Cheers
>>>>>>>>>
>>>>>>>>> Thomas
>>>>>>>>>
>>>>>>>>> Le 06/10/2014 13:10, Sammarco, Carmelo a écrit :
>>>>>>>>>> Dear all,
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> When I run Compute_cc  the terminal show this message:
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> File "s03compute_cc.py", line 313, in <module>
>>>>>>>>>>              X0 = s1.X
>>>>>>>>>> AttributeError: 'NoneType' object has no attribute 'X'
>>>>>>>>>>
>>>>>>>>>> ?In which way can I fix it?? The attribute X, Y and also Z exits  in
>>>>>>>>>> the table and I also populate it. So I don't understand this type of
>>>>>>>>>> error. thank you very much. I hope to receive some answer..
>>>>>>>>>>
>>>>>>>>>> cheers,
>>>>>>>>>>
>>>>>>>>>> Carmelo
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> The University of Aberdeen is a charity registered in Scotland, No
>>>>>>>>>> SC013683.
>>>>>>>>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba,
>>>>>>>>>> Àir. SC013683.
>>>>>>>>>> _______________________________________________
>>>>>>>>>> MSNoise mailing list
>>>>>>>>>> MSNoise at mailman-as.oma.be
>>>>>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>>>>> _______________________________________________
>>>>>>>>> MSNoise mailing list
>>>>>>>>> MSNoise at mailman-as.oma.be
>>>>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> The University of Aberdeen is a charity registered in Scotland, No
>>>>>>>>> SC013683.
>>>>>>>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba,
>>>>>>>>> Àir. SC013683.
>>>>>>>>> _______________________________________________
>>>>>>>>> MSNoise mailing list
>>>>>>>>> MSNoise at mailman-as.oma.be
>>>>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>>>> _______________________________________________
>>>>>>>> MSNoise mailing list
>>>>>>>> MSNoise at mailman-as.oma.be
>>>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>>>>
>>>>>>>>
>>>>>>>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>>>>>>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>>>>>>>> _______________________________________________
>>>>>>>> MSNoise mailing list
>>>>>>>> MSNoise at mailman-as.oma.be
>>>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>>> _______________________________________________
>>>>>>> MSNoise mailing list
>>>>>>> MSNoise at mailman-as.oma.be
>>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>>>
>>>>>>>
>>>>>>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>>>>>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>>>>>>> _______________________________________________
>>>>>>> MSNoise mailing list
>>>>>>> MSNoise at mailman-as.oma.be
>>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>> _______________________________________________
>>>>>> MSNoise mailing list
>>>>>> MSNoise at mailman-as.oma.be
>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>>
>>>>>>
>>>>>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>>>>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>>>>>> _______________________________________________
>>>>>> MSNoise mailing list
>>>>>> MSNoise at mailman-as.oma.be
>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>> _______________________________________________
>>>>> MSNoise mailing list
>>>>> MSNoise at mailman-as.oma.be
>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>
>>>>>
>>>>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>>>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>>>>> _______________________________________________
>>>>> MSNoise mailing list
>>>>> MSNoise at mailman-as.oma.be
>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>> _______________________________________________
>>>> MSNoise mailing list
>>>> MSNoise at mailman-as.oma.be
>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>
>>>>
>>>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>>>> _______________________________________________
>>>> MSNoise mailing list
>>>> MSNoise at mailman-as.oma.be
>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>> _______________________________________________
>>> MSNoise mailing list
>>> MSNoise at mailman-as.oma.be
>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>
>>>
>>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>>> _______________________________________________
>>> MSNoise mailing list
>>> MSNoise at mailman-as.oma.be
>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>
>>>
>>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>>> _______________________________________________
>>> MSNoise mailing list
>>> MSNoise at mailman-as.oma.be
>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>> _______________________________________________
>> MSNoise mailing list
>> MSNoise at mailman-as.oma.be
>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>
>>
>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>> _______________________________________________
>> MSNoise mailing list
>> MSNoise at mailman-as.oma.be
>> http://mailman-as.oma.be/mailman/listinfo/msnoise
> _______________________________________________
> MSNoise mailing list
> MSNoise at mailman-as.oma.be
> http://mailman-as.oma.be/mailman/listinfo/msnoise
>
>
> The University of Aberdeen is a charity registered in Scotland, No SC013683.
> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
> _______________________________________________
> MSNoise mailing list
> MSNoise at mailman-as.oma.be
> http://mailman-as.oma.be/mailman/listinfo/msnoise

More information about the MSNoise mailing list