[MSNoise] Error to run compute_cc

Thu Oct 9 16:37:05 UTC 2014

Thomas,

Now 'compute_cc' is running. I lunched again like you told me in '2/' s02new_jobs.py. I want now ask you something about the output. I have only a folder called 'STACK' . In the configurator the folder for the cross correlation isn't stack but 'CROSS_CORRELATION'. Please explain me this differences or maybe is there something wrong?? If you want i can send you a sample of this data. Let me know.

cheers,

-----------
Mr Carmelo Sammarco MSc  BSc  FGS
PhD student in Geology and Petroleum Geology
University of Aberdeen

________________________________________
From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
Sent: 09 October 2014 11:49
To: msnoise at mailman-as.oma.be
Subject: Re: [MSNoise] Error to run compute_cc

Carmelo,

1/ it should not be empty, so you have to find the reason it has been
identified "empty" when the scan_archive process analysed your files.
Are the meta data in the files properly set ? This is essential.

2/ did you delete all "jobs" from the "jobs" table, mark all
data_availability lines "N" and launch s02new_jobs.py ?

You should maybe try to do a fresh install of MSNoise (delete the
database content) and restart from the beginning. Ensuring that all
steps are OK .

Thomas

Le 09/10/2014 12:46, Sammarco, Carmelo a écrit :
> Thomas,
>
> I check and all the info are correct. As I told before I add the name of the network into 'net' in  the Data_availability table (before was empty).
> Now it is all correct. So what is the other problem??
>
> cheers,
>
> -----------
> Mr Carmelo Sammarco MSc  BSc  FGS
> PhD student in Geology and Petroleum Geology
> University of Aberdeen
>
> ________________________________________
> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
> Sent: 09 October 2014 11:29
> To: msnoise at mailman-as.oma.be
> Subject: Re: [MSNoise] Error to run compute_cc
>
> Carmelo,
>
> as long as the network name is not correct, this step will never work.
> So, please, check the data_availability table and the station tables and
> control all elements are OK. If yes, there must be another problem, but
> don't re-run the code that is not going to work, and don't paste again
> the same error.
>
> Thomas
>
> Le 09/10/2014 12:19, Sammarco, Carmelo a écrit :
>> Dear Thomas,
>>
>> I try again but it doesn't works.
>>
>>
>>    File "s03compute_cc.py", line 313, in <module>
>>       X0 = s1.X
>> AttributeError: 'NoneType' object has no attribute 'X'
>>
>>
>> I was thinking that the problem was the 3). So Now i want to ask.. if i write :
>>
>> s1 = get_station(db, networks[0], station1.split('.')[1])
>>    s2 = get_station(db, networks[0], station2.split('.')[1])
>>
>> in this way works... I can see a new folder 'STACK' but i don't see the folder 'Cross_correlation'. Could explain me if is it ok? If it is ok i can process the data.. if not i need to find another solution..
>> Thanks.
>>
>> Cheers,
>> -----------
>> Mr Carmelo Sammarco MSc  BSc  FGS
>> PhD student in Geology and Petroleum Geology
>> University of Aberdeen
>>
>> ________________________________________
>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Sammarco, Carmelo <carmelosammarco at abdn.ac.uk>
>> Sent: 09 October 2014 10:53
>> To: msnoise at mailman-as.oma.be
>> Subject: Re: [MSNoise] Error to run compute_cc
>>
>> Thomas,
>>
>> 1) The data structure is ok.
>>
>> 2) >> Populating the Station table
>>
>> Adding: YB 4623
>> Adding: YB 4706
>> Adding: YB 4711
>> Adding: YB 4752
>> Adding: YB 4903
>> Adding: YB 5333
>> Adding: YB 5432
>> Adding: YB 5446
>> Adding: YB 5478
>> Adding: YB 5480
>> Adding: YB 5481
>> Adding: YB 5485
>>
>>
>> 3) The content in 'net' is empty!!! Could be this the problem!!!
>>
>> thank you very much. Let me know what do you think..
>>
>> cheers,
>> -----------
>> Mr Carmelo Sammarco MSc  BSc  FGS
>> PhD student in Geology and Petroleum Geology
>> University of Aberdeen
>>
>> ________________________________________
>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
>> Sent: 09 October 2014 10:15
>> To: msnoise at mailman-as.oma.be
>> Subject: Re: [MSNoise] Error to run compute_cc
>>
>> Carmelo,
>>
>> The network code is empty, that is the problem !
>>
>> 1/ Please make sure your data archive is properly defined (SDS, BUD, other).
>> 2/ When you ran the "populate station table" code, did it mention
>> "network.station" (eg. BE.SKQ, BE.ZEV) codes ?
>> 3/ What does the data_availability table look like (the content), are
>> "net, sta, comp, path, file" parameters referring to existing files ?
>>
>> Thomas
>>
>>
>> Le 09/10/2014 10:58, Sammarco, Carmelo a écrit :
>>> Dear Thomas,
>>>
>>> the line says: 2014-10-09 09:35:37,178 [DEBUG] Processing pair: .5333 vs .5432
>>>
>>> I change s1=.. and s2=...  like this:  please tell me what you think..
>>>
>>> s1 = get_station(db, networks[0], station1.split('.')[1])
>>> s2 = get_station(db, networks[0], station2.split('.')[1])
>>>
>>>
>>> my correction is ok ?? Now run!!! but I don't know if in this way it is correct. I thought to add info about station.. because in the old one there wasn't this information. Now my computer is working and I have  a new folder called 'stack' but no folder called Cross_Correlation. is it normal?? let me know..
>>>
>>> cheers,
>>>
>>> Carmelo
>>>
>>>
>>>
>>> -----------
>>> Mr Carmelo Sammarco MSc  BSc  FGS
>>> PhD student in Geology and Petroleum Geology
>>> University of Aberdeen
>>>
>>> ________________________________________
>>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
>>> Sent: 09 October 2014 08:56
>>> To: msnoise at mailman-as.oma.be
>>> Subject: Re: [MSNoise] Error to run compute_cc
>>>
>>> Carmelo,
>>>
>>> I asked you about the *output* of the line "logging.debug('Processing
>>> pair: %s' % pair.replace(':', ' vs '))", when you run the code, in the
>>> command window, the line should say which pais is being used, something
>>> like:
>>>
>>> "[2014-10-09 ...] Processing pair: BE.SKQ vs BE.ZEV"
>>>
>>> This would help understanding the reasons of s1 being "None"...
>>>
>>> Thomas
>>>
>>>
>>>
>>> ps : please refrain from "begging" for help in your messages.
>>>
>>>
>>> Le 08/10/2014 10:43, Sammarco, Carmelo a écrit :
>>>> Dear Thomas and all,
>>>>
>>>> I don't find a way to resolve the problem( you can read below if you don't remember). I have the same line that you write below. The problem I think could be in the following expression:
>>>>
>>>> s1= ....
>>>> s2=....
>>>>
>>>> when I print s1 or s2 they are 'None'. If before  's1=...' and 's2=...' I  write 'print pair' the terminal show me (0,1) that it is correct.
>>>>
>>>> what do you think?? Could be useful delete the station table and create again with the script (Populate station table)??  I hope that you will let me know..
>>>> anyway thank you all guys to help me.
>>>>
>>>> cheers,
>>>>
>>>> Carmelo
>>>> ________________________________________
>>>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
>>>> Sent: 07 October 2014 16:13
>>>> To: msnoise at mailman-as.oma.be
>>>> Subject: Re: [MSNoise] Error to run compute_cc
>>>>
>>>> Carmelo,
>>>>
>>>> 0,1 seems OK
>>>>
>>>> what does this line say ?
>>>>
>>>> logging.debug('Processing pair: %s' % pair.replace(':', ' vs '))
>>>>
>>>> Thomas
>>>>
>>>> ps: yes, I said before, the __version__ tag is not correct, don't worry.
>>>>
>>>> Le 07/10/2014 17:10, Sammarco, Carmelo a écrit :
>>>>> Dear Thomas,
>>>>>
>>>>> I did it. With the replacement of all the file nothing change. I wrote what you say.('print pair' in line 309 before s1=.. and s2=..)
>>>>> The result of this print was '(0 , 1)'. I also notice that in the new init file the version is still 1.0.1.. is it normal?? I think that what show the 'print pair'  is wrong because I don't see the name of the station, right?? Let me know what you think. In the mean time I will try and try again to find a solution. thank you.
>>>>>
>>>>> cheers,
>>>>>
>>>>> Carmelo
>>>>>
>>>>>
>>>>>
>>>>> ________________________________________
>>>>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
>>>>> Sent: 07 October 2014 15:50
>>>>> To: msnoise at mailman-as.oma.be
>>>>> Subject: Re: [MSNoise] Error to run compute_cc
>>>>>
>>>>> yeah, the __version__ tag is not correct.
>>>>>
>>>>> to be sure, overwrite the python files with those
>>>>> https://github.com/ROBelgium/MSNoise/archive/1.2.5.zip and test.
>>>>>
>>>>> then if the error persists:
>>>>>
>>>>> add at line 309
>>>>> (https://github.com/ROBelgium/MSNoise/blob/1.2.5/s03compute_cc.py#L309)
>>>>>
>>>>>          print pair
>>>>>
>>>>> and check that the stations do exist in the database?
>>>>>
>>>>> Thomas
>>>>>
>>>>> Le 07/10/2014 16:47, Sammarco, Carmelo a écrit :
>>>>>> Dear Thomas,
>>>>>>
>>>>>> I am running the 1.0.1.  It is so an old version... I see this info on the init file(2013 version). I try also to print s1 and s2 in the script before the line where there is the error (line 313) and as you told like result I have 'none'. So in this case what do you suggest to me? Could be a bug of an old version? thank you very much for your time and support.
>>>>>>
>>>>>> cheers,
>>>>>>
>>>>>> Carmelo
>>>>>> ________________________________________
>>>>>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
>>>>>> Sent: 07 October 2014 14:57
>>>>>> To: msnoise at mailman-as.oma.be
>>>>>> Subject: Re: [MSNoise] Error to run compute_cc
>>>>>>
>>>>>> Carmelo,
>>>>>>
>>>>>> Looking at it in more details, the error you face is because "s1 is
>>>>>> None", which should NEVER happen. Could you tell me which version you
>>>>>> are using ? is it the latest tagged version ? (1.2.5) ?
>>>>>>
>>>>>> Thomas
>>>>>>
>>>>>> Le 06/10/2014 16:13, Sammarco, Carmelo a écrit :
>>>>>>> Dear Thomas,
>>>>>>>
>>>>>>> Now i am going to correct Lat and Long.. but the components are as you told me.. the only 'Y' is in ZZ.
>>>>>>> The coordinates are in degree..so there is'DEG' and no 'UTM' in the field 'coordinates' where all the stations are. Thank you very much for your help and sorry if i maybe ask too much.. but i am in the beginning..
>>>>>>>
>>>>>>> cheers,
>>>>>>>
>>>>>>> Carmelo
>>>>>>> ________________________________________
>>>>>>> From: msnoise-bounces at mailman-as.oma.be <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq <thomas.lecocq at oma.be>
>>>>>>> Sent: 06 October 2014 14:56
>>>>>>> To: Python Package for Monitoring Seismic Velocity Changes using Ambient Seismic Noise
>>>>>>> Subject: Re: [MSNoise] Error to run compute_cc
>>>>>>>
>>>>>>> Carmelo,
>>>>>>>
>>>>>>> first= X=Lon and Y=Lat, usually.. but that's not your problem. I suspect
>>>>>>> the components to be checked (="Y") in the configurator, while only "ZZ"
>>>>>>> should be set equal to "Y", the other 8 (ZR,RT,...) set to "N" !
>>>>>>>
>>>>>>> Thomas
>>>>>>>
>>>>>>> Le 06.10.2014 15:28, Sammarco, Carmelo a écrit :
>>>>>>>> Dear Thomas,
>>>>>>>>
>>>>>>>> As you told me I check all the parameters in the configurator. The X
>>>>>>>> and Y are well populated(X=LAT / Y=LONG), I have only the ZZ job to do
>>>>>>>> and I check it on the Configurator options. The error still happens. I
>>>>>>>> don't know what could be.. very strange.
>>>>>>>>
>>>>>>>> cheers,
>>>>>>>>
>>>>>>>> Carmelo
>>>>>>>> ________________________________________
>>>>>>>> From: msnoise-bounces at mailman-as.oma.be
>>>>>>>> <msnoise-bounces at mailman-as.oma.be> on behalf of Thomas Lecocq
>>>>>>>> <thomas.lecocq at oma.be>
>>>>>>>> Sent: 06 October 2014 12:26
>>>>>>>> To: msnoise at mailman-as.oma.be
>>>>>>>> Subject: Re: [MSNoise] Error to run compute_cc
>>>>>>>>
>>>>>>>> Carmelo,
>>>>>>>>
>>>>>>>> it looks like:
>>>>>>>> * You are computing something else than ZZ (other components of the
>>>>>>>> tensor, requiring horizontal components)
>>>>>>>> * You have at least one station with no station coordinates defined in
>>>>>>>> the database
>>>>>>>>
>>>>>>>> Check the configurator to edit the stations and ensure they have X,Y
>>>>>>>> coordinates properly entered.
>>>>>>>>
>>>>>>>> If this is your case, are you sure you do have horizontal components
>>>>>>>> for
>>>>>>>> all your stations ? do files exist ?
>>>>>>>>
>>>>>>>> Cheers
>>>>>>>>
>>>>>>>> Thomas
>>>>>>>>
>>>>>>>> Le 06/10/2014 13:10, Sammarco, Carmelo a écrit :
>>>>>>>>> Dear all,
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> When I run Compute_cc  the terminal show this message:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> File "s03compute_cc.py", line 313, in <module>
>>>>>>>>>             X0 = s1.X
>>>>>>>>> AttributeError: 'NoneType' object has no attribute 'X'
>>>>>>>>>
>>>>>>>>> ?In which way can I fix it?? The attribute X, Y and also Z exits  in
>>>>>>>>> the table and I also populate it. So I don't understand this type of
>>>>>>>>> error. thank you very much. I hope to receive some answer..
>>>>>>>>>
>>>>>>>>> cheers,
>>>>>>>>>
>>>>>>>>> Carmelo
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> The University of Aberdeen is a charity registered in Scotland, No
>>>>>>>>> SC013683.
>>>>>>>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba,
>>>>>>>>> Àir. SC013683.
>>>>>>>>> _______________________________________________
>>>>>>>>> MSNoise mailing list
>>>>>>>>> MSNoise at mailman-as.oma.be
>>>>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>>>> _______________________________________________
>>>>>>>> MSNoise mailing list
>>>>>>>> MSNoise at mailman-as.oma.be
>>>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>>>>
>>>>>>>>
>>>>>>>> The University of Aberdeen is a charity registered in Scotland, No
>>>>>>>> SC013683.
>>>>>>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba,
>>>>>>>> Àir. SC013683.
>>>>>>>> _______________________________________________
>>>>>>>> MSNoise mailing list
>>>>>>>> MSNoise at mailman-as.oma.be
>>>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>>> _______________________________________________
>>>>>>> MSNoise mailing list
>>>>>>> MSNoise at mailman-as.oma.be
>>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>>>
>>>>>>>
>>>>>>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>>>>>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>>>>>>> _______________________________________________
>>>>>>> MSNoise mailing list
>>>>>>> MSNoise at mailman-as.oma.be
>>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>> _______________________________________________
>>>>>> MSNoise mailing list
>>>>>> MSNoise at mailman-as.oma.be
>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>>
>>>>>>
>>>>>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>>>>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>>>>>> _______________________________________________
>>>>>> MSNoise mailing list
>>>>>> MSNoise at mailman-as.oma.be
>>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>> _______________________________________________
>>>>> MSNoise mailing list
>>>>> MSNoise at mailman-as.oma.be
>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>>
>>>>>
>>>>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>>>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>>>>> _______________________________________________
>>>>> MSNoise mailing list
>>>>> MSNoise at mailman-as.oma.be
>>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>> _______________________________________________
>>>> MSNoise mailing list
>>>> MSNoise at mailman-as.oma.be
>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>>
>>>>
>>>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>>>> _______________________________________________
>>>> MSNoise mailing list
>>>> MSNoise at mailman-as.oma.be
>>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>> _______________________________________________
>>> MSNoise mailing list
>>> MSNoise at mailman-as.oma.be
>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>>
>>>
>>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>>> _______________________________________________
>>> MSNoise mailing list
>>> MSNoise at mailman-as.oma.be
>>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>> _______________________________________________
>> MSNoise mailing list
>> MSNoise at mailman-as.oma.be
>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>
>>
>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>> _______________________________________________
>> MSNoise mailing list
>> MSNoise at mailman-as.oma.be
>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>
>>
>> The University of Aberdeen is a charity registered in Scotland, No SC013683.
>> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
>> _______________________________________________
>> MSNoise mailing list
>> MSNoise at mailman-as.oma.be
>> http://mailman-as.oma.be/mailman/listinfo/msnoise
> _______________________________________________
> MSNoise mailing list
> MSNoise at mailman-as.oma.be
> http://mailman-as.oma.be/mailman/listinfo/msnoise
>
>
> The University of Aberdeen is a charity registered in Scotland, No SC013683.
> Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.
> _______________________________________________
> MSNoise mailing list
> MSNoise at mailman-as.oma.be
> http://mailman-as.oma.be/mailman/listinfo/msnoise

_______________________________________________
MSNoise mailing list
MSNoise at mailman-as.oma.be
http://mailman-as.oma.be/mailman/listinfo/msnoise

The University of Aberdeen is a charity registered in Scotland, No SC013683.
Tha Oilthigh Obar Dheathain na charthannas clàraichte ann an Alba, Àir. SC013683.