[MSNoise] Found 0 new Jobs to do

Thu Mar 13 12:37:51 UTC 2014

Hi Esteban,

If you use sqlite, you cannot use more than 1 thread, otherwise there 
are big chances some data will be lost. So option "-t 1" is compulsory.

With the new scan_archive code, there is no longer visual ouptut of the 
scans, that is a problem I'm trying to solve soon.

When you run the scan_archive -i -t1, it looks like your archive takes 
some time to be scanned (72s), so I assume the scan is OK. Can you 
confirm that after this step, the data_availability table contains 
metadata for the station/files ?

Then, what could happen is that you haven't properly configured the 
start and end-times in the configurator, so no new jobs are found.

Thomas

Le 12/03/2014 20:35, Esteban Chaves a écrit :
> Hi Tomas et al;
>
> I got the next problem:
>
> Estebans-MacBook-Pro:MSNoise-master ech$ python s002populate_station_table.py
>
>>> Populating the Station table
> Adding: YZ INDI
> Adding: YZ JUDI
> Adding: YZ SAJU
> Estebans-MacBook-Pro:MSNoise-master ech$ python s01scan_archive.py -i -t 2
> 2014-03-12 12:14:23,805 [INFO] *** Starting: Scan Archive ***
> 2014-03-12 12:14:23,816 [INFO] Initializing (should be run only once)
> 2014-03-12 12:14:23,816 [INFO] Will work on 2 threads
> 2014-03-12 12:14:23,830 [INFO] Started: /Users/ech/gap/YZ/INDI
> 2014-03-12 12:14:23,833 [INFO] Started: /Users/ech/gap/YZ/INDI
> 2014-03-12 12:14:23,834 [INFO] child process calling self.run()
> 2014-03-12 12:14:23,836 [INFO] child process calling self.run()
> 2014-03-12 12:14:41,157 [INFO] process shutting down
> 2014-03-12 12:14:41,157 [INFO] process exiting with exitcode 0
> 2014-03-12 12:14:41,159 [INFO] process shutting down
> 2014-03-12 12:14:41,159 [INFO] process exiting with exitcode 0
> 2014-03-12 12:14:41,196 [INFO] Started: /Users/ech/gap/YZ/INDI
> 2014-03-12 12:14:41,200 [INFO] child process calling self.run()
> 2014-03-12 12:14:41,200 [INFO] Started: /Users/ech/gap/YZ/JUDI
> 2014-03-12 12:14:41,204 [INFO] child process calling self.run()
> 2014-03-12 12:14:56,235 [INFO] process shutting down
> 2014-03-12 12:14:56,236 [INFO] process exiting with exitcode 0
> 2014-03-12 12:14:56,275 [INFO] Started: /Users/ech/gap/YZ/JUDI
> 2014-03-12 12:14:56,279 [INFO] child process calling self.run()
> 2014-03-12 12:14:57,349 [INFO] process shutting down
> 2014-03-12 12:14:57,349 [INFO] process exiting with exitcode 0
> 2014-03-12 12:14:57,372 [INFO] Started: /Users/ech/gap/YZ/JUDI
> 2014-03-12 12:14:57,375 [INFO] child process calling self.run()
> 2014-03-12 12:15:09,552 [INFO] process shutting down
> 2014-03-12 12:15:09,552 [INFO] process exiting with exitcode 0
> 2014-03-12 12:15:09,578 [INFO] Started: /Users/ech/gap/YZ/SAJU
> 2014-03-12 12:15:09,581 [INFO] child process calling self.run()
> 2014-03-12 12:15:10,519 [INFO] process shutting down
> 2014-03-12 12:15:10,519 [INFO] process exiting with exitcode 0
> 2014-03-12 12:15:10,539 [INFO] Started: /Users/ech/gap/YZ/SAJU
> 2014-03-12 12:15:10,542 [INFO] child process calling self.run()
> 2014-03-12 12:15:24,492 [INFO] process shutting down
> 2014-03-12 12:15:24,492 [INFO] process exiting with exitcode 0
> 2014-03-12 12:15:24,493 [INFO] process shutting down
> 2014-03-12 12:15:24,494 [INFO] process exiting with exitcode 0
> 2014-03-12 12:15:24,519 [INFO] Started: /Users/ech/gap/YZ/SAJU
> 2014-03-12 12:15:24,522 [INFO] child process calling self.run()
> 2014-03-12 12:15:36,690 [INFO] process shutting down
> 2014-03-12 12:15:36,691 [INFO] process exiting with exitcode 0
> 2014-03-12 12:15:36,709 [INFO] *** Finished: Scan Archive ***
> 2014-03-12 12:15:36,710 [INFO] It took 72.91 seconds
> 2014-03-12 12:15:36,710 [INFO] process shutting down
> Estebans-MacBook-Pro:MSNoise-master ech$ python s02new_jobs.py
> 2014-03-12 12:15:53,224 [INFO] *** Starting: New Jobs ***
> 2014-03-12 12:15:54,548 [DEBUG] Found 0 new jobs to do
> 2014-03-12 12:15:54,664 [INFO] *** Finished: New Jobs ***
>
>
> My data is in BUD format and I’m using the last MASTER release of MSNoise. This is the first time that I got this kind of problem. If you see my msnoise.sqlite table
> you will see that I’m trying to process data starting from day 2012-286 and basically (I think) it cannot initialize the jobs after scan. The weird thing is that using the previous days, say from May 2012 till September 2012 the programs works very well.
>
> I appreciate your help;
>
> Esteban
> PhD Student in Seismology
> University of California, Santa Cruz
>
>
>
>
>
>
>
> On Mar 9, 2014, at 5:00 AM, msnoise-request at mailman-as.oma.be wrote:
>
>> Send MSNoise mailing list submissions to
>> 	msnoise at mailman-as.oma.be
>>
>> To subscribe or unsubscribe via the World Wide Web, visit
>> 	http://mailman-as.oma.be/mailman/listinfo/msnoise
>> or, via email, send a message with subject or body 'help' to
>> 	msnoise-request at mailman-as.oma.be
>>
>> You can reach the person managing the list at
>> 	msnoise-owner at mailman-as.oma.be
>>
>> When replying, please edit your Subject line so it is more specific
>> than "Re: Contents of MSNoise digest..."
>>
>>
>> Today's Topics:
>>
>>    1. Fwd: MSNoise: filters (Thomas Lecocq)
>>
>>
>> ----------------------------------------------------------------------
>>
>> Message: 1
>> Date: Sat, 08 Mar 2014 16:56:15 +0100
>> From: Thomas Lecocq <thomas.lecocq at seismology.be>
>> To: Python Package for Monitoring Seismic Velocity Changes using
>> 	Ambient	Seismic Noise <msnoise at mailman-as.oma.be>
>> Subject: [MSNoise] Fwd: MSNoise: filters
>> Message-ID: <531B3D9F.3040003 at seismology.be>
>> Content-Type: text/plain; charset=ISO-8859-1; format=flowed
>>
>> Hi H?l?ne,
>>
>> The filters need to be defined in the configurator. Filter bounds define
>> the bandpass that will whitened. Around this whitened part, the spectra
>> will be tapered to 0.+0j.
>>
>> Indeed, I've rechecked the doc, it's not very obvious. Thanks for
>> pointing this out :) I'll try to spend some time on the doc soon.
>>
>> Briefly: each filter is defined with:
>> low : lower frequency of the bandpass
>> high : upper ...
>>
>> mwcs_low : slightly higher than low, it is the lower frequency for which
>> MWCS' weighted linear regression will be estimated
>> mwcs_high : slightly lower than high,...
>>
>> mwcs_wlen : window length for computing the relative delay in the MWCS
>> mwcs_step : step between two windows. if equal to mwcs_wlen: no overlap.
>>
>> rms_threshold: not used any more, should disappear, set it to 0.0.
>>
>> Hope this helps, let me know (via this mailing list, svp.)
>>
>> Thom
>>
>> -------- Message original --------
>> Sujet: 	MSNoise: filters
>> Date : 	Sat, 8 Mar 2014 14:14:33 +0100
>>
>> 	
>> Pour : 	Thomas Lecocq <thomas.lecocq at oma.be>
>>
>>
>>
>> Thomas, we solved the problem with scikits_samplerate apprently related to
>> some export in my .bashrc.
>> I am now  at s03compute_cc.py and get an error because I did not define any
>> filters: apparently this is not implementted yet (?) , to what these filters
>> correspond?
>> Cheers
>> Helene
>>
>> -----Message d'origine-----
>> From: Thomas Lecocq
>> Sent: Thursday, March 06, 2014 5:45 PM
>> To: Helene.Lyon-Caen at ens.fr
>> Subject: Re: scikits
>>
>> H?l?ne,
>>
>> You could remove the dependency to scikits by using only Decimation, if
>> all your data are in the same sampling rate !
>>
>> Thom
>>
>> Le 06/03/2014 16:18, Helene Lyon-Caen a ?crit :
>>> Thomas,
>>> we have been trying to understand with the computer engineer here. The
>>> only differences with what is on your web site we could find is that we
>>> use a more recent version of anaconda (1.9) and of python (2.7.6)
>>> could that make a difference?
>>
>>
>>
>>
>> ------------------------------
>>
>> _______________________________________________
>> MSNoise mailing list
>> MSNoise at mailman-as.oma.be
>> http://mailman-as.oma.be/mailman/listinfo/msnoise
>>
>>
>> End of MSNoise Digest, Vol 5, Issue 4
>> *************************************
> _______________________________________________
> MSNoise mailing list
> MSNoise at mailman-as.oma.be
> http://mailman-as.oma.be/mailman/listinfo/msnoise