[MSNoise] Problem with database conection.

Oscar Alberto Castro Artola oscar.cas.art at gmail.com
Thu Jun 1 15:59:51 UTC 2017


Hello,

I have 10 years of data for 13 stations, I have computed the CCF and now it
is turn to compute the MWCS. When I do *msnoise -t 20 compute_mwcs *this
error appears:

*Process Process-4:*
*Traceback (most recent call last):*
*  File "/usr/local/anaconda/lib/python2.7/multiprocessing/process.py",
line 258, in _bootstrap*
*    self.run()*
*  File "/usr/local/anaconda/lib/python2.7/multiprocessing/process.py",
line 114, in run*
*    self._target(*self._args, **self._kwargs)*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/msnoise/s05compute_mwcs.py",
line 150, in main*
*    update_job(db, day, pair, jobtype='DTT', flag='D')*
*  File "/usr/local/anaconda/lib/python2.7/site-packages/msnoise/api.py",
line 615, in update_job*
*    job = session.query(Job).filter(Job.day == day).filter(Job.pair ==
pair).filter(Job.jobtype == jobtype).first()*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/orm/query.py",
line 2755, in first*
*    ret = list(self[0:1])*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/orm/query.py",
line 2547, in __getitem__*
*    return list(res)*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/orm/query.py",
line 2855, in __iter__*
*    return self._execute_and_instances(context)*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/orm/query.py",
line 2878, in _execute_and_instances*
*    result = conn.execute(querycontext.statement, self._params)*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 945, in execute*
*    return meth(self, multiparams, params)*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/sql/elements.py",
line 263, in _execute_on_connection*
*    return connection._execute_clauseelement(self, multiparams, params)*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1053, in _execute_clauseelement*
*    compiled_sql, distilled_params*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1189, in _execute_context*
*    context)*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1402, in _handle_dbapi_exception*
*    exc_info*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/util/compat.py",
line 203, in raise_from_cause*
*    reraise(type(exception), exception, tb=exc_tb, cause=cause)*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/engine/base.py",
line 1182, in _execute_context*
*    context)*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/sqlalchemy/engine/default.py",
line 470, in do_execute*
*    cursor.execute(statement, parameters)*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/pymysql/cursors.py", line
158, in execute*
*    result = self._query(query)*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/pymysql/cursors.py", line
308, in _query*
*    conn.query(q)*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/pymysql/connections.py",
line 819, in query*
*    self._execute_command(COMMAND.COM_QUERY, sql)*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/pymysql/connections.py",
line 1037, in _execute_command*
*    self._write_bytes(packet)*
*  File
"/usr/local/anaconda/lib/python2.7/site-packages/pymysql/connections.py",
line 989, in _write_bytes*
*    raise err.OperationalError(2006, "MySQL server has gone away (%r)" %
(e,))*
*OperationalError: (pymysql.err.OperationalError) (2006, "MySQL server has
gone away (error(32, 'Broken pipe'))") [SQL: u'SELECT jobs.ref AS jobs_ref,
jobs.day AS jobs_day, jobs.pair AS jobs_pair, jobs.jobtype AS jobs_jobtype,
jobs.flag AS jobs_flag, jobs.lastmod AS jobs_lastmod \nFROM jobs \nWHERE
jobs.day = %(day_1)s AND jobs.pair = %(pair_1)s AND jobs.jobtype =
%(jobtype_1)s \n LIMIT %(param_1)s'] [parameters: {u'param_1': 1, u'day_1':
'2009-02-16', u'jobtype_1': 'DTT', u'pair_1': 'IG.ARIG:IG.MOIG'}]*

At the beginning everything works fine, but because it takes a long time to
make the computation (around 5 days), every time  that I come back to see
the results this happens. I am working with MSNoise 1.4 and I don't know
how to upgrade to MSNoise 1.5.

Does anyone know how to fix this?

Thanks in advance!

Oscar


More information about the MSNoise mailing list