Oddly, I reinstalled the host and got all the same errors on both types of uploads to the host from KMC uploading and drop folder attempts. I got frustrated and took a break. Cleared all the logs to have a fresh strart this morning and make this post with all the available information. However, now I upload via KMC directly to Kaltura and the video completely processes and becomes ready. It did return the following errors duing the conversion process before becoming ready in KMC console.
[tmp_name] => /opt/kaltura/web/tmp/phphF66lw
[error] => 0
[size] => 52885634
--
[tmp_name] => /opt/kaltura/web/tmp/phphF66lw
[error] => 0
[size] => 52885634
--
2016-03-19 09:41:07 [0.000295] [107.152.128.122] [1579117781] [717] [API] [KalturaStatement->execute] DEBUG: Sql took - 0.00019598007202148 seconds
2016-03-19 09:41:07 [0.000233] [107.152.128.122] [1579117781] [718] [API] [kBatchManager::createFlavorAsset] ERR: exception 'Exception' with message 'Flavor [7] is none-comply' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/apps/kaltura/lib/batch2/kBatchManager.php(88): KalturaLog::err('Flavor [7] is n...')Now, when I attempt to upload to the same file via drop folder the process stopped at downloading, which from the errors looked like the start of conversion. It return the following errors.
2016-03-19 09:48:56 [0.000096] [24.49.36.237] [1529757653] [56] [PS2] [kFileSyncUtils::getReadyFileSyncForKey] NOTICE: FileSync was not found
2016-03-19 09:48:56 [0.000281] [24.49.36.237] [1529757653] [57] [PS2] [kCoreException->__construct] ERR: exception 'kFileSyncException' with message 'no ready filesync on current DC' in /opt/kaltura/app/alpha/apps/kaltura/lib/myEntryUtils.class.php:783
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/entry.php(3348): myEntryUtils::resizeEntryImage(Object(entry), 0, 120, 90, 2, 'F7F7F7', NULL, 0, 0, 0, 0, 0, -1, '-1', '-1')
--
2016-03-19 09:48:56 [0.000087] [24.49.36.237] [1529757653] [65] [PS2] [kFileSyncUtils::getReadyFileSyncForKey] NOTICE: FileSync was not found
2016-03-19 09:48:56 [0.000114] [24.49.36.237] [1529757653] [66] [PS2] [entry->getLocalThumbFilePath] ERR: exception 'Exception' with message 'No ready fileSync found on any DC.' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/entry.php(3365): KalturaLog::err('No ready fileSy...')
--
#16 {main}
2016-03-19 09:48:56 [0.000119] [24.49.36.237] [1529757653] [67] [PS2] [KExternalErrors::dieError] ERR: exception 'Exception' with message 'exiting on error 10 - missing thumbnail fileSync for entry' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/apps/kaltura/lib/KExternalErrors.class.php(128): KalturaLog::err('exiting on erro...')
--
2016-03-19 09:50:21 [0.000091] [24.49.36.237] [1369558539] [56] [PS2] [kFileSyncUtils::getReadyFileSyncForKey] NOTICE: FileSync was not found
2016-03-19 09:50:21 [0.000232] [24.49.36.237] [1369558539] [57] [PS2] [kCoreException->__construct] ERR: exception 'kFileSyncException' with message 'no ready filesync on current DC' in /opt/kaltura/app/alpha/apps/kaltura/lib/myEntryUtils.class.php:783
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/entry.php(3348): myEntryUtils::resizeEntryImage(Object(entry), 0, 120, 90, 2, 'F7F7F7', NULL, 0, 0, 0, 0, 0, -1, '-1', '-1')
--
2016-03-19 09:50:21 [0.000090] [24.49.36.237] [1369558539] [65] [PS2] [kFileSyncUtils::getReadyFileSyncForKey] NOTICE: FileSync was not found
2016-03-19 09:50:21 [0.000109] [24.49.36.237] [1369558539] [66] [PS2] [entry->getLocalThumbFilePath] ERR: exception 'Exception' with message 'No ready fileSync found on any DC.' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/entry.php(3365): KalturaLog::err('No ready fileSy...')
--
#16 {main}
2016-03-19 09:50:21 [0.000127] [24.49.36.237] [1369558539] [67] [PS2] [KExternalErrors::dieError] ERR: exception 'Exception' with message 'exiting on error 10 - missing thumbnail fileSync for entry' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/apps/kaltura/lib/KExternalErrors.class.php(128): KalturaLog::err('exiting on erro...')
2016-03-19 09:48:56 [0.000096] [24.49.36.237] [1529757653] [56] [PS2] [kFileSyncUtils::getReadyFileSyncForKey] NOTICE: FileSync was not found
2016-03-19 09:48:56 [0.000281] [24.49.36.237] [1529757653] [57] [PS2] [kCoreException->__construct] ERR: exception 'kFileSyncException' with message 'no ready filesync on current DC' in /opt/kaltura/app/alpha/apps/kaltura/lib/myEntryUtils.class.php:783
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/entry.php(3348): myEntryUtils::resizeEntryImage(Object(entry), 0, 120, 90, 2, 'F7F7F7', NULL, 0, 0, 0, 0, 0, -1, '-1', '-1')
--
2016-03-19 09:48:56 [0.000087] [24.49.36.237] [1529757653] [65] [PS2] [kFileSyncUtils::getReadyFileSyncForKey] NOTICE: FileSync was not found
2016-03-19 09:48:56 [0.000114] [24.49.36.237] [1529757653] [66] [PS2] [entry->getLocalThumbFilePath] ERR: exception 'Exception' with message 'No ready fileSync found on any DC.' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/entry.php(3365): KalturaLog::err('No ready fileSy...')
--
#16 {main}
2016-03-19 09:48:56 [0.000119] [24.49.36.237] [1529757653] [67] [PS2] [KExternalErrors::dieError] ERR: exception 'Exception' with message 'exiting on error 10 - missing thumbnail fileSync for entry' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/apps/kaltura/lib/KExternalErrors.class.php(128): KalturaLog::err('exiting on erro...')
--
2016-03-19 09:50:21 [0.000091] [24.49.36.237] [1369558539] [56] [PS2] [kFileSyncUtils::getReadyFileSyncForKey] NOTICE: FileSync was not found
2016-03-19 09:50:21 [0.000232] [24.49.36.237] [1369558539] [57] [PS2] [kCoreException->__construct] ERR: exception 'kFileSyncException' with message 'no ready filesync on current DC' in /opt/kaltura/app/alpha/apps/kaltura/lib/myEntryUtils.class.php:783
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/entry.php(3348): myEntryUtils::resizeEntryImage(Object(entry), 0, 120, 90, 2, 'F7F7F7', NULL, 0, 0, 0, 0, 0, -1, '-1', '-1')
--
2016-03-19 09:50:21 [0.000090] [24.49.36.237] [1369558539] [65] [PS2] [kFileSyncUtils::getReadyFileSyncForKey] NOTICE: FileSync was not found
2016-03-19 09:50:21 [0.000109] [24.49.36.237] [1369558539] [66] [PS2] [entry->getLocalThumbFilePath] ERR: exception 'Exception' with message 'No ready fileSync found on any DC.' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/entry.php(3365): KalturaLog::err('No ready fileSy...')
--
#16 {main}
2016-03-19 09:50:21 [0.000127] [24.49.36.237] [1369558539] [67] [PS2] [KExternalErrors::dieError] ERR: exception 'Exception' with message 'exiting on error 10 - missing thumbnail fileSync for entry' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/apps/kaltura/lib/KExternalErrors.class.php(128): KalturaLog::err('exiting on erro...')
#0 /opt/kaltura/app/alpha/apps/kaltura/lib/KExternalErrors.class.php(128): KalturaLog::err('exiting on erro...')
--
2016-03-19 09:53:54 [0.000223] [107.152.128.122] [1981576908] [30] [API] [KalturaStatement->execute] DEBUG: Sql took - 0.00013184547424316 seconds
2016-03-19 09:53:54 [0.005828] [107.152.128.122] [1981576908] [31] [API] [kDropFolderEventsConsumer->setFileError] ERR: exception 'Exception' with message 'Error with file [2] -Failed in file transferring from the drop folder to Kaltura' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/plugins/drop_folder/lib/kDropFolderEventsConsumer.php(439): KalturaLog::err('Error with file...')The first question is do I have drop folder's conversion profile setup properly. I selected the defautl one but there is a passthrough option but last time I tried that it didn't work So with that said 'Desktop' uploading works with minimal errors but drop folder is still not working.
Here are the results of the SQL query you asked for as well.
mysql> select id,name,status from entry where id='0_js3qfo2i';
+------------+------+--------+
| id | name | status |
+------------+------+--------+
| 0_js3qfo2i | 1057 | -2 |
+------------+------+--------+
1 row in set (0.00 sec)This is the SQL results for the media uploaded via deskop.
mysql> select id,name,status from entry where id='0_mxryf83v';
+------------+------+--------+
| id | name | status |
+------------+------+--------+
| 0_mxryf83v | 1057 | 2 |
+------------+------+--------+
1 row in set (0.00 sec)I did try a second time and created a new transcoding profile with only source slected and I got similar results.
--
2016-03-19 10:21:38 [0.133537] [337943751] [33] [BATCH] [KAsyncImport->fetchFile] DEBUG: Curl results:
2016-03-19 10:21:38 [0.000455] [337943751] [34] [BATCH] [KJobHandlerWorker->closeJob] ERR: exception 'Exception' with message 'Error: Couldn't resolve host 'my-domain.com:ftp-passwd@my-domain.com'' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/batch/batches/KJobHandlerWorker.class.php(372): KalturaLog::err('Error: Couldn't...')
--
2016-03-19 10:22:01 [0.000092] [24.49.36.237] [682046333] [56] [PS2] [kFileSyncUtils::getReadyFileSyncForKey] NOTICE: FileSync was not found
2016-03-19 10:22:01 [0.000238] [24.49.36.237] [682046333] [57] [PS2] [kCoreException->__construct] ERR: exception 'kFileSyncException' with message 'no ready filesync on current DC' in /opt/kaltura/app/alpha/apps/kaltura/lib/myEntryUtils.class.php:783
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/entry.php(3348): myEntryUtils::resizeEntryImage(Object(entry), 0, 120, 90, 2, 'F7F7F7', NULL, 0, 0, 0, 0, 0, -1, '-1', '-1')
--
2016-03-19 10:22:01 [0.000087] [24.49.36.237] [682046333] [65] [PS2] [kFileSyncUtils::getReadyFileSyncForKey] NOTICE: FileSync was not found
2016-03-19 10:22:01 [0.000109] [24.49.36.237] [682046333] [66] [PS2] [entry->getLocalThumbFilePath] ERR: exception 'Exception' with message 'No ready fileSync found on any DC.' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/entry.php(3365): KalturaLog::err('No ready fileSy...')
--
#16 {main}
2016-03-19 10:22:01 [0.000117] [24.49.36.237] [682046333] [67] [PS2] [KExternalErrors::dieError] ERR: exception 'Exception' with message 'exiting on error 10 - missing thumbnail fileSync for entry' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/apps/kaltura/lib/KExternalErrors.class.php(128): KalturaLog::err('exiting on erro...')
--
2016-03-19 10:22:52 [0.000091] [24.49.36.237] [1028756867] [56] [PS2] [kFileSyncUtils::getReadyFileSyncForKey] NOTICE: FileSync was not found
2016-03-19 10:22:52 [0.000361] [24.49.36.237] [1028756867] [57] [PS2] [kCoreException->__construct] ERR: exception 'kFileSyncException' with message 'no ready filesync on current DC' in /opt/kaltura/app/alpha/apps/kaltura/lib/myEntryUtils.class.php:783
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/entry.php(3348): myEntryUtils::resizeEntryImage(Object(entry), 0, 340, 194, 1, 'ffffff', NULL, 0, 0, 0, 0, 0, -1, '-1', '-1')
--
2016-03-19 10:22:52 [0.000089] [24.49.36.237] [1028756867] [65] [PS2] [kFileSyncUtils::getReadyFileSyncForKey] NOTICE: FileSync was not found
2016-03-19 10:22:52 [0.000112] [24.49.36.237] [1028756867] [66] [PS2] [entry->getLocalThumbFilePath] ERR: exception 'Exception' with message 'No ready fileSync found on any DC.' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/entry.php(3365): KalturaLog::err('No ready fileSy...')
--
#16 {main}
2016-03-19 10:22:52 [0.000132] [24.49.36.237] [1028756867] [67] [PS2] [KExternalErrors::dieError] ERR: exception 'Exception' with message 'exiting on error 10 - missing thumbnail fileSync for entry' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/alpha/apps/kaltura/lib/KExternalErrors.class.php(128): KalturaLog::err('exiting on erro...')
--
2016-03-19 10:26:41 [0.000650] [1911012826] [22] [BATCH] [KCurlWrapper->setSourceUrlAndprotocol] INFO: Setting source URL to [ftp://ftp-user@my-domain.com:ftp-passwd@mydomain.com/vod_import/1057.mp4]
2016-03-19 10:26:41 [0.080334] [1911012826] [23] [BATCH] [KJobHandlerWorker->closeJob] ERR: exception 'Exception' with message 'Couldn't read file. Error: Couldn't resolve host 'my-domain.com:ftp-passwd@my-domain.com'' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/batch/batches/KJobHandlerWorker.class.php(372): KalturaLog::err('Couldn't read f...')
--
2016-03-19 10:26:41 [0.000211] [107.152.128.122] [1689877907] [30] [API] [KalturaStatement->execute] DEBUG: Sql took - 0.00012493133544922 seconds
2016-03-19 10:26:41 [0.000361] [107.152.128.122] [1689877907] [31] [API] [kDropFolderEventsConsumer->setFileError] ERR: exception 'Exception' with message 'Error with file [5] -Failed in file transferring from the drop folder to Kaltura' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/plugins/drop_folder/lib/kDropFolderEventsConsumer.php(439): KalturaLog::err('Error with file...')So this scenario look like it had issue with making thumbnail again and then was ready to publish but could not connect to FTP a second time to move the source file. Guess I will remove source file from all transcoding profiles til that is fixed.
Specifically, this needs to be fixed in the actual source code to pass the connect information in full like the first pass.
DEBUG: Curl results:
2016-03-19 10:21:38 [0.000455] [337943751] [34] [BATCH] [KJobHandlerWorker->closeJob] ERR: exception 'Exception' with message 'Error: Couldn't resolve host 'my-domain.com:ftp-passwd@my-domain.com'' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:Here the source URL is set but the full variable is not used to connect.
2016-03-19 10:26:41 [0.000650] [1911012826] [22] [BATCH] [KCurlWrapper->setSourceUrlAndprotocol] INFO: Setting source URL to [ftp://ftp-user@my-domain.com:ftp-passwd@mydomain.com/vod_import/1057.mp4]
2016-03-19 10:26:41 [0.080334] [1911012826] [23] [BATCH] [KJobHandlerWorker->closeJob] ERR: exception 'Exception' with message 'Couldn't read file. Error: Couldn't resolve host 'my-domain.com:ftp-passwd@my-domain.com'' in /opt/kaltura/app/infra/log/KalturaLog.php:83
Stack trace:
#0 /opt/kaltura/app/batch/batches/KJobHandlerWorker.class.php(372): KalturaLog::err('Couldn't read f...')