fatum / api-extractor Goto Github PK

2012-09-06T10:30:14Z 25882 TID-t2llc Extract::GetContentWorker MSG-owks9xwkc INFO: Response failed: code=500, body=[:error, "invalid byte sequence in UTF-8"]
2012-09-06T10:30:14Z 25882 TID-t2llc Extract::GetContentWorker MSG-owks9xwkc INFO: Response failed: code=500, body=[:error, "invalid byte sequence in UTF-8"]
2012-09-06T10:30:15Z 25882 TID-t2llc Extract::GetContentWorker MSG-owks9xwkc INFO: Response failed: code=500, body=[:error, "invalid byte sequence in UTF-8"]
2012-09-06T10:30:15Z 25882 TID-t2llc Extract::GetContentWorker MSG-owks9xwkc INFO: Response failed: code=500, body=[:error, "invalid byte sequence in UTF-8"]
2012-09-06T10:30:15Z 25882 TID-t2llc Extract::GetContentWorker MSG-owks9xwkc INFO: Response failed: code=500, body=[:error, "invalid byte sequence in UTF-8"]

Передавая укороченную ссылку и пройдя по всем редиректам мы получаем расскрытую ссылку, которую и следует возвращать

Вот как здесь https://github.com/otobrglez/denginex/blob/master/denginex_api_server.rb

[:error, "(): couldn't parse YAML at line 2 column 14"]

Возникают случаи, когда один из коннектов уже вставил запись, а другой перед вставкой этого не проверил

[8087:INFO] 2012-08-07 12:38:40 :: Status: 500, Content-Length: 111, Response Time: 5531.37ms
Detect encoding from header: UTF-8
Meta charset: ["UTF-8"]
Encodings: "UTF-8"
[8087:ERROR] 2012-08-07 12:38:43 :: Mysql2::Error: Duplicate entry '040accebec73953429f535c272ffdb3f' for key 'contents_hash_url_index'
[8087:ERROR] 2012-08-07 12:38:43 :: /srv/projects/extractor/shared/bundle/ruby/1.9.1/gems/sequel-3.37.0/lib/sequel/adapters/mysql2.rb:90:in query' /srv/projects/extractor/shared/bundle/ruby/1.9.1/gems/sequel-3.37.0/lib/sequel/adapters/mysql2.rb:90:inblock in _execute'

[11847:INFO] 2012-07-31 22:33:13 :: Status: 500, Content-Length: 71, Response Time: 565.02ms
[11847:ERROR] 2012-07-31 22:33:14 :: undefined local variable or method weight' for #<Extractor::Media:0x00000003570a50> [11847:ERROR] 2012-07-31 22:33:14 :: /srv/projects/extractor/releases/20120731183059/lib/extractor/media.rb:89:increate_vimeo_embed_from'
/srv/projects/extractor/releases/20120731183059/lib/extractor/media.rb:32:in block in get_videos' /srv/projects/extractor/releases/20120731183059/lib/extractor/media.rb:31:ineach'
/srv/projects/extractor/releases/20120731183059/lib/extractor/media.rb:31:in get_videos' /srv/projects/extractor/releases/20120731183059/lib/extractor/media.rb:11:inanalyze'
/srv/projects/extractor/releases/20120731183059/lib/extract_manager.rb:33:in block in extract_data_from' /srv/projects/extractor/releases/20120731183059/lib/extract_manager.rb:32:ineach'
/srv/projects/extractor/releases/20120731183059/lib/extract_manager.rb:32:in extract_data_from' /srv/projects/extractor/releases/20120731183059/lib/extract_manager.rb:17:inperform'
extractor.rb:23:in `response'

[11847:INFO] 2012-07-31 22:34:12 :: Status: 500, Content-Length: 71, Response Time: 596.84ms
Detect encoding from header: utf-8
[11847:ERROR] 2012-07-31 22:34:12 :: invalid byte sequence in UTF-8
[11847:ERROR] 2012-07-31 22:34:12 :: /srv/projects/extractor/releases/20120731183059/lib/extractor/readability.rb:47:in scan' /srv/projects/extractor/releases/20120731183059/lib/extractor/readability.rb:47:inmeta_charset'
/srv/projects/extractor/releases/20120731183059/lib/extractor/readability.rb:21:in detect_encoding' /srv/projects/extractor/releases/20120731183059/lib/extractor/readability.rb:11:inget_content'
/srv/projects/extractor/releases/20120731183059/lib/extractor/readability.rb:5:in analyze' /srv/projects/extractor/releases/20120731183059/lib/extract_manager.rb:33:inblock in extract_data_from'
/srv/projects/extractor/releases/20120731183059/lib/extract_manager.rb:32:in each' /srv/projects/extractor/releases/20120731183059/lib/extract_manager.rb:32:inextract_data_from'
/srv/projects/extractor/releases/20120731183059/lib/extract_manager.rb:17:in perform' extractor.rb:23:inresponse'

[11847:ERROR] 2012-07-31 22:27:07 :: undefined method html_safe' for #<String:0x000000033a7778> [11847:ERROR] 2012-07-31 22:27:07 :: /srv/projects/extractor/releases/20120731183059/lib/extractor/media.rb:41:inblock in get_videos'
/srv/projects/extractor/releases/20120731183059/lib/extractor/media.rb:40:in map' /srv/projects/extractor/releases/20120731183059/lib/extractor/media.rb:40:inget_videos'
/srv/projects/extractor/releases/20120731183059/lib/extractor/media.rb:11:in analyze' /srv/projects/extractor/releases/20120731183059/lib/extract_manager.rb:33:inblock in extract_data_from'
/srv/projects/extractor/releases/20120731183059/lib/extract_manager.rb:32:in each' /srv/projects/extractor/releases/20120731183059/lib/extract_manager.rb:32:inextract_data_from'
/srv/projects/extractor/releases/20120731183059/lib/extract_manager.rb:17:in perform' extractor.rb:23:inresponse'