Log in

Request #1401670

From: pne pne Philip Newton
: Permanent Account
LiveJournal: username: pne
style: (S1) lastn: 1 friends: 211202 calendar: 18546 day: 5
overrides: view 
userpics: base + loyalty = userpics
sup enabled:
email validated? yes
cluster: Shishkabob (#8); data version : 8
design: old  scheme: horizon    friends page: friends
language: en_LJ
underage no;
Is JavaScript enabled: (unknown)
Request sent from Beta:
Photo hosting migration: done
Support category: Issue Investigation  [previous | next]
Time posted: Wed, 26 Oct 2011 05:10:09 GMT (4 years ago)
Status: closed (10 points to markf)
Summary: Comment export no longer working
Original Request:
Hi there,

I occasionally back up my journal with ljArchive and ljdump.

ljArchive stopped working a while ago; apparently, it would get a problem when trying to retrieve the comments, where it would get fed an HTML page instead of the comment data.

ljdump used to work, for retrieving both posts and comments.

However, when I tried it this morning, I got a Varnish error (405 Method Not Allowed); see http://www.livejournal.com/support/see_request.bml?id=1401664.

This was apparently due to POSTing to livejournal.com instead of to www.livejournal.com; changing the host allowed me to get past the challenge and even to sync journal entries.

However, I now seem to be running into the same problem with ljdump as I did with ljArchive: the request to retrieve comments redirects me to the site's main page, which is not valid XML, so the XML parser errors out. (And even if it didn't... the HTML source of the main page is not comment export XML!)

What happens is that ljdump sends a GET request for the URL:


and gets the response:

HTTP/1.1 302 Found
Server: GoatProxy 1.0
Date: Wed, 26 Oct 2011 04:59:11 GMT
Content-Type: text/html; charset=utf-8
Connection: close
X-AWS-Id: ws27
Location: http://www.livejournal.com/?returnto=%2Fexport_comments.bml%3Fget%3Dcomment_meta%26startid%3D14251
Cache-Control: private, proxy-revalidate
ETag: "06b904260b0d751caf0034cfe86504fc"
X-end: end: www.livejournal.com/export_comments.bml?get=comment_meta&startid=14251<_c-><_cs->
Content-Length: 4
Accept-Ranges: bytes
X-Varnish: 2001582467 2001568512
Age: 182
X-VWS-Id: bil1-varn22
X-Gateway: bil1-swlb04


So it follows the 302 redirect and requests http://www.livejournal.com/?returnto=%2Fexport_comments.bml%3Fget%3Dcomment_meta%26startid%3D14251 .

This results in:

HTTP/1.1 200 OK
Server: GoatProxy 1.0
Date: Wed, 26 Oct 2011 04:59:11 GMT
Content-Type: text/html; charset=utf-8
Transfer-Encoding: chunked
Connection: close
X-AWS-Id: ws42
Cache-Control: private, proxy-revalidate
Vary: Accept-Encoding
X-end: end: www.livejournal.com/?returnto=%2Fexport_comments.bml%3Fget%3Dcomment_meta%26startid%3D14251<_c-><_cs->
X-Varnish: 1722182700 1722165170
Age: 182
X-VWS-Id: bil1-varn13
ETag: GgZz"b4da60dc8c6742a0b8c9b24048c8a356"
X-Gateway: bil1-swlb04

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
<html xmlns="http://www.w3.org/1999/xhtml" lang="en" xml:lang="en">
<meta http-equiv="X-UA-Compatible" content="IE=EmulateIE7; IE=EmulateIE9" />
        <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
        <title>LiveJournal: Discover global communities of friends who share your unique passions and interests.</title>
        <link rel="home" title="Home" href="http://www.livejournal.com/" />
        <link rel="contents" title="Site Map" href="http://www.livejournal.com/site/" />
        <link rel="help" title="Technical Support" href="http://www.livejournal.com/support/" />
        <link rel="apple-touch-icon" href="http://l-stat.livejournal.com/img/apple-touch-icon.png?v=6037" />


                <meta name="description" content="LiveJournal is a vibrant global social media platform where users share common passions and interests. With hundreds of communities built around popular interests, like entertainment, celebrity gossip, music, food, travel, fashion, parenting, pets, and more, LiveJournal users express themselves through creative journaling and lively commentary." />
                <meta name="keywords" content="communities, journaling, celebrity gossip, ONTD, entertainment, music, creative expression, photography, writing, cooking" />

[lots and lots of lines snipped]

Has the URL for comment exporting changed? Or is it no longer supported?

Or is this simply a bug?

I'd appreciate it if you'd let me sync my comments again!


Philip (pne)
Diagnostics: Opera/9.80 (Windows NT 6.1; U; en) Presto/2.9.168 Version/11.51
pne pne  - Philip Newton
Comment (#5352616)
Posted Wed, 26 Oct 2011 05:14:40 GMT (4 years ago)
Oddly enough(?), when I go to http://www.livejournal.com/export_comments.bml?get=comment_meta&startid=14251 in my browser, I get told:


We're sorry, but there was an error in the information you submitted. Please go back and try again.
This page can't be viewed except via POST.

Is that the problem? Do you need a POST even for get=comment_meta?
pne pne  - Philip Newton
Comment (#5352688)
Posted Wed, 26 Oct 2011 06:41:48 GMT (4 years ago)
And going to http://livejournal.com/export_comments.bml?get=comment_meta&startid=14251 (without "www.") in a browser works - I get redirected to http://www.livejournal.com/export_comments.bml?get=comment_meta&startid=14251 but the output is LiveJournal comment output XML.

Which would explain why ljdump used to work even after ljArchive stopped working, since I had ljdump configured to use livejournal.com but ljArchive used www.livejournal.com

So it seems that livejournal.com and www.livejournal.com behave differently, at least as regards /interface/flat and /export_comments.bml.

Please fix this! So that I can log in using either site, and export comments using either site, again.

Philip (pne)
markf  - Mark
Answer (#5637881)
Posted Wed, 14 Mar 2012 22:35:35 GMT (3 years ago)
I'm responding to this belatedly to say we think this is fixed now, and that comment exporting is working. If you're aware of something still wonky here, let me know so I can bug people ;)