andrewducker: (Default)
andrewducker ([personal profile] andrewducker) wrote2011-09-02 01:14 pm

Question for the geeks in the crowd

Okay, so if I want something to scrape an RSS feed and turn it into a daily
LJ/DW post, how hard is that going to be? Anyone got something handy that
I can kick off on a daily basis?

Or a service they could recommend?
nameandnature: Giles from Buffy (Default)

[personal profile] nameandnature 2011-09-03 12:52 pm (UTC)(link)
I run it once a day from a cron job. When it runs, it gathers new items from the feed and generates HTML for them. It posts the accumulated HTML at the point where it's been a while since the last post, or when there are more than N items gathered since the last post (I've messed about with the exact figures, but the script should make it obvious what you need to tweak to adjust that).

So, when there are more than N, it posts all of them at the point where it notices, and it has a chance to notice every time it runs.

If you use it, you might want to take out the hack that means it never mentions religion in the post titles and you'll need to tell it your password a different way (mine comes from an XML file I use to configure the backup tool).