How often does ohloh update a repository?

Avatar

AFrisby

about 1 year ago

Just a side question - how often does ohloh attempt to resync?


Avatar

Robin Luckey

about 1 year ago

Generally, we update every project about once a week. If it's been much longer than that for a project you are interested in, let us know and we'll investigate.

It's technically possible for us to update every project every day, and we've maintained that pace occasionally, but typically we have maintenance or big work items that can slow us down.

As we continue to scale out our server farm and we improve our architecture, we do plan to keep speeding up the updates.


Avatar

dartar

about 1 year ago

Could at least the project news be updated more frequently? It looks as if ohloh currently updates RSS feeds and code statistics with the same frequency, with the result that some news may be one week old. A request to a feed should not be very heavy in term of server workload and I wonder if you could run this separately from the main update routine.


Avatar

AFrisby

about 1 year ago

Hrrm, been 11 days since the openmetaverse projects have updated - anything we need to fix?


Avatar

Jason Allen

about 1 year ago

hi Afrisby,

Since we launched the new features 3 weeks ago we've had a spike in traffic. This resulted in a double-whammy for us. People are entering a lot more projects into the system AND we have started running into bandwith issues with our hosting company. We hope to have this resolved next week. Sorry for the delay.


Avatar

AFrisby

about 1 year ago

heh no problems.


Avatar

Lars Wesselius

about 1 year ago

Good news never comes alone.


Avatar

AFrisby

about 1 year ago

Thought I'd give it another prod since it's been 17 days since the last updates (just want to make sure there's nothing busted on our end) - is the timer just running 'whenever' in a complete loop?


Avatar

dartar

about 1 year ago

AFrisby 17 days since the last update for WikkaWiki as well.


Avatar

Robin Luckey

about 1 year ago

Yes, project updates pretty much run 'whenever' in a loop that we keep moving as fast as we can. The loop can take anywhere from 8 hours to several days to complete, depending on the number of large new projects coming in to the system.

The last couple of weeks have been remarkably busy for us, with a long queue of new projects coming in to the system, preventing us from running any updates at all. We have some big new servers ready to install in the next week or two (it seems like we're always saying this!) which should help us keep up with the increased traffic.

Today it looks like we've finally caught up with the new project queue, so I've restarted the update loop. If things stay relatively quiet, we should update every project this weekend.


Avatar

AFrisby

about 1 year ago

Woot! You guys are awesome.


Avatar

Rytis Slatkevičius

about 1 year ago

Well, the weekend is over :)

Since something apparently came up and you could not update all projects, could you at least push BOINC (id 3215) somewhere closer to the queue top? Thanks.


Avatar

Andy Verprauskus

about 1 year ago

Hi Rytis.

You're right that we did run into some problems this weekend. In response to that, I manually queued

  • WikkaWiki for Dario
  • 3 openmetaverse projects for AFrisby and just queued
  • BOINC for you

Thanks!


Avatar

Jure Repinc

about 1 year ago

Hi,

Repositories for Thousand Parsec have not been updated for 20 days now. Would it be possible if someone could check out if there is a problem somewhere?

Thanks in advance.


Avatar

Robin Luckey

about 1 year ago

Hi Jure,

I'm not sure what is going on with this project. One of the repositories was updated just 5 days ago, and we show a commit from June 7.

In any case, I've scheduled a full update of all the repositories, which should finish today. I'll keep an eye on it. Thanks!


Avatar

Artur Hefczyc

about 1 year ago

Tigase server project source code has been updated 29 days ago: http://www.ohloh.net/projects/4171/enlistments Did it miss the queue somehow? Nothing urgent but I just wonder if there is something I can do to improve it....


Avatar

Andy Verprauskus

about 1 year ago

Hi Artur,

Tigase just finished updating. You don't need to do anything to improve it, we were just behind. Our new hardware should help us stay more up-to-date with most projects.


Avatar

Artur Hefczyc

about 1 year ago

Thank you for response.

As an open source developer I know how things are looking from the other side and I know that sometimes simple report about some problem may help. So I wasn't intending to push you just reported problem;-)

Good work, thanks a lot...


Avatar

ipv6guru

about 1 year ago

Keeping this thread alive rather than a new one, it seems to be about a month now since the Apache Forrest project was updated - my commits and others for August don't seem to be showing up.

Just a heads-up, no complaints here, great work guys.

(If you need any help with anything give us a yell)

Gav...


Avatar

Robin Luckey

about 1 year ago

Hi ipv6guru,

Yes, sorry, we are a bit behind on updates at the moment.

We last updated Forrest 9 days ago. I'll go ahead and schedule a new update for this project, but the queue is pretty long at this point, so it might be a few more days.


Avatar

Daniel / Nazca

about 1 year ago

Just to shove it in this thread rather than another ... I'm assuming the long queue is why http://www.ohloh.net/projects/7719/enlistments has been waiting for 30 hours for it's initial download? It's just sat in queue ... it's not paticularly big either, 1778 lines in head :/


Avatar

Samuel Bronson

about 1 year ago

Maybe you should put newly-enlisted repositories in a seperate queue or something?


Avatar

Daniel / Nazca

about 1 year ago

yah, they're normally shoved to the front iirc, but I'm guessing it's either borked or just very backlogged


Avatar

Daniel / Nazca

about 1 year ago

Robin? Jason? Andy? Anyone?


Avatar

Jason Allen

about 1 year ago

Robin made a really insightful posts on project update timing here. Meanwhile, I've pushed the priority up for LivePage. Cheers!