[Nix-dev] Need any mirror in Asia?

[zimbatm]

How I see the setup, it would be a HTTP reverse proxy with caching enabled.
That way only the accessed files are transferred over, avoiding unnecessary
traffic. One downside is that it requires a bit of tuning and monitoring to
make sure it's running efficiently. First accesses to files are also doing
the full round trip.

https://www.nginx.com/blog/nginx-caching-guide/ is a pretty good example
setup for nging, where upstream would be cache.nixos.org . A few things
need to be turned, for example the cache TTL should be much bigger than the
10min that they set. Ideally all content-addressable files would never
invalidate unless the disk is full, in that case they should LRU.

Let me know if you need more details or if this enough to get going.

On Mon, 8 May 2017, 16:53 Karibu, <karibu at freedif.org> wrote:

> Thanks for sharing Daniel, I see another thread around my same topic
> ("still waiting for https://cache.nixos.org after 5 seconds..."). So
> I'm happy to see such open discussion.
>
> It seems they have some projects in the pipe to improve the delivery.
> But I will be happy to support in a short or long term (secondary cache
> layer,...)
>
> I'm currently having a 100M, but I'm thinking of upgrading to 1G. (Just
> a new offer, more expansive of course but for a reasonable price still.
> IMO)
>
> Kari
>
> On Mon, 2017-05-08 at 08:15 -0400, Daniel Peebles wrote:
> > Copying this from another related thread: https://mailman.science.uu.
> > nl/pipermail/nix-dev/2016-October/022029.html
> >
> >
> > On Sun, May 7, 2017 at 9:33 PM, Karibu <karibu at freedif.org> wrote:
> > > Hi Zimbatm,
> > >
> > > This would be the first time for me.
> > >
> > > Can yoy brief me on the details and tools needed?
> > >
> > > Thanks
> > >
> > > On May 7, 2017 22:48, zimbatm <zimbatm at zimbatm.com> wrote:
> > > @Karibu: is it possible to setup the mirror as a secondary layer
> > > cache instead?
> > >
> > > On Thu, 4 May 2017 at 14:18 Volth <volth at volth.com> wrote:
> > > Actually, there are regions with bad connectity to Amazon's
> > > Cloudfront.
> > > For example Russia, and, yes, Vietnam.
> > >
> > > There are few obstacles:
> > > 1. the distribution model is not rsync-friendly and not well suited
> > > for 3rd-party mirrors.
> > > 2. there is a  team promising to solve the geo-distribution issue
> > > using IPFS. There is no results yet but the expectation from their
> > > works lower priority of alternative solutions.
> > > 3. the majority of developers (and users?) are located in Cenral
> > > Europe (NL,DE,CZ,SI,...) so the geodistrubution issue get very
> > > little
> > > traction.
> > >
> > > On 5/4/17, Karibu <karibu at freedif.org> wrote:
> > > > Thanks for the prompt reply.
> > > > So you don't need any mirror in Asia and no issue from the speed
> > > there
> > > > I suppose.
> > > >
> > > > If one day, you will need one, you can count on me.
> > > >
> > > > Thanks
> > > >
> > > > Kari
> > > >
> > > > On Thu, 2017-05-04 at 14:43 +0200, Domen Kožar wrote:
> > > >> This is not Gentoo. Our infrastructure is hosted by Amazon S3
> > > and
> > > >> globally distributed over cloudflare CDN.
> > > >>
> > > >> On Thu, May 4, 2017 at 2:41 PM, Karibu <karibu at freedif.org>
> > > wrote:
> > > >> > Hi guys,
> > > >> >
> > > >> > Any idea about the RSYNC url I should use to do a mirror?
> > > >> >
> > > >> > Thanks
> > > >> >
> > > >> > On Tue, 2017-05-02 at 21:09 +0700, Karibu wrote:
> > > >> > > Hehe no problem.
> > > >> > >
> > > >> > > Any mirror admin or dev to let me know the RSYNC url.
> > > >> > > Thanks
> > > >> > >
> > > >> > > Kari
> > > >> > >
> > > >> > > On Tue, 2017-05-02 at 00:47 +0800, Wei Tang wrote:
> > > >> > > >
> > > >> > > > Hi Karibu,
> > > >> > > >
> > > >> > > > I live in Hong Kong, and I would definitely appreciate a
> > > mirror
> > > >> > in
> > > >> > > > Asia.
> > > >> > > >
> > > >> > > > -- Wei
> > > >> > > >
> > > >> > > > Karibu writes:
> > > >> > > >
> > > >> > > > >
> > > >> > > > >
> > > >> > > > > Hi guys,
> > > >> > > > > I am the admin of the Vietnamese mirror (and blog)
> > > >> > freedif.org
> > > >> > > > > (mirror.freedif.org)
> > > >> > > > >
> > > >> > > > > I have some spare bandwidth and space and would like to
> > > >> > support
> > > >> > > > > your
> > > >> > > > > project.
> > > >> > > > >
> > > >> > > > > Do you need a mirror in Vietnam (no problem to support
> > > >> > > > > neighbourhood
> > > >> > > > > countries)
> > > >> > > > >
> > > >> > > > > Thanks
> > > >> > > > >
> > > >> > > > > Kari
> > > >> > > > > _______________________________________________
> > > >> > > > > nix-dev mailing list
> > > >> > > > > nix-dev at lists.science.uu.nl
> > > >> > > > > https://mailman.science.uu.nl/mailman/listinfo/nix-dev
> > > >> > > _______________________________________________
> > > >> > > nix-dev mailing list
> > > >> > > nix-dev at lists.science.uu.nl
> > > >> > > https://mailman.science.uu.nl/mailman/listinfo/nix-dev
> > > >> > _______________________________________________
> > > >> > nix-dev mailing list
> > > >> > nix-dev at lists.science.uu.nl
> > > >> > https://mailman.science.uu.nl/mailman/listinfo/nix-dev
> > > >> >
> > > >>
> > > > _______________________________________________
> > > > nix-dev mailing list
> > > > nix-dev at lists.science.uu.nl
> > > > https://mailman.science.uu.nl/mailman/listinfo/nix-dev
> > > >
> > > _______________________________________________
> > > nix-dev mailing list
> > > nix-dev at lists.science.uu.nl
> > > https://mailman.science.uu.nl/mailman/listinfo/nix-dev
> > >
> > >
> > > _______________________________________________
> > > nix-dev mailing list
> > > nix-dev at lists.science.uu.nl
> > > https://mailman.science.uu.nl/mailman/listinfo/nix-dev
> > >
> >
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.science.uu.nl/pipermail/nix-dev/attachments/20170508/b28bffa2/attachment-0001.html>