When is colocation the right choice?
-
- Scalability beyond a core.
Cloud is all about scalability and elasticity, that's its purpose. If you have a core workload that doesn't fluctuate, even if other parts of it do, it's often better to put the stable core capacity (even if it's not stable itself, and only the capacity is a minimum) into colocation to get the performance and cost advantages; and then only use the cloud for capacity beyond that core amount. This is hybrid colo/cloud and can work very well.
-
- Stable, non-trivial workload.
This is what gets most companies. Cloud for steady workloads doesn't make sense, because you pay a premium for elasticity that you do not use. Non-trivial means large enough to justify the hardware to have a server.
If your workloads are trivial (in capacity, not that they aren't important) then cloud is best, because your scale is so small that you can't hit the minimum thresholds for colocation. But once you do, typically colocation is best.
So extremely small SMBs, or those in constant flux, tend to find cloud better. More normal sized SMBs with steady size or regular, non-sporadic growth, tend to find colocation far better.
Simple thresholds for size are based off of minimum colocation costs which are generally in the $50 - $100 / month range for a single starter server. And the cost of the server, often a couple thousand dollars, amortized over the period of use. THis might be around $2,000 for five years, or $35/mo.
This means if you have a stable bill of approximately $85/month or larger with a cloud provider, you might be at the tipping point for colocation. The larger you get, the cheaper that gets for colocation.
Once cloud monthly costs approach $200, as long as the workload is stable, the advantage to colocation becomes rapidly better. The larger the server, the denser the utilization, the better colocation performs.
-
Companies like xByte are a big deal for colocation. They reduce the cost of hardware for colocation facilities making it easier to get the hardware purchase prices below what cloud can provide.
-
Within the factors that I listed, one of the big contributors is storage. Cloud providers typically are not very flexible or scalable with storage. This varies, and is not a rule, but a trend. If your workload is not well balanced for cloud usage, especially needing a lot of storage capacity, colocation can become very advantageous extremely quickly. A workload like NextCloud can be very difficult to afford on a cloud, but trivial in colocation.
-
@scottalanmiller said in When is colocation the right choice?:
A workload like NextCloud can be very difficult to afford on a cloud, but trivial in colocation.
A Nextcloud example in production woudl be my personal system. I have nearly 1TB of data on it. I have it in a colo as a VM on a server running many other systems to. This is way cheaper for me than buying a cloud instance large enough to handle Nextcloud, and then more separate instances for the other VMs I have.
-
I would like a Colo server for personal use. VPSs don't cut it. My problem is getting ahold of hardware. The monthly cost is no issue.
-
@obsolesce said in When is colocation the right choice?:
I would like a Colo server for personal use. VPSs don't cut it. My problem is getting ahold of hardware. The monthly cost is no issue.
I did get lucky there. I won a server from XByte at the first ML meetup in NYC in 2014.
It is getting long in the tooth, but for my needs it works well. I think the Service tag marked it as made in the middle of 2012.
-
@jaredbusch said in When is colocation the right choice?:
@obsolesce said in When is colocation the right choice?:
I would like a Colo server for personal use. VPSs don't cut it. My problem is getting ahold of hardware. The monthly cost is no issue.
I did get lucky there. I won a server from XByte at the first ML meetup in NYC in 2014.
It is getting long in the tooth, but for my needs it works well. I think the Service tag marked it as made in the middle of 2012.
Still, it's better than what I have.
-
@obsolesce said in When is colocation the right choice?:
I would like a Colo server for personal use. VPSs don't cut it. My problem is getting ahold of hardware. The monthly cost is no issue.
xByte
-
@obsolesce said in When is colocation the right choice?:
@jaredbusch said in When is colocation the right choice?:
@obsolesce said in When is colocation the right choice?:
I would like a Colo server for personal use. VPSs don't cut it. My problem is getting ahold of hardware. The monthly cost is no issue.
I did get lucky there. I won a server from XByte at the first ML meetup in NYC in 2014.
It is getting long in the tooth, but for my needs it works well. I think the Service tag marked it as made in the middle of 2012.
Still, it's better than what I have.
Getting a decent Rx2x generation box can be pretty cheap. For colo lab purposes, go for a 1U to save on the monthly bills.
-
Lots of good replies in this thread. The reason I brought it up is because almost no one talks about colocation but maybe that's because of the composition of the members of the forum.
The last few posts goes in the direction I'm planning to go myself. And that is to rent 1/4 rack in a datacenter and colocate a couple of servers there. The servers I'm going to use are part refurbished, part new but still has a couple of years worth of life in them. Given the price of just CPU & memory today, refurbished is very good value for money. You could obviously get more cores and higher density with new machines but even if a few U's are wasted, the difference in money is huge.
-
@pete-s said in When is colocation the right choice?:
Lots of good replies in this thread. The reason I brought it up is because almost no one talks about colocation but maybe that's because of the composition of the members of the forum.
Likely because we've talked about it a lot before and it's well covered for a lot of the regulars. A lot of us use it, NTG does, lots of our clients do, @EddieJennings does, etc. I've had colocation continuously for decades. I'd say it is more the norm, than not.
-
@pete-s said in When is colocation the right choice?:
The last few posts goes in the direction I'm planning to go myself. And that is to rent 1/4 rack in a datacenter and colocate a couple of servers there. The servers I'm going to use are part refurbished, part new but still has a couple of years worth of life in them. Given the price of just CPU & memory today, refurbished is very good value for money. You could obviously get more cores and higher density with new machines but even if a few U's are wasted, the difference in money is huge.
In colocation, value tends to lean heavily towards investing in rack density. Virtualization drove the move to colocation heavily. You want big CPUs, and loads of RAM. If you can squeeze into 1U or maybe 2U, it's worth a bit of extra money thrown at the hardware to keep yourself from spilling over to an extra box.
Rack pricing (aka 1/4 rack, 1/3 rack, 1/2 rack, Full Rack) is typically very high compared to "Per U" pricing. You'd be amazed how much you can save.
Hit up @colocationamerica for pricing details. They have some really competitive rates.
-
@scottalanmiller said in When is colocation the right choice?:
@pete-s said in When is colocation the right choice?:
Lots of good replies in this thread. The reason I brought it up is because almost no one talks about colocation but maybe that's because of the composition of the members of the forum.
Likely because we've talked about it a lot before and it's well covered for a lot of the regulars. A lot of us use it, NTG does, lots of our clients do, @EddieJennings does, etc. I've had colocation continuously for decades. I'd say it is more the norm, than not.
Thanks, that makes sense.
-
@scottalanmiller said in When is colocation the right choice?:
Rack pricing (aka 1/4 rack, 1/3 rack, 1/2 rack, Full Rack) is typically very high compared to "Per U" pricing. You'd be amazed how much you can save.
Hit up @colocationamerica for pricing details. They have some really competitive rates.Yet, even @colocationamerica does not offer "per u" pricing in very many places. It is much more common to get fractional rack space.
-
@scottalanmiller said in When is colocation the right choice?:
@pete-s said in When is colocation the right choice?:
The last few posts goes in the direction I'm planning to go myself. And that is to rent 1/4 rack in a datacenter and colocate a couple of servers there. The servers I'm going to use are part refurbished, part new but still has a couple of years worth of life in them. Given the price of just CPU & memory today, refurbished is very good value for money. You could obviously get more cores and higher density with new machines but even if a few U's are wasted, the difference in money is huge.
In colocation, value tends to lean heavily towards investing in rack density. Virtualization drove the move to colocation heavily. You want big CPUs, and loads of RAM. If you can squeeze into 1U or maybe 2U, it's worth a bit of extra money thrown at the hardware to keep yourself from spilling over to an extra box.
Rack pricing (aka 1/4 rack, 1/3 rack, 1/2 rack, Full Rack) is typically very high compared to "Per U" pricing. You'd be amazed how much you can save.
Hit up @colocationamerica for pricing details. They have some really competitive rates.
I'm in Europe so doesn't make sense to use US datacenters. But the quotes I have puts three 1U servers at the same price as 1/4 rack.
-
@pete-s said in When is colocation the right choice?:
@scottalanmiller said in When is colocation the right choice?:
@pete-s said in When is colocation the right choice?:
The last few posts goes in the direction I'm planning to go myself. And that is to rent 1/4 rack in a datacenter and colocate a couple of servers there. The servers I'm going to use are part refurbished, part new but still has a couple of years worth of life in them. Given the price of just CPU & memory today, refurbished is very good value for money. You could obviously get more cores and higher density with new machines but even if a few U's are wasted, the difference in money is huge.
In colocation, value tends to lean heavily towards investing in rack density. Virtualization drove the move to colocation heavily. You want big CPUs, and loads of RAM. If you can squeeze into 1U or maybe 2U, it's worth a bit of extra money thrown at the hardware to keep yourself from spilling over to an extra box.
Rack pricing (aka 1/4 rack, 1/3 rack, 1/2 rack, Full Rack) is typically very high compared to "Per U" pricing. You'd be amazed how much you can save.
Hit up @colocationamerica for pricing details. They have some really competitive rates.
I'm in Europe so doesn't make sense to use US datacenters. But the quotes I have puts three 1U servers at the same price as 1/4 rack.
Sounds right to me.
-
@jaredbusch said in When is colocation the right choice?:
@scottalanmiller said in When is colocation the right choice?:
Rack pricing (aka 1/4 rack, 1/3 rack, 1/2 rack, Full Rack) is typically very high compared to "Per U" pricing. You'd be amazed how much you can save.
Hit up @colocationamerica for pricing details. They have some really competitive rates.Yet, even @colocationamerica does not offer "per u" pricing in very many places. It is much more common to get fractional rack space.
Both coasts, though. Enough places for most people.
-
@pete-s said in When is colocation the right choice?:
@scottalanmiller said in When is colocation the right choice?:
@pete-s said in When is colocation the right choice?:
The last few posts goes in the direction I'm planning to go myself. And that is to rent 1/4 rack in a datacenter and colocate a couple of servers there. The servers I'm going to use are part refurbished, part new but still has a couple of years worth of life in them. Given the price of just CPU & memory today, refurbished is very good value for money. You could obviously get more cores and higher density with new machines but even if a few U's are wasted, the difference in money is huge.
In colocation, value tends to lean heavily towards investing in rack density. Virtualization drove the move to colocation heavily. You want big CPUs, and loads of RAM. If you can squeeze into 1U or maybe 2U, it's worth a bit of extra money thrown at the hardware to keep yourself from spilling over to an extra box.
Rack pricing (aka 1/4 rack, 1/3 rack, 1/2 rack, Full Rack) is typically very high compared to "Per U" pricing. You'd be amazed how much you can save.
Hit up @colocationamerica for pricing details. They have some really competitive rates.
I'm in Europe so doesn't make sense to use US datacenters. But the quotes I have puts three 1U servers at the same price as 1/4 rack.
Wow, the difference here is usually huge. Like $50 - $100 for a 1U or 2U, and several hundred for quarter racks.
-
@scottalanmiller said in When is colocation the right choice?:
I'm in Europe so doesn't make sense to use US datacenters. But the quotes I have puts three 1U servers at the same price as 1/4 rack.
Wow, the difference here is usually huge. Like $50 - $100 for a 1U or 2U, and several hundred for quarter racks.
Yes, I guess the choice would depend a lot on the pricing.
I also have specific 2U servers in mind which would make it lower cost with a 1/4 rack already at two servers.
Each refurb server will have 128GB RAM on 20 cores, expandable to 256GB RAM on 40 cores. I haven't run benchmarks on it but looking at geekbench, machines with the same cpu have a score of around 3000 for a single core. So performance should be similar to most cloud providers that are not running latest gen servers. Hopefully the balance of physical cores and RAM will turn out fine, 6.4GB/pCPU. Of course I could allocate resources as I want and add another server if need be.
