ML
    • Recent
    • Categories
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    Syncing massive amounts of changing data to BackBlaze B2 via Linux

    IT Discussion
    b2 file storage thoughtworks active backup disaster avoidance
    6
    17
    968
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • DustinB3403D
      DustinB3403 @1337
      last edited by

      @Pete-S 1Gbe symmetric 24/7

      1 1 Reply Last reply Reply Quote 0
      • 1
        1337 @DustinB3403
        last edited by

        @DustinB3403 said in Syncing massive amounts of changing data to BackBlaze B2 via Linux:

        @Pete-S 1Gbe symmetric 24/7

        So when you upload to Backblaze you get 1Gbit/s?

        DustinB3403D 1 Reply Last reply Reply Quote 0
        • DustinB3403D
          DustinB3403 @1337
          last edited by

          @Pete-S said in Syncing massive amounts of changing data to BackBlaze B2 via Linux:

          @DustinB3403 said in Syncing massive amounts of changing data to BackBlaze B2 via Linux:

          @Pete-S 1Gbe symmetric 24/7

          So when you upload to Backblaze you get 1Gbit/s?

          I haven't specifically checked, but when we get to L3 were do have 1GBe.

          1 1 Reply Last reply Reply Quote 0
          • 1
            1337 @DustinB3403
            last edited by 1337

            @DustinB3403 said in Syncing massive amounts of changing data to BackBlaze B2 via Linux:

            @Pete-S said in Syncing massive amounts of changing data to BackBlaze B2 via Linux:

            @DustinB3403 said in Syncing massive amounts of changing data to BackBlaze B2 via Linux:

            @Pete-S 1Gbe symmetric 24/7

            So when you upload to Backblaze you get 1Gbit/s?

            I haven't specifically checked, but when we get to L3 were do have 1GBe.

            You could do a simple test here:
            https://www.backblaze.com/speedtest/

            I'm not sure it will tell the complete story though. I understand that Backblaze only has one datacenter i Sacramento, California. I don't know how many hops away that is for you. Any congestion, traffic shaping etc on the way will lower your bandwidth.

            DustinB3403D 1 Reply Last reply Reply Quote 1
            • DustinB3403D
              DustinB3403 @1337
              last edited by DustinB3403

              @Pete-S At my workstation I'm getting 225Mbit/s down and 155Mbit/s up (clearly not symmetrical there. . .) but not bad either considering I have nothing special configured for my workstation.

              On a second test I noticed this A connection of 152.8 Mbps upload would backup 1,650 GB in a day

              So this very well could be feasible to do.

              DashrenderD 1 2 Replies Last reply Reply Quote 0
              • DashrenderD
                Dashrender @DustinB3403
                last edited by

                @DustinB3403 said in Syncing massive amounts of changing data to BackBlaze B2 via Linux:

                @Pete-S At my workstation I'm getting 225Mbit/s down and 155Mbit/s up (clearly not symmetrical there. . .) but not bad either considering I have nothing special configured for my workstation.

                On a second test I noticed this A connection of 152.8 Mbps upload would backup 1,650 GB in a day

                So this very well could be feasible to do.

                what you get is totally dependent upon so many factors - and you know you can't control those factors over the internet.

                DustinB3403D 1 Reply Last reply Reply Quote 0
                • DustinB3403D
                  DustinB3403 @Dashrender
                  last edited by

                  @Dashrender said in Syncing massive amounts of changing data to BackBlaze B2 via Linux:

                  @DustinB3403 said in Syncing massive amounts of changing data to BackBlaze B2 via Linux:

                  @Pete-S At my workstation I'm getting 225Mbit/s down and 155Mbit/s up (clearly not symmetrical there. . .) but not bad either considering I have nothing special configured for my workstation.

                  On a second test I noticed this A connection of 152.8 Mbps upload would backup 1,650 GB in a day

                  So this very well could be feasible to do.

                  what you get is totally dependent upon so many factors - and you know you can't control those factors over the internet.

                  I understand that, but those speeds meet/exceed what would be created within a week. Which if the backup process took 2-3 days to complete that would be fine.

                  dafyreD 1 Reply Last reply Reply Quote 0
                  • ObsolesceO
                    Obsolesce
                    last edited by

                    giphy.gif

                    1 Reply Last reply Reply Quote 0
                    • dafyreD
                      dafyre @DustinB3403
                      last edited by

                      @DustinB3403 said in Syncing massive amounts of changing data to BackBlaze B2 via Linux:

                      @Dashrender said in Syncing massive amounts of changing data to BackBlaze B2 via Linux:

                      @DustinB3403 said in Syncing massive amounts of changing data to BackBlaze B2 via Linux:

                      @Pete-S At my workstation I'm getting 225Mbit/s down and 155Mbit/s up (clearly not symmetrical there. . .) but not bad either considering I have nothing special configured for my workstation.

                      On a second test I noticed this A connection of 152.8 Mbps upload would backup 1,650 GB in a day

                      So this very well could be feasible to do.

                      what you get is totally dependent upon so many factors - and you know you can't control those factors over the internet.

                      I understand that, but those speeds meet/exceed what would be created within a week. Which if the backup process took 2-3 days to complete that would be fine.

                      If you already have B2, the best thing you could do, I think is run it for a week and see how far it makes it.

                      1 Reply Last reply Reply Quote 0
                      • 1
                        1337 @DustinB3403
                        last edited by 1337

                        @DustinB3403 said in Syncing massive amounts of changing data to BackBlaze B2 via Linux:

                        @Pete-S At my workstation I'm getting 225Mbit/s down and 155Mbit/s up (clearly not symmetrical there. . .) but not bad either considering I have nothing special configured for my workstation.

                        On a second test I noticed this A connection of 152.8 Mbps upload would backup 1,650 GB in a day

                        So this very well could be feasible to do.

                        Yes, that's not too bad. It could work. As @dafyre and other mentioned you should give it a try.
                        $.005 per GB is $5 per TB. So get an account and upload 2TB of random data to see how long it takes. Only going to cost you 10 bucks to find out.

                        1 Reply Last reply Reply Quote 0
                        • 1 / 1
                        • First post
                          Last post