ML
    • Recent
    • Categories
    • Tags
    • Popular
    • Users
    • Groups
    • Register
    • Login

    XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!

    IT Discussion
    xenserver xenserver 6.2 iscsi san
    10
    243
    44.1k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • C
      CitrixNewbJD @scottalanmiller
      last edited by

      @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

      @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

      @CitrixNewbJD

      Sorry, ate my text again. Unless I should be looking somewhere else...

      Get us the SMlog tail...

      tail -n 100 SMlog
      
      Dec 27 13:24:41 xen2 SM: [6456]   |- 5:0:0:1 sdf 8:80  failed faulty running
      Dec 27 13:24:41 xen2 SM: [6456]   `- 7:0:0:1 sdl 8:176 active ready  running
      Dec 27 13:24:41 xen2 SM: [6456] multipathd>
      Dec 27 13:24:41 xen2 SM: [6456] MPATH:  Set val: [1, 4]
      Dec 27 13:24:41 xen2 SM: [6456] Matched SCSIid, updating 360024e800070ed06000007f54dba7bfb
      Dec 27 13:24:41 xen2 SM: [6456] MPATH: Updating entry for [360024e800070ed06000007f54dba7bfb], current: [0, 4]
      Dec 27 13:24:41 xen2 SM: [6456] MPATH: Update done
      Dec 27 13:24:41 xen2 SM: [6456] lock: closed /var/lock/sm/mpathcount2/host
      Dec 27 13:24:41 xen2 SM: [6456] lock: released /var/lock/sm/mpathcount1/host
      Dec 27 13:24:41 xen2 SM: [6456] lock: closed /var/lock/sm/mpathcount1/host
      Dec 27 13:24:41 xen2 SM: [6579] lock: acquired /var/lock/sm/mpathcount1/host
      Dec 27 13:24:41 xen2 SM: [6579] lock: released /var/lock/sm/mpathcount2/host
      Dec 27 13:24:41 xen2 SM: [6579] MPATH: I get the lock
      Dec 27 13:24:41 xen2 SM: [6579] Matched SCSIid, updating 360024e80007b786a000004134a9670f3
      Dec 27 13:24:41 xen2 SM: [6579] MPATH: Updating entry for [360024e80007b786a000004134a9670f3], current: [2, 4]
      Dec 27 13:24:41 xen2 SM: [6579] Matched SCSIid, updating 360024e800054baef0000ddd550c85082
      Dec 27 13:24:41 xen2 SM: [6579] MPATH: Updating entry for [360024e800054baef0000ddd550c85082], current: [4, 4]
      Dec 27 13:24:41 xen2 SM: [6579] Matched SCSIid, updating 360024e800070ed06000004314a967309
      Dec 27 13:24:41 xen2 SM: [6579] MPATH: Updating entry for [360024e800070ed06000004314a967309], current: [1, 4]
      Dec 27 13:24:41 xen2 SM: [6579] mpath cmd: show map 360024e800070ed06000004314a967309 topology
      Dec 27 13:24:41 xen2 SM: [6663] MPATH: Trying to acquire the lock
      Dec 27 13:24:41 xen2 SM: [6663] lock: tried lock /var/lock/sm/mpathcount1/host, acquired: False (exists: True)
      Dec 27 13:24:41 xen2 SM: [6663] lock: tried lock /var/lock/sm/mpathcount2/host, acquired: True (exists: True)
      Dec 27 13:24:41 xen2 SM: [6663] Failed to lock /var/lock/sm/mpathcount1/host on first attempt, blocked by PID 6579
      Dec 27 13:24:41 xen2 SM: [6666] MPATH: Trying to acquire the lock
      Dec 27 13:24:41 xen2 SM: [6666] lock: tried lock /var/lock/sm/mpathcount1/host, acquired: False (exists: True)
      Dec 27 13:24:41 xen2 SM: [6666] lock: tried lock /var/lock/sm/mpathcount2/host, acquired: False (exists: True)
      Dec 27 13:24:41 xen2 SM: [6666] lock: closed /var/lock/sm/mpathcount2/host
      Dec 27 13:24:41 xen2 SM: [6666] lock: closed /var/lock/sm/mpathcount1/host
      Dec 27 13:24:41 xen2 SM: [6579] mpath output: multipathd> 360024e800070ed06000004314a967309 dm-0 DELL,MD3000i
      Dec 27 13:24:41 xen2 SM: [6579] size=1.4T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
      Dec 27 13:24:41 xen2 SM: [6579] |-+- policy='round-robin 0' prio=4 status=active
      Dec 27 13:24:41 xen2 SM: [6579] | |- 6:0:0:1 sdi 8:128 active ghost  running
      Dec 27 13:24:41 xen2 SM: [6579] | `- 4:0:0:1 sdc 8:32  failed faulty running
      Dec 27 13:24:41 xen2 SM: [6579] `-+- policy='round-robin 0' prio=3 status=enabled
      Dec 27 13:24:41 xen2 SM: [6579]   |- 5:0:0:1 sdf 8:80  failed faulty running
      Dec 27 13:24:41 xen2 SM: [6579]   `- 7:0:0:1 sdl 8:176 active ready  running
      Dec 27 13:24:41 xen2 SM: [6579] multipathd>
      Dec 27 13:24:41 xen2 SM: [6579] mpath cmd: show map 360024e800070ed06000004314a967309 topology
      Dec 27 13:24:41 xen2 SM: [6579] mpath output: multipathd> 360024e800070ed06000004314a967309 dm-0 DELL,MD3000i
      Dec 27 13:24:41 xen2 SM: [6579] size=1.4T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
      Dec 27 13:24:41 xen2 SM: [6579] |-+- policy='round-robin 0' prio=4 status=active
      Dec 27 13:24:41 xen2 SM: [6579] | |- 6:0:0:1 sdi 8:128 active ghost  running
      Dec 27 13:24:41 xen2 SM: [6579] | `- 4:0:0:1 sdc 8:32  failed faulty running
      Dec 27 13:24:41 xen2 SM: [6579] `-+- policy='round-robin 0' prio=3 status=enabled
      Dec 27 13:24:41 xen2 SM: [6579]   |- 5:0:0:1 sdf 8:80  failed faulty running
      Dec 27 13:24:41 xen2 SM: [6579]   `- 7:0:0:1 sdl 8:176 active ready  running
      Dec 27 13:24:41 xen2 SM: [6579] multipathd>
      Dec 27 13:24:41 xen2 SM: [6579] MPATH:  Set val: [2, 4]
      Dec 27 13:24:41 xen2 SM: [6579] Matched SCSIid, updating 360024e800070ed06000007f54dba7bfb
      Dec 27 13:24:41 xen2 SM: [6579] MPATH: Updating entry for [360024e800070ed06000007f54dba7bfb], current: [0, 4]
      Dec 27 13:24:41 xen2 SM: [6579] MPATH: Update done
      Dec 27 13:24:41 xen2 SM: [6579] lock: closed /var/lock/sm/mpathcount2/host
      Dec 27 13:24:41 xen2 SM: [6579] lock: released /var/lock/sm/mpathcount1/host
      Dec 27 13:24:41 xen2 SM: [6579] lock: closed /var/lock/sm/mpathcount1/host
      Dec 27 13:24:41 xen2 SM: [6663] lock: acquired /var/lock/sm/mpathcount1/host
      Dec 27 13:24:41 xen2 SM: [6663] lock: released /var/lock/sm/mpathcount2/host
      Dec 27 13:24:41 xen2 SM: [6663] MPATH: I get the lock
      Dec 27 13:24:41 xen2 SM: [6663] Matched SCSIid, updating 360024e80007b786a000004134a9670f3
      Dec 27 13:24:41 xen2 SM: [6663] MPATH: Updating entry for [360024e80007b786a000004134a9670f3], current: [2, 4]
      Dec 27 13:24:41 xen2 SM: [6663] Matched SCSIid, updating 360024e800054baef0000ddd550c85082
      Dec 27 13:24:41 xen2 SM: [6663] MPATH: Updating entry for [360024e800054baef0000ddd550c85082], current: [4, 4]
      Dec 27 13:24:41 xen2 SM: [6663] Matched SCSIid, updating 360024e800070ed06000004314a967309
      Dec 27 13:24:41 xen2 SM: [6663] MPATH: Updating entry for [360024e800070ed06000004314a967309], current: [2, 4]
      Dec 27 13:24:41 xen2 SM: [6663] mpath cmd: show map 360024e800070ed06000004314a967309 topology
      Dec 27 13:24:41 xen2 SM: [6663] mpath output: multipathd> 360024e800070ed06000004314a967309 dm-0 DELL,MD3000i
      Dec 27 13:24:41 xen2 SM: [6663] size=1.4T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
      Dec 27 13:24:41 xen2 SM: [6663] |-+- policy='round-robin 0' prio=4 status=active
      Dec 27 13:24:41 xen2 SM: [6663] | |- 6:0:0:1 sdi 8:128 active ghost  running
      Dec 27 13:24:41 xen2 SM: [6663] | `- 4:0:0:1 sdc 8:32  failed faulty running
      Dec 27 13:24:41 xen2 SM: [6663] `-+- policy='round-robin 0' prio=3 status=enabled
      Dec 27 13:24:41 xen2 SM: [6663]   |- 5:0:0:1 sdf 8:80  failed faulty running
      Dec 27 13:24:41 xen2 SM: [6663]   `- 7:0:0:1 sdl 8:176 active ready  running
      Dec 27 13:24:41 xen2 SM: [6663] multipathd>
      Dec 27 13:24:41 xen2 SM: [6663] mpath cmd: show map 360024e800070ed06000004314a967309 topology
      Dec 27 13:24:42 xen2 SM: [6663] mpath output: multipathd> 360024e800070ed06000004314a967309 dm-0 DELL,MD3000i
      Dec 27 13:24:42 xen2 SM: [6663] size=1.4T features='3 queue_if_no_path pg_init_retries 50' hwhandler='1 rdac' wp=rw
      Dec 27 13:24:42 xen2 SM: [6663] |-+- policy='round-robin 0' prio=4 status=active
      Dec 27 13:24:42 xen2 SM: [6663] | |- 6:0:0:1 sdi 8:128 active ghost  running
      Dec 27 13:24:42 xen2 SM: [6663] | `- 4:0:0:1 sdc 8:32  failed faulty running
      Dec 27 13:24:42 xen2 SM: [6663] `-+- policy='round-robin 0' prio=3 status=enabled
      Dec 27 13:24:42 xen2 SM: [6663]   |- 5:0:0:1 sdf 8:80  failed faulty running
      Dec 27 13:24:42 xen2 SM: [6663]   `- 7:0:0:1 sdl 8:176 active ready  running
      Dec 27 13:24:42 xen2 SM: [6663] multipathd>
      Dec 27 13:24:42 xen2 SM: [6663] Matched SCSIid, updating 360024e800070ed06000007f54dba7bfb
      Dec 27 13:24:42 xen2 SM: [6663] MPATH: Updating entry for [360024e800070ed06000007f54dba7bfb], current: [0, 4]
      Dec 27 13:24:42 xen2 SM: [6663] MPATH: Update done
      Dec 27 13:24:42 xen2 SM: [6663] lock: closed /var/lock/sm/mpathcount2/host
      Dec 27 13:24:42 xen2 SM: [6663] lock: released /var/lock/sm/mpathcount1/host
      Dec 27 13:24:42 xen2 SM: [6663] lock: closed /var/lock/sm/mpathcount1/host
      Dec 27 13:24:42 xen2 SM: [6728] MPATH: Trying to acquire the lock
      Dec 27 13:24:42 xen2 SM: [6728] lock: tried lock /var/lock/sm/mpathcount1/host, acquired: True (exists: True)
      Dec 27 13:24:42 xen2 SM: [6728] MPATH: I get the lock
      Dec 27 13:24:42 xen2 SM: [6728] Matched SCSIid, updating 360024e80007b786a000004134a9670f3
      Dec 27 13:24:42 xen2 SM: [6728] MPATH: Updating entry for [360024e80007b786a000004134a9670f3], current: [2, 4]
      Dec 27 13:24:42 xen2 SM: [6728] Matched SCSIid, updating 360024e800054baef0000ddd550c85082
      Dec 27 13:24:42 xen2 SM: [6728] MPATH: Updating entry for [360024e800054baef0000ddd550c85082], current: [4, 4]
      Dec 27 13:24:42 xen2 SM: [6728] Matched SCSIid, updating 360024e800070ed06000004314a967309
      Dec 27 13:24:42 xen2 SM: [6728] MPATH: Updating entry for [360024e800070ed06000004314a967309], current: [2, 4]
      Dec 27 13:24:42 xen2 SM: [6728] mpath cmd: show map 360024e800070ed06000004314a967309 topology
      
      1 Reply Last reply Reply Quote 0
      • C
        CitrixNewbJD
        last edited by

        0_1482866750909_Screenshot 2016-12-27 13.25.40.png

        scottalanmillerS 1 Reply Last reply Reply Quote 0
        • scottalanmillerS
          scottalanmiller @CitrixNewbJD
          last edited by

          @CitrixNewbJD okay, no need to look in the xen folder, that's not going to be a useful log 🙂

          1 Reply Last reply Reply Quote 0
          • scottalanmillerS
            scottalanmiller
            last edited by

            I'm discussing conversion options with Scale. Looks like moving the disk images over would not be too hard as long as you can pull them off of the SAN.

            1 Reply Last reply Reply Quote 0
            • scottalanmillerS
              scottalanmiller
              last edited by

              If you do this...

              cd ..
              

              It will take you back to the main logs. What is the output of this...

              ls | grep -i xen
              
              C 1 Reply Last reply Reply Quote 0
              • scottalanmillerS
                scottalanmiller
                last edited by

                While you are working on that, this is a good time to discuss triage. In all honesty, this is an old, unmaintained cluster. What is the hardware of the compute nodes?

                The storage is poor. Even if we fix things, the system is very old in both software and hardware. So it's only a bandaid. Which is very doable, but it is what it is.

                Doing a migration, like right now, might be the logical path forward. Let's get your specs for the current cluster, concerns for a new one and discuss if that's a real possibility. Also, what is the moment to moment impact of the outage?

                C 1 Reply Last reply Reply Quote 1
                • C
                  CitrixNewbJD @scottalanmiller
                  last edited by

                  @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                  If you do this...

                  cd ..
                  

                  It will take you back to the main logs. What is the output of this...

                  ls | grep -i xen
                  
                  [root@xen2 ~]# ls | grep -i xen
                  xen2pooldb
                  [root@xen2 ~]#
                  
                  scottalanmillerS 1 Reply Last reply Reply Quote 0
                  • scottalanmillerS
                    scottalanmiller @CitrixNewbJD
                    last edited by

                    @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                    @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                    If you do this...

                    cd ..
                    

                    It will take you back to the main logs. What is the output of this...

                    ls | grep -i xen
                    
                    [root@xen2 ~]# ls | grep -i xen
                    xen2pooldb
                    [root@xen2 ~]#
                    

                    What does this return...

                    pwd
                    
                    C 1 Reply Last reply Reply Quote 0
                    • C
                      CitrixNewbJD @scottalanmiller
                      last edited by

                      @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                      While you are working on that, this is a good time to discuss triage. In all honesty, this is an old, unmaintained cluster. What is the hardware of the compute nodes?

                      The storage is poor. Even if we fix things, the system is very old in both software and hardware. So it's only a bandaid. Which is very doable, but it is what it is.

                      Doing a migration, like right now, might be the logical path forward. Let's get your specs for the current cluster, concerns for a new one and discuss if that's a real possibility. Also, what is the moment to moment impact of the outage?

                      I actually have a quote for a cluster from Scale that I had planned to try to push forward with the owner of the company when he returns from Europe next week. In the interest of properly giving you the information that you need, I want to be sure you're aware of that.

                      scottalanmillerS 1 Reply Last reply Reply Quote 0
                      • C
                        CitrixNewbJD @scottalanmiller
                        last edited by

                        @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                        @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                        @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                        If you do this...

                        cd ..
                        

                        It will take you back to the main logs. What is the output of this...

                        ls | grep -i xen
                        
                        [root@xen2 ~]# ls | grep -i xen
                        xen2pooldb
                        [root@xen2 ~]#
                        

                        What does this return...

                        pwd
                        

                        /root

                        DashrenderD scottalanmillerS 2 Replies Last reply Reply Quote 0
                        • DashrenderD
                          Dashrender @CitrixNewbJD
                          last edited by

                          @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                          @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                          @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                          @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                          If you do this...

                          cd ..
                          

                          It will take you back to the main logs. What is the output of this...

                          ls | grep -i xen
                          
                          [root@xen2 ~]# ls | grep -i xen
                          xen2pooldb
                          [root@xen2 ~]#
                          

                          What does this return...

                          pwd
                          

                          /root

                          that explains a lot - I think you want to be in /var/logs

                           cd /var/logs
                          
                          scottalanmillerS 1 Reply Last reply Reply Quote 0
                          • scottalanmillerS
                            scottalanmiller @CitrixNewbJD
                            last edited by

                            @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                            @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                            While you are working on that, this is a good time to discuss triage. In all honesty, this is an old, unmaintained cluster. What is the hardware of the compute nodes?

                            The storage is poor. Even if we fix things, the system is very old in both software and hardware. So it's only a bandaid. Which is very doable, but it is what it is.

                            Doing a migration, like right now, might be the logical path forward. Let's get your specs for the current cluster, concerns for a new one and discuss if that's a real possibility. Also, what is the moment to moment impact of the outage?

                            I actually have a quote for a cluster from Scale that I had planned to try to push forward with the owner of the company when he returns from Europe next week. In the interest of properly giving you the information that you need, I want to be sure you're aware of that.

                            So the quote is already spec'd and ready to go? Maybe call him in Europe and see if things can be expedited? Would suck to have a major recovery operation happen just to hold off a discussion by one week.

                            C 1 Reply Last reply Reply Quote 0
                            • scottalanmillerS
                              scottalanmiller @CitrixNewbJD
                              last edited by

                              @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                              @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                              @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                              @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                              If you do this...

                              cd ..
                              

                              It will take you back to the main logs. What is the output of this...

                              ls | grep -i xen
                              
                              [root@xen2 ~]# ls | grep -i xen
                              xen2pooldb
                              [root@xen2 ~]#
                              

                              What does this return...

                              pwd
                              

                              /root

                              How did you get there?

                              DashrenderD 1 Reply Last reply Reply Quote 0
                              • scottalanmillerS
                                scottalanmiller @Dashrender
                                last edited by

                                @Dashrender said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                If you do this...

                                cd ..
                                

                                It will take you back to the main logs. What is the output of this...

                                ls | grep -i xen
                                
                                [root@xen2 ~]# ls | grep -i xen
                                xen2pooldb
                                [root@xen2 ~]#
                                

                                What does this return...

                                pwd
                                

                                /root

                                that explains a lot - I think you want to be in /var/logs

                                 cd /var/logs
                                

                                Yes

                                C 1 Reply Last reply Reply Quote 0
                                • DashrenderD
                                  Dashrender @scottalanmiller
                                  last edited by

                                  @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                  @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                  @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                  @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                  @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                  If you do this...

                                  cd ..
                                  

                                  It will take you back to the main logs. What is the output of this...

                                  ls | grep -i xen
                                  
                                  [root@xen2 ~]# ls | grep -i xen
                                  xen2pooldb
                                  [root@xen2 ~]#
                                  

                                  What does this return...

                                  pwd
                                  

                                  /root

                                  How did you get there?

                                  I was wondering that. 🙂

                                  1 Reply Last reply Reply Quote 0
                                  • C
                                    CitrixNewbJD @scottalanmiller
                                    last edited by

                                    @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                    @Dashrender said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                    @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                    @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                    @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                    @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                    If you do this...

                                    cd ..
                                    

                                    It will take you back to the main logs. What is the output of this...

                                    ls | grep -i xen
                                    
                                    [root@xen2 ~]# ls | grep -i xen
                                    xen2pooldb
                                    [root@xen2 ~]#
                                    

                                    What does this return...

                                    pwd
                                    

                                    /root

                                    that explains a lot - I think you want to be in /var/logs

                                     cd /var/logs
                                    

                                    Yes

                                    [root@xen2 log]# ls | grep -i xen
                                    xen
                                    xen-dmesg
                                    xensource.log
                                    xensource.log.1.gz
                                    xensource.log.2.gz
                                    xensource.log.3.gz
                                    xensource.log.4.gz
                                    xenstored-access.log
                                    
                                    scottalanmillerS 1 Reply Last reply Reply Quote 0
                                    • scottalanmillerS
                                      scottalanmiller @CitrixNewbJD
                                      last edited by

                                      @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                      @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                      @Dashrender said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                      @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                      @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                      @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                      @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                      If you do this...

                                      cd ..
                                      

                                      It will take you back to the main logs. What is the output of this...

                                      ls | grep -i xen
                                      
                                      [root@xen2 ~]# ls | grep -i xen
                                      xen2pooldb
                                      [root@xen2 ~]#
                                      

                                      What does this return...

                                      pwd
                                      

                                      /root

                                      that explains a lot - I think you want to be in /var/logs

                                       cd /var/logs
                                      

                                      Yes

                                      [root@xen2 log]# ls | grep -i xen
                                      xen
                                      xen-dmesg
                                      xensource.log
                                      xensource.log.1.gz
                                      xensource.log.2.gz
                                      xensource.log.3.gz
                                      xensource.log.4.gz
                                      xenstored-access.log
                                      

                                      There we go. Let's see what the xen logs thing.

                                      tail -n 100 xen
                                      
                                      tail -n 100 xen-dmesg
                                      
                                      tail -n 100 xensource.log
                                      
                                      C 1 Reply Last reply Reply Quote 0
                                      • DashrenderD
                                        Dashrender
                                        last edited by Dashrender

                                        Scott could make this a bit easier on you and give you specific paths in the commands 😉

                                        example

                                         tail -n 100 /var/log/xen
                                         tail -n 100 /var/log/xen-dmesg
                                         tail -n 100 /var/log/xensource.log
                                        

                                        You can run these from path and they should give you the desired output

                                        1 Reply Last reply Reply Quote 0
                                        • C
                                          CitrixNewbJD @scottalanmiller
                                          last edited by

                                          @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                          @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                          @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                          @Dashrender said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                          @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                          @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                          @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                          @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                          If you do this...

                                          cd ..
                                          

                                          It will take you back to the main logs. What is the output of this...

                                          ls | grep -i xen
                                          
                                          [root@xen2 ~]# ls | grep -i xen
                                          xen2pooldb
                                          [root@xen2 ~]#
                                          

                                          What does this return...

                                          pwd
                                          

                                          /root

                                          that explains a lot - I think you want to be in /var/logs

                                           cd /var/logs
                                          

                                          Yes

                                          [root@xen2 log]# ls | grep -i xen
                                          xen
                                          xen-dmesg
                                          xensource.log
                                          xensource.log.1.gz
                                          xensource.log.2.gz
                                          xensource.log.3.gz
                                          xensource.log.4.gz
                                          xenstored-access.log
                                          

                                          There we go. Let's see what the xen logs thing.

                                          tail -n 100 xen
                                          
                                          tail -n 100 xen-dmesg
                                          
                                          tail -n 100 xensource.log
                                          
                                          [root@xen2 log]# tail -n 100 /var/logs/xen
                                          tail: cannot open `/var/logs/xen' for reading: No such file or directory
                                          [root@xen2 log]# tail -n 100 /var/log/xen
                                          tail: error reading `/var/log/xen': Is a directory
                                          [root@xen2 log]# tail -n 100 xen
                                          tail: error reading `xen': Is a directory
                                          [root@xen2 log]# cd xen
                                          [root@xen2 xen]# tail -n 100 xen
                                          tail: cannot open `xen' for reading: No such file or directory
                                          

                                          What's wrong with my syntax?

                                          DashrenderD 1 Reply Last reply Reply Quote 0
                                          • C
                                            CitrixNewbJD @scottalanmiller
                                            last edited by

                                            @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                            @CitrixNewbJD said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                            @scottalanmiller said in XenServer 6.2 servers down. I have no Xen skill. Most likely networking? Help!:

                                            While you are working on that, this is a good time to discuss triage. In all honesty, this is an old, unmaintained cluster. What is the hardware of the compute nodes?

                                            The storage is poor. Even if we fix things, the system is very old in both software and hardware. So it's only a bandaid. Which is very doable, but it is what it is.

                                            Doing a migration, like right now, might be the logical path forward. Let's get your specs for the current cluster, concerns for a new one and discuss if that's a real possibility. Also, what is the moment to moment impact of the outage?

                                            I actually have a quote for a cluster from Scale that I had planned to try to push forward with the owner of the company when he returns from Europe next week. In the interest of properly giving you the information that you need, I want to be sure you're aware of that.

                                            So the quote is already spec'd and ready to go? Maybe call him in Europe and see if things can be expedited? Would suck to have a major recovery operation happen just to hold off a discussion by one week.

                                            I'd need to talk to someone from Scale to understand the process and guarantees of it working, or the headaches involved before making that call. Can you tell me with whom you spoke, or have them contact my reps, Blake Dickmeyer and Frank Seal?

                                            scottalanmillerS 2 Replies Last reply Reply Quote 0
                                            • 1
                                            • 2
                                            • 3
                                            • 4
                                            • 5
                                            • 6
                                            • 7
                                            • 8
                                            • 12
                                            • 13
                                            • 6 / 13
                                            • First post
                                              Last post