BCM 400 Trouble Shooting Guide
(or cursor keys)Action: Determine where customer is reporting static, and isolate to specific equipment.
Use the following steps to narrow scope of problem (Note: Static typically occurs in analogue sections):
- Determine how many sets affected
- Determine if static is affecting only a specific type of set (eg. T7316 only or IP sets only)
- Determine if static is affecting only a specific set
- Determine if static is limited to local vs external calls
- Determine if static only affects PRI/BRI vs GATM calls
- Do both parties hear the static?
Start with a digital set if possible, go off hook, listen for steady dial tone, type number to break dial tone, listen for quiet.
If static isolated to digital set:
|
If static isolated to GATM port:
|
If static isolated to IP set:
|
If static isolated to T1/PRI:
|
Action:
- If it is a new unit, then ensure the installer gives it at least 60 mins to boot
If the BCM is performing FSCK (file system check), it should come up within 1hr to 1hr15min - If unit is not up after 60mins, connect to the console port with a hyperterminal and a null modem serial cable (9600,8,n,1). Hit enter to get a login prompt (nnadmin, PlsChgMe!) otherwise the boot up sequence can be observed.
- If unable to login on serial port, remove VGA & keyboard access panel, and attach a monitor to view POST and Linux boot.
If POST completes correctly, the last line displayed will be "Uncompressing Linux OK, booting the kernel.". - If you do NOT see "Uncompressing Linux OK, booting the kernel.", the likely cause would be a "bad/corrupted HD".
Confirm error messages from POST, replace or re-image the HD. - If POST (power-on-self-test) has NOT completed correctly, open up the BCM to ensure all connections are intact.
Action:
- Check LED status normal (ie. LED 1, 3-10 All Green). (LED 2: Drive LED could be dark if no HD activity).
- Ensure installer has access to the LAN port (ie. able to ping the port).
- Check to ensure the installer has the correct version of EM on PC.
If in doubt, download the current version from the Web page of the BCM. - Ensure the Date and Time are set correctly in BCM
- Try Telset programming. If Telset programming works, then it confirms the problem resides with EM.
- If nothing works, then collect logs and escalate. Could be other issues such as RPM corruption
Action:
- Review alarms and status LEDs for errors (ie. LED 3-9 should be Green). Take action on any errors.
- If alarms report "/var/log partition full", check if BCM is patch current, if yes then escalate.
- Verify where patch is located (e.g. from USB, server). Try another PC to see if the operator can backup or patch.
- Check to ensure the installer has the correct version of EM on PC
- Ensure the PC is set up correctly to communicate with the BCM
- Ensure the Date and Time are set correctly in BCM
- Check physical connections (e.g. LAN cables)
Action:
- Ensure the unit has the latest core patch and dependencies
- Check analog, GATM at correct firmware/version, DIP switches are properly set Bus Resource switches set properly: mode/country all off. GATM comes with auto line tuning functionalities (autoswitch between 600 & 900 ohms)
- Check digital, verify PRI/T1 settings for clock source, interface build out, protocol
If echo is occurring on GATM:
- Verify line with "butt in" set
- Verify DIP switch settings on GATM
- Verify FW version of GATM is up to date
If echo is occurring on PRI/T1 with IP sets:
- Verify settings such as clock source, build out, protocol
- Determine if there is packet loss alarms in logs
If echo is occurring on PRI/T1 with digital sets:
- Verify settings such as clock source, build out, protocol
- Engage carrier to investigate echo in PSTN
Action: Check for Configuration and network problems
- Connect a laptop to that LAN drop to determine if there is connectivity
- Check with customer network architect/support to confirm VLAN setup
- Check if there are any errors while IP phone boots
If BCM CANNOT be pinged:
- Confirm network connectivity
- Confirm VLAN configuration
If BCM CAN be pinged:
- Confirm IP sets have valid IP, Mask, DG, and S1.
- Confirm UTPS service running
Action:
- Check LED status normal (ie. All Green)
- Check with customer network architect/support to confirm VLAN setup
If link status LEDs are good and IP network valid:
- Confirm VLAN settings in network
If connected to customer's network:
- Verify if the BCM can be pinged
- Verify LAN cable is good and link status lights are valid
If any digital sets present, telset admin may be used to:
- Verify IP address and netmask
- Verify default gateway
If BCM cannot be pinged, use console port to:
- Verify IP address and netmask
- Verify default gateway
Action: Check Raid LEDs status: Normal = All 3 LEDs Green); Drive fail = Drive and Status LED red.
If Secondary drive failed:
- Connect secondary drive directly to motherboard to confirm drive failure
Connecting the failed drive directly to the motherboard eliminates the RAID controller as a failure point - Replace secondary HD if HD still unresponsive
- Replace RAID controller if secondary HD works directly with motherboard
If Primary drive failed:
- Move secondary to primary to confirm RAID controller good.
Moving the secondary drive to the primary eliminates the RAID controller and prepares for remirror operation - Replace primary HD if secondary works in primary position
- Replace RAID controller if neither drive recognized on primary RAID channel
Note: Mirroring takes hours (e.g. over 3hrs).
If after replacing the hard-drive you're still seeing errors, check the HD size. Off-the-shelf HDs may not not be compatible with BCM. Always buy the correct replacment HD.
- Use BCM Monitor to confirm that there are enough resources available. Signalling channels, PEC resources.
In a 6/2(5/3) Split, there are only 59(91) signalling channels available for VoIP trunks, Call Pilot, and IP sets. - Confirm that no ports are in "disabled by user" state (resources->telephony->bus->port details)
- Confirm that call center CDNs are properly configured (Digital Station emulation, port unequippped)
Potential issue #2: Defective BFT (Base Function Tray)?
- Confirm that there are no leaking or damaged capacitors evident on motherboard
- Confirm that motherboard does not contain light green capacitors
- Check the Power Supply LED
- Ensure DC voltages are correct (+/-12V; +/-5V; 3.3V)
Potential issue #3: Power source problem?
- Ensure the power source (e.g. from the wall outlet) is a dedicated circuit and it is NOT shared with other appliances BCM draws a significant amount of current especially with an Expansion Module
- If customer is using an UPS or other power conditioning equipment, bypass those devices and connect directly to the wall outlet. This will help to isolate the problem to the power source or BCM
Action:
- Confirm if telephony data back at factory (3 digit, 221 starting DN)
BCM will default back to 3 digit, 221 starting DN if customer data is corrupt - Change number of digits and/or starting DN, then remove power for 15 minutes and confirm configuration valid
- Replace the MSC if it is unable to retain data
Action:
- Verify date, time and time zone are set correctly
- Verify no conflicts in IP subsystem
- Confirm System ID (Via EM) matches the one on the keycode file
- Ensure the sequence number of the keycode is greater than the one currently in the system
- Verify keycode file against KRS. If everything matches up, try to re-apply the keycode file.
- If re-apply fails, try enter keycode via Telset
After trying these steps and you still can't apply keycodes, escalate to KRS
Action:
- Allow the system sufficient time to boot (eg. 60mins). Core patches need to be transferred to the MSC (Media Services Card), and they can take up to 45mins to install
- If unable to recover based on info in alarms, escalate problem
Action:
- Check whether the fans are working
- If fans not working, check electrical wall outlet
- Check the power cord condition
- If power source is verified, replace the power supply or replace the unit
Potential issue #1: Resource conflicts
- In a 2/6 split buses 1 & 8 (2 buses) are used for VoIP and apps. with buses 2 - 7 (6 buses) for MBM.
- In a 3/5 split, bus 7 joins 1 & 8 (3 buses) for VoIP and applications, leaving 2 - 6 (5 buses) for MBMs.
Action:
- Confirm that no media bay modules are configured for bus 07
- Confirm dip switch settings on all MBMs looking for conflicts
- Confirm all CDNs are valid.
Port use must be Digital Station Emulation and port must be unequipped (no phone attached)
Potential issue #2: Disabled Resources
- If telephony resources are not accessible through EM, telset based admin may be used.
Leave only a single DSM for this purpose.
Action:
- Perform a proper shutdown of BCM
- Disconnect power, then remove all media bay modules, disconnect expansion chassis if present
- Reconnect power and startup BCM
- Set all buses to DSM type and review status of all ports
- Any port with status of "Disabled by user" needs to be enabled
- Set ports back to original config on all ports enabled
- Perform a proper shutdown and disconnect power
- Install all media bay modules
- Connect power and restart BCM
- Escalate problem if procedure fails
Action:
- Check alarm 31 or 79 to determine which module is having issues
- Confirm FW version, under B1 channel
- Check dip switch settings. Mode/country switches all off.
- If it is an older MBM, replace MBM
The User ID is the default Nortel telset one of ID = 738662 (setnna), and password 266344 (config).
Just click on the NEXT button 3 times to see System Restart
appear.
Click OK and Yes to reboot the BCM.