Stokbar

Business Continuity Plan - Emergency Global Applications Leadership_Team iSupplier North America Turkey Region Global Infrastructure Mexico Region China Region India Region China Infrastructure India Infrastructure CATIA Global License Server Mexico Infrastructure Turkey Infrastructure Network Circuits Business Continuity - MX1 China Application India Applications Crowdstrike Mexico Applications Turkey Applications QA Alert Hardware PLM Network EHS/QA Oracle EBS Office 365 VPN EPM OKTA Oracle HCM - tpiOne QA Mobile (QMS) Mobile Manufacturing Snowflake Supplier Quality Portal(SQP) Stokbar YZ Print Services EAM System IND Printer IND ADP TRESS System (Payroll System) MPLS Circuits Enibra MPLS Circuits Arizona IND File Server IND Solidworks AduanaSoft System Internet & P2P Circuits Beam Internet Circuits YZ Backup Workflow Iowa Lenovo Disk IND Backups IND Maintainwiz E-Book & E-Invoice P2P Internet Circuit TC Backup Rhode Island E-Card System IND CCTV System IND MiniTAB WEB Based Applications Print Services DF Backup Santa Theresa E-LPA IND Network CCTV Systems China Test YZ License Service WeCom IND QA TAB Local Servers YZ CCTV WenJuanXin IND Video Conferencing YZ Network E-bidding YZ IP Phone YZ Fileserver DF Network DF License Service DF CCTV DF Fileserver DF Print Service TC Network China VPN TC CCTV TC Print Service TC Fileserver TC License Service MX1 - MPLS Circuit MX2 - MX1 P2P & Internet Circuit TK1 - MPLS Circuit TK1 - Internet Circuit TK1 - Print Service TK1 - CCTV System TK1 - Local Servers MX2 - MPLS Circuit MX2 - MX5 P2P & Internet Circuit TK2 - MPLS Circuit TK2 - Internet Circuit TK2 - Print Service TK2 - CCTV System TK2 - Local Servers MX4 - MPLS Circuit MX2 - MX4 P2P & Internet Circuit
 
Jul-18 2024, 11:05pm

From today morning 10:30 AM IST hours onwards, laptops across all the regions are getting crashed and restarting for several users. For many of them, it's successfully getting restarted and able to continue operations and for some of them, it's failing to restart.

We're currently on the bridge call involving all the IT Teams across regions and cases have been raised with Microsoft Vendor Support Team to identify the root-cause and permanent fix.

As of now, Security Team confirmed that this is not any kind of malicious activity or a Cyber Attack.

We'll provide updates periodically. Thanks for your patience. 

 
Jul-19 2024, 12:04am

We've identified the root-cause of the problem.

Recent version update of the CrowdStrike sensors running on the Windows laptops caused this bluescreen error and loop restarts of the laptops. We're working on pushing a global updates on all the machines to uninstall the sensor. 

Thanks for your patience. 

 
Jul-19 2024, 1:37am

We're still working on a fix for this issue. In the meanwhile, we strongly advise users to not turn on their laptops unless its production critical and really necessary for delivery standpoint.


This is a global issue and several organizations' across the globe are impacted. We'll send out communications when the issue is fixed so that you can use your laptops without any issues.


Incase, you're using your laptops, please contact your local IT Team to uninstall the CrowdStrike software in your machine immediately. Once uninstalled, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet. 


Thanks for your patience. We will continue to send out periodic updates.

 
Jul-19 2024, 5:28am

Security Team is still following up with CrowdStrike Vendor for permanent fix. 


If you're using your laptops, please contact your local IT Team to uninstall the CrowdStrike software in your machine immediately. Once uninstalled, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet. 


Thanks for your patience. We will continue to send out periodic updates.

 
Jul-19 2024, 9:00am

IT team has been recovering laptops and PCs of affected users across the regions. As of 9:00 AM AZ time, many business critical user computers and leadership PCs are restored and the effort is ongoing in Mexico region. 

If you're using laptop, please contact your local IT Team to restore your machine. Once recovered, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet. 

This is a global issue impacting multiple organizations. A permanent fix is still being worked by Microsoft and Crowd strike.

Thanks for your patience and co-operation. Periodic updates will follow.

 
Jul-19 2024, 2:00pm

IT Team has restored majority of the impacted laptops and desktop computers in all regions. This enabled to continue regular operations and resume business activities.

Team has also reached out many users proactively and continued the restoring process. If you are one of the users (on-site or remote) who is still impacted, please reach out to your local IT support personal as mentioned in below list. Remote users will be supported over the phone and doesn't require to ship the laptop. 

As of 2:00 PM AZ Time, all critical applications, including Oracle ERP, tpiOne, QMS are working normal. 



Next update will follow on 07/20 9:00 AM AZ time. 

 
Jul-20 2024, 9:00am
[in progress]

IT Teams from each region restored laptops that are identified and reported. If you are one of the users (on-site or remote) who is still impacted, please reach out to your local IT support by calling their contact Phone number or messaging in teams, as mentioned in below list. 

Regional IT teams are available to support over the weekend. Remote users will be supported over the phone and doesn't require to ship the laptop. 


August 30 2023, 12:00am
Oracle EBS QA Mobile (QMS) Stokbar
 
Aug-29 2023, 2:07pm

Dear Associate,

  The Oracle planned outage for Tomorrow(Aug-30, 00:00 AM AZ time) will have no impact in accessing Oracle application. Business will continue as normal since IT team was successfully able to implement the rerouting approach during the network upgrade. 

 

Regards,

TPI IT Support. 

 
Aug-30 2023, 12:00am

Dear Associate,

      Our Oracle cloud connectivity service provider, has scheduled a mandatory software upgrade on Wednesday, 30th August 2023, between 00:00 AM to 04:00 AM AZ Time which impacts Oracle Production instance.
While IT Teams are working on an alternative approach to avoid the downtime by rerouting the connection through a secondary channel, the results of that is still pending.
If the alternate approach is enabled prior to the upgrade, you may not experience any disruption. If not, your EBS operations including logging in and transactions will be impacted during this period.
IT will send out a follow up communication with in next 24 hours on the impact status. We appreciate your understanding and apologize for any inconvenience.

To assist you in adjusting your plans, here are the maintenance start timings in different time zones:

  • India: Wednesday, 30th August 2023, 12:30 PM IST
  • Turkey: Wednesday, 30th August 2023, 10:00 AM TRT
  • China: Wednesday, 30th August 2023, 03:00 PM CST
  • US / MX: Wednesday, 30th August 2023, 00:00 AM AZ Time  

Impact applications:
Oracle EBS
QMS Jobs
Stokbar 

Non-Impacted applications:
tpiOne
iSupplier

Thank you for your cooperation.

Oracle EBS QA Mobile (QMS) Stokbar
 
Aug-29 2023, 4:19pm

Dear Associate,

  Due to a communication issue with our broadcasting application, there were multiple notifications delivered regarding the network upgrade scheduled on Aug-30.

  Please consider below notification as the most recent and final. We apologize for the inconveniece. 
  

  The Oracle planned outage for Tomorrow(Aug-30, 00:00 AM AZ time) will have no impact in accessing Oracle application. Business will continue as normal since IT team was successfully able to implement the rerouting approach during the network upgrade. 

Regards,
TPI IT Support. 

 
Aug-29 2023, 4:19pm
Resolved
August 16 2023, 7:11am
Oracle EBS Stokbar
 
Aug-16 2023, 7:11am

Users across the TPI locations are unable to connect to the Oracle applications over Fortinet Client, Global Protect VPN and from Office premise network , due to network outage with Megaport cloud service provider, we are closely working with the vendor.

And also the integration to oracle will not work until network connectivity issue is fixed.

Case has been raised with Megaport service provider to understand the issue. We will keep you all posted for further updates. Sorry for the inconvenience and thank you for your understanding.
 

 
Aug-16 2023, 8:00am

 

Network connectivity issue has been resolved. 

Oracle users should be able to connect oracle now.

Thanks for your understanding.

iSupplier Oracle EBS Stokbar
 
Oct-29 2021, 6:00pm

 

Dear Associate,

    Oracle Production Outage is planned between 6:00 PM AZ Time and 7:00 PM AZ Time to enable Single Sign On using Okta for Oracle EBS login.

    Once services are restored, users will be prompted to enter their Okta username and password while logging in to Oracle EBS.

If you experience any issue with login, please follow the below link to dial in and report. Global and Regional IT teams will be available to fix immediately during the below schedule.

  • Friday(10/29) 6 PM AZ Time until Saturday(10/30) 9 AM AZ Time 
  • Sunday(10/31) 5 PM AZ Time until Monday(11/01) 5 PM AZ Time

Click here to join the meeting

Please create a Cherwell Ticket (Under Everything Oracle Service) if you are unable to dial-in.

Regards,
IT Support

 
Oct-29 2021, 7:03pm

Dear Associates,

   IT Team is working to restore the Oracle EBS services. Expected resolution time is 20:00 Hrs AZ Time. 

  

Regards,

TPI IT. 

 
Oct-29 2021, 10:30pm

Dear Associate,

  Due to Technical challenges, Oracle EBS is NOT enabled for Single Sign-On. Please continue to login Oracle the same way that you were logging before. 

  Oracle Services are up and running normal. Associates are able to login and confirmed. Normal operations resumed. 

   We shall be enabling Single Sign-On soon by keeping you informed. 

   Thank you for your patience and co-operation. 


Regards,

TPI IT.  

 

 

iSupplier Oracle EBS QA Mobile (QMS) Stokbar
 
Oct-16 2021, 7:00pm

Oracle Team will be applying patches for system stability on EBS Production system on Oct-16, between 7:00 PM AZ time to 10:00 PM AZ time. 
Users will be unable to access oracle application during this time.

Regards,
Production Support Team. 

 
Oct-16 2021, 9:10pm

Oracle services are back online. Users are able to login successfully. 

Oracle EBS QA Mobile (QMS) Stokbar
 
Oct-11 2021, 1:00pm

Hi All,

Issue:  Expiration of SSL certificates

Reason for outage : Renew / Extend the SSL certificates and restart the services

Business Impact: Oracle EBS services will be unavailable during the outage window  

Outage Window: Monday 10/11/2021 01:00 PM AZ to 10/11/2021 01:30 PM AZ

Thanks,
IT Team

 
Oct-11 2021, 1:35pm

Oracle services are back online. Users are able to login and resume regular activities. 

Thank you for the patience and support. 


Regards,

IT Team

Network Oracle EBS Oracle HCM - tpiOne QA Mobile (QMS) Stokbar
 
Feb-12 2021, 4:40pm

Due to electrical instructure failure Servers and Network has shutdown involuntarily. 

Services were unavailable for 13hrs.

 

 
Feb-13 2021, 5:40am

Eletrical Maintanence team fixed the issue in 13hrs.

Systems are back up and running.

 
Feb-13 2021, 5:40am

Maintenance on Backup Power Generators caused electrical short curciut, and caused factory wide general electrical failure.