Stokbar
From today morning 10:30 AM IST hours onwards, laptops across all the regions are getting crashed and restarting for several users. For many of them, it's successfully getting restarted and able to continue operations and for some of them, it's failing to restart.
We're currently on the bridge call involving all the IT Teams across regions and cases have been raised with Microsoft Vendor Support Team to identify the root-cause and permanent fix.
As of now, Security Team confirmed that this is not any kind of malicious activity or a Cyber Attack.
We'll provide updates periodically. Thanks for your patience.
We've identified the root-cause of the problem.
Recent version update of the CrowdStrike sensors running on the Windows laptops caused this bluescreen error and loop restarts of the laptops. We're working on pushing a global updates on all the machines to uninstall the sensor.
Thanks for your patience.
We're still working on a fix for this issue. In the meanwhile, we strongly advise users to not turn on their laptops unless its production critical and really necessary for delivery standpoint.
This is a global issue and several organizations' across the globe are impacted. We'll send out communications when the issue is fixed so that you can use your laptops without any issues.
Incase, you're using your laptops, please contact your local IT Team to uninstall the CrowdStrike software in your machine immediately. Once uninstalled, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet.
Thanks for your patience. We will continue to send out periodic updates.
Security Team is still following up with CrowdStrike Vendor for permanent fix.
If you're using your laptops, please contact your local IT Team to uninstall the CrowdStrike software in your machine immediately. Once uninstalled, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet.
Thanks for your patience. We will continue to send out periodic updates.
IT team has been recovering laptops and PCs of affected users across the regions. As of 9:00 AM AZ time, many business critical user computers and leadership PCs are restored and the effort is ongoing in Mexico region.
If you're using laptop, please contact your local IT Team to restore your machine. Once recovered, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet.
This is a global issue impacting multiple organizations. A permanent fix is still being worked by Microsoft and Crowd strike.
Thanks for your patience and co-operation. Periodic updates will follow.
IT Team has restored majority of the impacted laptops and desktop computers in all regions. This enabled to continue regular operations and resume business activities.
Team has also reached out many users proactively and continued the restoring process. If you are one of the users (on-site or remote) who is still impacted, please reach out to your local IT support personal as mentioned in below list. Remote users will be supported over the phone and doesn't require to ship the laptop.
As of 2:00 PM AZ Time, all critical applications, including Oracle ERP, tpiOne, QMS are working normal.
Next update will follow on 07/20 9:00 AM AZ time.
IT Teams from each region restored laptops that are identified and reported. If you are one of the users (on-site or remote) who is still impacted, please reach out to your local IT support by calling their contact Phone number or messaging in teams, as mentioned in below list.
Regional IT teams are available to support over the weekend. Remote users will be supported over the phone and doesn't require to ship the laptop.
Dear Associate,
The Oracle planned outage for Tomorrow(Aug-30, 00:00 AM AZ time) will have no impact in accessing Oracle application. Business will continue as normal since IT team was successfully able to implement the rerouting approach during the network upgrade.
Regards,
TPI IT Support.
Dear Associate,
Our Oracle cloud connectivity service provider, has scheduled a mandatory software upgrade on Wednesday, 30th August 2023, between 00:00 AM to 04:00 AM AZ Time which impacts Oracle Production instance.
While IT Teams are working on an alternative approach to avoid the downtime by rerouting the connection through a secondary channel, the results of that is still pending.
If the alternate approach is enabled prior to the upgrade, you may not experience any disruption. If not, your EBS operations including logging in and transactions will be impacted during this period.
IT will send out a follow up communication with in next 24 hours on the impact status. We appreciate your understanding and apologize for any inconvenience.
To assist you in adjusting your plans, here are the maintenance start timings in different time zones:
- India: Wednesday, 30th August 2023, 12:30 PM IST
- Turkey: Wednesday, 30th August 2023, 10:00 AM TRT
- China: Wednesday, 30th August 2023, 03:00 PM CST
- US / MX: Wednesday, 30th August 2023, 00:00 AM AZ Time
Impact applications:
Oracle EBS
QMS Jobs
Stokbar
Non-Impacted applications:
tpiOne
iSupplier
Thank you for your cooperation.
Dear Associate,
Due to a communication issue with our broadcasting application, there were multiple notifications delivered regarding the network upgrade scheduled on Aug-30.
Please consider below notification as the most recent and final. We apologize for the inconveniece.
The Oracle planned outage for Tomorrow(Aug-30, 00:00 AM AZ time) will have no impact in accessing Oracle application. Business will continue as normal since IT team was successfully able to implement the rerouting approach during the network upgrade.
Regards,
TPI IT Support.
Users across the TPI locations are unable to connect to the Oracle applications over Fortinet Client, Global Protect VPN and from Office premise network , due to network outage with Megaport cloud service provider, we are closely working with the vendor.
And also the integration to oracle will not work until network connectivity issue is fixed.
Case has been raised with Megaport service provider to understand the issue. We will keep you all posted for further updates. Sorry for the inconvenience and thank you for your understanding.
Network connectivity issue has been resolved.
Oracle users should be able to connect oracle now.
Thanks for your understanding.
Dear Associate,
Oracle Production Outage is planned between 6:00 PM AZ Time and 7:00 PM AZ Time to enable Single Sign On using Okta for Oracle EBS login.
Once services are restored, users will be prompted to enter their Okta username and password while logging in to Oracle EBS.
If you experience any issue with login, please follow the below link to dial in and report. Global and Regional IT teams will be available to fix immediately during the below schedule.
- Friday(10/29) 6 PM AZ Time until Saturday(10/30) 9 AM AZ Time
- Sunday(10/31) 5 PM AZ Time until Monday(11/01) 5 PM AZ Time
Click here to join the meeting
Please create a Cherwell Ticket (Under Everything Oracle Service) if you are unable to dial-in.
Regards,
IT Support
Dear Associates,
IT Team is working to restore the Oracle EBS services. Expected resolution time is 20:00 Hrs AZ Time.
Regards,
TPI IT.
Dear Associate,
Due to Technical challenges, Oracle EBS is NOT enabled for Single Sign-On. Please continue to login Oracle the same way that you were logging before.
Oracle Services are up and running normal. Associates are able to login and confirmed. Normal operations resumed.
We shall be enabling Single Sign-On soon by keeping you informed.
Thank you for your patience and co-operation.
Regards,
TPI IT.
Oracle Team will be applying patches for system stability on EBS Production system on Oct-16, between 7:00 PM AZ time to 10:00 PM AZ time.
Users will be unable to access oracle application during this time.
Regards,
Production Support Team.
Oracle services are back online. Users are able to login successfully.
Hi All,
Issue: Expiration of SSL certificates
Reason for outage : Renew / Extend the SSL certificates and restart the services
Business Impact: Oracle EBS services will be unavailable during the outage window
Outage Window: Monday 10/11/2021 01:00 PM AZ to 10/11/2021 01:30 PM AZ
Thanks,
IT Team
Oracle services are back online. Users are able to login and resume regular activities.
Thank you for the patience and support.
Regards,
IT Team
Due to electrical instructure failure Servers and Network has shutdown involuntarily.
Services were unavailable for 13hrs.
Eletrical Maintanence team fixed the issue in 13hrs.
Systems are back up and running.
Maintenance on Backup Power Generators caused electrical short curciut, and caused factory wide general electrical failure.