EPM
From today morning 10:30 AM IST hours onwards, laptops across all the regions are getting crashed and restarting for several users. For many of them, it's successfully getting restarted and able to continue operations and for some of them, it's failing to restart.
We're currently on the bridge call involving all the IT Teams across regions and cases have been raised with Microsoft Vendor Support Team to identify the root-cause and permanent fix.
As of now, Security Team confirmed that this is not any kind of malicious activity or a Cyber Attack.
We'll provide updates periodically. Thanks for your patience.
We've identified the root-cause of the problem.
Recent version update of the CrowdStrike sensors running on the Windows laptops caused this bluescreen error and loop restarts of the laptops. We're working on pushing a global updates on all the machines to uninstall the sensor.
Thanks for your patience.
We're still working on a fix for this issue. In the meanwhile, we strongly advise users to not turn on their laptops unless its production critical and really necessary for delivery standpoint.
This is a global issue and several organizations' across the globe are impacted. We'll send out communications when the issue is fixed so that you can use your laptops without any issues.
Incase, you're using your laptops, please contact your local IT Team to uninstall the CrowdStrike software in your machine immediately. Once uninstalled, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet.
Thanks for your patience. We will continue to send out periodic updates.
Security Team is still following up with CrowdStrike Vendor for permanent fix.
If you're using your laptops, please contact your local IT Team to uninstall the CrowdStrike software in your machine immediately. Once uninstalled, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet.
Thanks for your patience. We will continue to send out periodic updates.
IT team has been recovering laptops and PCs of affected users across the regions. As of 9:00 AM AZ time, many business critical user computers and leadership PCs are restored and the effort is ongoing in Mexico region.
If you're using laptop, please contact your local IT Team to restore your machine. Once recovered, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet.
This is a global issue impacting multiple organizations. A permanent fix is still being worked by Microsoft and Crowd strike.
Thanks for your patience and co-operation. Periodic updates will follow.
IT Team has restored majority of the impacted laptops and desktop computers in all regions. This enabled to continue regular operations and resume business activities.
Team has also reached out many users proactively and continued the restoring process. If you are one of the users (on-site or remote) who is still impacted, please reach out to your local IT support personal as mentioned in below list. Remote users will be supported over the phone and doesn't require to ship the laptop.
As of 2:00 PM AZ Time, all critical applications, including Oracle ERP, tpiOne, QMS are working normal.
Next update will follow on 07/20 9:00 AM AZ time.
IT Teams from each region restored laptops that are identified and reported. If you are one of the users (on-site or remote) who is still impacted, please reach out to your local IT support by calling their contact Phone number or messaging in teams, as mentioned in below list.
Regional IT teams are available to support over the weekend. Remote users will be supported over the phone and doesn't require to ship the laptop.
An issue has been identified with EPBCS causing incorrect information of our balance sheet. Application support team found the issue related to a recent April patch that was deployed and actively working with Oracle roll back the changes. In parallel, Oracle is debugging the change to find the root cause and fix. If Oracle finds the bug in production and the required fix, we may avoid having to rebuild production.
Technical Support teams are regrouping at 6:30 PM AZ Time for progress.
Issue Resolved in Production after Oracle technical team fixed the bug. Root Cause Analysis will be performed by working with Oracle team and implement plans to prevent future occurrence.
Hi All,
Intermittent slowness in EPM (ARCS/FCCS/ePBCS) applications resolved by Oracle at 12:00 pm MST. Interruption to FCCS integration was cleared. FCCS Integration is running since 10:58 am MST. Performance is back to normal.
Thanks.
Hi All,
Intermittent slowness in EPM (ARCS/FCCS/ePBCS) applications.
FCCS integration to Oracle was interrupted from 3:58 am MST to 10:58 am MST. FCCS integration is running now.
Severity 1 ticket raised with Oracle. We working diligently with Oracle to resolve the issue.
Thanks.
Due to Oracle Upgrade Go-live, Oracle EBS application will be unavailable. During this time, the data feeds from Oracle EBS to ARCS, FCCS, ePBCS and Power BI / Data Warehouse will be suspended.
EPM (ARCS / FCCS / ePBCS ) applications are available and can be accessed, but no new Oracle transactions / balances will flow into ARCS / FCCS / ePBCS during the EBS outage.
Power BI reports are available and can be accessed, but will not be refreshed from Oracle EBS during the EBS outage.
ATTENTION :
EPM (ARCS / FCCS / ePBCS ) and Power BI / Data Warehouse applications are accessible during the EBS outage.
Only data feeds into ARCS / FCCS / ePBCS and Power BI / Data Warehouse will be suspended between 19-Aug-2022 16:00 PM AZ (Friday) until 22-Aug-2022 4:00 AM AZ (Monday).
Task |
Arizona (MST) |
Turkey (TRT) |
India (IST) |
China (CST) |
Outage Starts |
19 Aug 16:00 PM |
20 Aug 02:00 AM |
20 Aug 04:30 AM |
20 Aug 07:00 AM |
Outage Ends |
22 Aug 04:00 AM |
22 Aug 14:00 PM |
22 Aug 16:30 PM |
22 Aug 19:00 PM |