BladeAssure - Production
Hi All
BladeAssure application is not responding - internal site components tpitvs.com and tpi.leverege are not responding.
Leverege vendor are working it.
We'll keep posted with updates.
Thanks & Regards,
BladeAssure Support
Hi All
BladeAssure application is back online - all their components are back working as normal.
Issue stands as closed and no more further updates would be rolled out.
Thanks for your patience and support.
Thanks & Regards
BladeAssure Support
Hi All
We're facing issue with a component (CloudFlare) inside Bladeassure application which is causing disruption and degradation.
We're actively working to resolve the same at the earliest.
We'll keep posted with updates.
Thanks & Regards,
LE2.0 - IT Support
Hi All
Issue is being worked by CloudFlare team - this is a global outage affecting multiple sites worldwide.
We'll keep posted with updates.
Thanks & Regards
BladeAssure Support
Hi All
Cloudflare global outage is resolved and all components are accessible now.
Issue stands as resolved and no more further updates would be rolled out.
Thanks for your support.
Thanks & Regards
BladeAssure Support
An unexpected power outage has occurred in MX1. This is affecting BladeAssure.
The MX1 maintenance team are working to get the power issue rectified.
Power to some device has been restored - working to bring Laser PC's online to bring application back.
Laser PC's are back online - we are working on an issue with 1 camera in MX1 Line 8 Pressure slide.
Camera issues are restored and application is back online.
Issue stands as closed and no more further updates would be rolled out.
Thanks for your cooperation and support.
We are currently experiencing a Sev1 outage impacting the Blade Assure application. Users are unable to access or utilize the platform.
Bladeassure is back for functioning and normal as BAU.
Initial analysis shows there was an issue with Bitnami - we are actively working with Leverege vendor to fully understand the cause of issue and preventive fix for the same.
We'll get back once we have complete RCCA (Root cause and corrective action) available and publish the same.
Issue stands as resolved and no more further updates will be rolled out.
BladeAssure is intermittently down and recovering - it is impacting cycle time and ply detection.
Currently this system is recovering and we are monitoring to ensure its functioning correctly.
Application is currently back online - we are monitoring with high priority along with vendor Leverege and ensuring issues aren't faced further.
BladeAssure was intermittently down and recovering - it impacted cycle time and ply detection.
Currently this system is recovering and we are monitoring to ensure its functioning correctly.
BladeAssure was intermittently down and recovering - it impacted cycle time and ply detection.
Currently this system is recovering and we are monitoring to ensure its functioning correctly.
Currently vendor Leverege is working on data fix to bring the application completely back online
We'll let you know once its completed
Vendor Leverege has again noticed BladeAssure application login issue and currently working with high priority.
We'll get back once we have anything further.
Vendor Leverege is still working on the issue and currently in progress.
We'll update once we hear from them further.
BladeAssure application is back online - vendor has resolved the issue and currently available.
Vendor Leverege is working on data fixes which is taken separately by the technical team.
Deliver transactions not created in EBS - Totally 294 lines not created deliver records in EBS which are completed in WMS
Currently, TPI IT team are in call with vendor for further investigation.
We fixed initially 1 record, tested and it worked fine. Later fixed and tested for 4 records and confirmed all good.
Currently we are planning to fix remaining 289 records in bulk to have it processed - ETA ~ 1 hour.
For new receipt creation, we are not seeing this issue. However we are actively monitoring to see same issue won't occur.
We'll keep you posted once bulk update processing is complete.
Vendor has suggested to reprocess affected record from Oracle - TPI IT has initiated the same for 1 record and found its processing as BAU.
Currently TPI IT preparing bulk script for processing remaining affected records and will check with users if all have processed and no more issues observed.
P.S :- For new receipt creation, we are not seeing this issue. However we are actively monitoring to see same issue won't occur.
We'll keep you posted once bulk update processing is complete.Script for updating affected items in bulk has been completed and all has been corrected properly.
Currently no more items are in affected list.
Fix Done Yesterday Evening : We have updated EBS Receipt number in WMS which will help finance team for invoice processing. Also we have streamlined the receipt to putaway process.
P.S :- For new receipt creation, we are not seeing this issue. However we are actively monitoring to see same issue won't occur.
From today morning 10:30 AM IST hours onwards, laptops across all the regions are getting crashed and restarting for several users. For many of them, it's successfully getting restarted and able to continue operations and for some of them, it's failing to restart.
We're currently on the bridge call involving all the IT Teams across regions and cases have been raised with Microsoft Vendor Support Team to identify the root-cause and permanent fix.
As of now, Security Team confirmed that this is not any kind of malicious activity or a Cyber Attack.
We'll provide updates periodically. Thanks for your patience.
We've identified the root-cause of the problem.
Recent version update of the CrowdStrike sensors running on the Windows laptops caused this bluescreen error and loop restarts of the laptops. We're working on pushing a global updates on all the machines to uninstall the sensor.
Thanks for your patience.
We're still working on a fix for this issue. In the meanwhile, we strongly advise users to not turn on their laptops unless its production critical and really necessary for delivery standpoint.
This is a global issue and several organizations' across the globe are impacted. We'll send out communications when the issue is fixed so that you can use your laptops without any issues.
Incase, you're using your laptops, please contact your local IT Team to uninstall the CrowdStrike software in your machine immediately. Once uninstalled, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet.
Thanks for your patience. We will continue to send out periodic updates.
Security Team is still following up with CrowdStrike Vendor for permanent fix.
If you're using your laptops, please contact your local IT Team to uninstall the CrowdStrike software in your machine immediately. Once uninstalled, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet.
Thanks for your patience. We will continue to send out periodic updates.
IT team has been recovering laptops and PCs of affected users across the regions. As of 9:00 AM AZ time, many business critical user computers and leadership PCs are restored and the effort is ongoing in Mexico region.
If you're using laptop, please contact your local IT Team to restore your machine. Once recovered, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet.
This is a global issue impacting multiple organizations. A permanent fix is still being worked by Microsoft and Crowd strike.
Thanks for your patience and co-operation. Periodic updates will follow.
IT Team has restored majority of the impacted laptops and desktop computers in all regions. This enabled to continue regular operations and resume business activities.
Team has also reached out many users proactively and continued the restoring process. If you are one of the users (on-site or remote) who is still impacted, please reach out to your local IT support personal as mentioned in below list. Remote users will be supported over the phone and doesn't require to ship the laptop.
As of 2:00 PM AZ Time, all critical applications, including Oracle ERP, tpiOne, QMS are working normal.
Next update will follow on 07/20 9:00 AM AZ time.
IT Teams from each region restored laptops that are identified and reported. If you are one of the users (on-site or remote) who is still impacted, please reach out to your local IT support by calling their contact Phone number or messaging in teams, as mentioned in below list.
Regional IT teams are available to support over the weekend. Remote users will be supported over the phone and doesn't require to ship the laptop.