From today morning 10:30 AM IST hours onwards, laptops across all the regions are getting crashed and restarting for several users. For many of them, it's successfully getting restarted and able to continue operations and for some of them, it's failing to restart.

We're currently on the bridge call involving all the IT Teams across regions and cases have been raised with Microsoft Vendor Support Team to identify the root-cause and permanent fix.

As of now, Security Team confirmed that this is not any kind of malicious activity or a Cyber Attack.

We'll provide updates periodically. Thanks for your patience. 

We've identified the root-cause of the problem.

Recent version update of the CrowdStrike sensors running on the Windows laptops caused this bluescreen error and loop restarts of the laptops. We're working on pushing a global updates on all the machines to uninstall the sensor. 

Thanks for your patience. 

We're still working on a fix for this issue. In the meanwhile, we strongly advise users to not turn on their laptops unless its production critical and really necessary for delivery standpoint.

This is a global issue and several organizations' across the globe are impacted. We'll send out communications when the issue is fixed so that you can use your laptops without any issues.

Incase, you're using your laptops, please contact your local IT Team to uninstall the CrowdStrike software in your machine immediately. Once uninstalled, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet. 

Thanks for your patience. We will continue to send out periodic updates.

Security Team is still following up with CrowdStrike Vendor for permanent fix. 

If you're using your laptops, please contact your local IT Team to uninstall the CrowdStrike software in your machine immediately. Once uninstalled, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet. 

Thanks for your patience. We will continue to send out periodic updates.

IT team has been recovering laptops and PCs of affected users across the regions. As of 9:00 AM AZ time, many business critical user computers and leadership PCs are restored and the effort is ongoing in Mexico region. 

If you're using laptop, please contact your local IT Team to restore your machine. Once recovered, kindly refrain from accessing any unwanted sites and avoid downloading any content from the internet. 

This is a global issue impacting multiple organizations. A permanent fix is still being worked by Microsoft and Crowd strike.

Thanks for your patience and co-operation. Periodic updates will follow.

IT Team has restored majority of the impacted laptops and desktop computers in all regions. This enabled to continue regular operations and resume business activities.

Team has also reached out many users proactively and continued the restoring process. If you are one of the users (on-site or remote) who is still impacted, please reach out to your local IT support personal as mentioned in below list. Remote users will be supported over the phone and doesn't require to ship the laptop. 

As of 2:00 PM AZ Time, all critical applications, including Oracle ERP, tpiOne, QMS are working normal. 

Next update will follow on 07/20 9:00 AM AZ time. 

IT Teams from each region restored laptops that are identified and reported. If you are one of the users (on-site or remote) who is still impacted, please reach out to your local IT support by calling their contact Phone number or messaging in teams, as mentioned in below list. 

Regional IT teams are available to support over the weekend. Remote users will be supported over the phone and doesn't require to ship the laptop. 

Update from Technical Team -  To improve on the performance related issues  - our support team will have to apply some updates to the QMS Database, for which we will be planning an OUTAGE of 2 hours today.  We are awaiting necessary approvals from TPI leadership since this is Global incident. Please co-operate and be patient until we resolve this issue !!! ***  We will keep the entire team informed about the timings of OUTAGE

Completed Schedule outage and applied relevant fixes and the issue has been resolved.

GÜNCELLEME / UPDATE:

TK1 kesintisi 15 dakika içinde başlıyor olacak. Bilgilerinize.

TK1 outage will be starting in 15 minutes. FYI.

-----------------------------------------------

Merhabalar,

TK1  Sunucu ve Network  altyapımızda yapılacak iyileştirme çalışmamızdan dolayı 13 Mart Pazar günü saat 08:30 ile 12:30 arasında network ( sunucu )  ve internet erişimi olmayacaktır. Aşağıda belirtilen sistemler etkilenecektir.

Çalışmalarınızı bu plan doğrultusunda düzenlemenizi rica ederiz. Bilgilerinize.

• Fabrika dışından TK1 lokasyonuna VPN bağlantısı (VPN Connection) gerçekleştirilemeyecek,
• File server ( File Server sharings ) üzerindeki ortak klasör ve dosyalara erişilemeyecek,
• Tüm CCTV Kamera ( CCTV Camera System ) sistemi (Belirtilen saatlerde Kayıt almayacak),
• Laboratuar da kullanılan TG ( LabTG System )  test sistemi çalışmayacak
• Kumaşhane ( Glass-Kitting – Server Sharing ) için gerekli olabilecek Server erişimi olmayacak
• WiFi ağı erişimi olmayacak ( Wifi and Cabling System )
• Enibra Personel Sistemi erişimi olmayacak ( Enibra System )
• Oracle EBS, QMS sistemlerine erişim olmayacak

Dear all,

A planned IT infrastructure installation will be held on 13^th of March, Sunday. Between the time 08:30 AM and 12:30 PM – approx. 4 hours, the access to network ( servers ) and to internet will not be available.

Please be informed.

Installation of TK1 New UPS Device.

A planned IT infrastructure installation will be held on 13^th of March, Sunday (Turkey Time).

Between the time 08:30 AM and 12:30 PM – approx. 4 hours, the access to network ( servers ) and to internet will not be available.

Completed without any issue.

There will be service disruption including all active devices at TK1 due to Electrical Maintenance.

It will start at 11PM (MST) Sunday night

It will last approximately 10hrs. 

Maintenance completed in 8hrs.

All active devices are back online.

Power Generator issues addressed.

Digital Guardian agent installation will be tested, previous installation caused issues with Server. Had to be uninstalled.

Tests will be done on 15:00 GMT+3 (06:00MST) for one hour.

If not successful changes will be removed.

When DG installed, our HR application (ENIBRA) fails to start. 

Issue could not be resolved. Required escalation on Digital Guardian side.

DG agent removed again, and HR application is back online.

Additional support is required from ENIBRA vendor and Digital Guardian on a future date.

Major issues: 

1- Not enough Digital Guardian Server licenses available. Had to remove license from one server to allow this one to acquire the license.

2- We do not have a Test server. We work on Production Server. Need to create a test environment for further testing. 

Additionally: ENIBRA server will be unavailable during the same period.

UPDATE: Additionally Enibra server will be unavailable

Planned outage (Due to BackBone Swtich Replacement) will occur at TK2.

Site wide Network Infrastructure, Servers and Services will be unavailable for 7hrs.

Start on Feb 21st Sunday at 09:59 GMT+3 (Feb 20th Saturday at 23:59 MST)

Complete at Feb 21st Sunday 17:00 GMT+3 (Feb 21st Sunday at 07:00 MST)

Planned maintenance and backbone replacement completed as planned with 10 min delay.

Old Backbone Switch Replacement.