tag:status.groupbycloud.com,2005:/historyGroupBy Status - Incident History2024-03-28T14:39:45-04:00GroupBytag:status.groupbycloud.com,2005:Incident/203016782024-03-19T11:43:41-04:002024-03-19T11:43:41-04:00SR-US-E Cluster - Service Degradation<p><small>Mar <var data-var='date'>19</var>, <var data-var='time'>11:43</var> EDT</small><br><strong>Resolved</strong> - Please be informed that the issue affecting the cluster SR-US-E has been successfully resolved, and all services are now operational.</p><p><small>Mar <var data-var='date'>19</var>, <var data-var='time'>10:22</var> EDT</small><br><strong>Investigating</strong> - GroupBy is currently experiencing degraded service for customers hosted on cluster SR-US-E. The GroupBy Engineering teams are actively addressing the degradation, and we will provide regular updates as we investigate and work to resolve it.<br /><br />If there any further questions, please feel free to reach to us at support@groupbyinc.com.</p>tag:status.groupbycloud.com,2005:Incident/198785062024-02-02T12:20:01-05:002024-02-02T12:20:01-05:00Service Degradation - Google Cloud Retail<p><small>Feb <var data-var='date'> 2</var>, <var data-var='time'>12:20</var> EST</small><br><strong>Resolved</strong> - Please be advised that the issue with Search API is resolved and the service is back to normal.</p><p><small>Jan <var data-var='date'>31</var>, <var data-var='time'>14:23</var> EST</small><br><strong>Investigating</strong> - Please be advised that GroupBy is currently experiencing intermittent latency issues with our Search API powered by Google Cloud Retail. GroupBy is currently working on this issue and will continue to provide updates as we gather additional information.</p>tag:status.groupbycloud.com,2005:Incident/189939362023-11-07T09:54:43-05:002023-11-07T09:54:43-05:00SSL Certificate Update<p><small>Nov <var data-var='date'> 7</var>, <var data-var='time'>09:54</var> EST</small><br><strong>Resolved</strong> - Please be advised that the SSL certificate update has completed successfully.</p><p><small>Nov <var data-var='date'> 1</var>, <var data-var='time'>18:09</var> EDT</small><br><strong>Investigating</strong> - Please be advised that our infrastructure team will be updating the SSL certificate to our endpoint starting at 3:00 AM EST on 7th November. We anticipate this update to be completed within 30 minutes. We expect all services to be fully-functional throughout the deployment process.<br /><br />If you have any questions regarding this maintenance, please send an email to support@groupbyinc.com.</p>tag:status.groupbycloud.com,2005:Incident/168264492023-04-12T13:47:00-04:002023-04-12T13:47:00-04:00SFTP Migration<p><small>Apr <var data-var='date'>12</var>, <var data-var='time'>13:47</var> EDT</small><br><strong>Completed</strong> - Please be advised that the SFTP migration is completed.</p><p><small>Apr <var data-var='date'>12</var>, <var data-var='time'>13:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Apr <var data-var='date'>11</var>, <var data-var='time'>15:26</var> EDT</small><br><strong>Scheduled</strong> - Please be advised that on April 12, 2023, GroupBy will be performing an upgrade to our SFTP infrastructure starting at 1PM EST. We expect this work to be completed within 1 hour. All services will be operational during the upgrade and there are no plans for downtime while this work is being executed. Once the upgrade is completed, a server connecting to GroupBy's FTP endpoint may be prompted with a warning that the client Host-key has changed when attempting to connect. If so the host-key change needs to be accepted and saved.<br /><br />If there are any questions regarding this migration, please send an email to support@groupbyinc.com.</p>tag:status.groupbycloud.com,2005:Incident/166999092023-03-31T09:38:50-04:002023-03-31T09:38:50-04:00Service Degradation - Search API<p><small>Mar <var data-var='date'>31</var>, <var data-var='time'>09:38</var> EDT</small><br><strong>Resolved</strong> - Please be advised that the issue with Search API is resolved and the service is back to normal.</p><p><small>Mar <var data-var='date'>30</var>, <var data-var='time'>16:40</var> EDT</small><br><strong>Identified</strong> - Please be advised that the issue has been identified and our team is working towards resolving it.</p><p><small>Mar <var data-var='date'>30</var>, <var data-var='time'>13:18</var> EDT</small><br><strong>Investigating</strong> - GroupBy is currently experiencing a service degradation with our Search API. The specific issue being observed is that in-engine metric attributes productConversion and clickBoost are not being populated on product records. This issue is only impacting customers who actively use these attributes for Biasing Profiles and Sorting in both Search and Browse requests. <br /><br />GroupBy is currently investigating this issue, and will provide updates as the investigation proceeds.</p>tag:status.groupbycloud.com,2005:Incident/164041062023-03-09T16:35:32-05:002023-03-09T16:35:32-05:00Service Degradation - Powered by Google Cloud Retail<p><small>Mar <var data-var='date'> 9</var>, <var data-var='time'>16:35</var> EST</small><br><strong>Resolved</strong> - The issue with Search API powered by Google Cloud Retail has been resolved and all services are back to normal.</p><p><small>Mar <var data-var='date'> 9</var>, <var data-var='time'>12:42</var> EST</small><br><strong>Investigating</strong> - Please be advised that GroupBy is currently experiencing degraded performance with our Search API powered by Google Cloud Retail. The issue is intermittent in nature and is occurring for only specific type of requests. If you are a customer that is not using this version of the Search API, you are not impacted. GroupBy is currently working on this issue along with our partners at Google and will continue to provide updates as we gather additional information.</p>tag:status.groupbycloud.com,2005:Incident/161820252023-02-17T22:47:30-05:002023-02-17T22:47:30-05:00Service Degradation - Powered by Google Cloud Retail<p><small>Feb <var data-var='date'>17</var>, <var data-var='time'>22:47</var> EST</small><br><strong>Resolved</strong> - Please be advised that the issue with Search API powered by Google Cloud Retail has been resolved and all services are back to normal.</p><p><small>Feb <var data-var='date'>17</var>, <var data-var='time'>22:15</var> EST</small><br><strong>Identified</strong> - Please be advised that the root cause has been identified by Google and are working on the mitigation process. We will continue to provide updates as more information becomes available.</p><p><small>Feb <var data-var='date'>17</var>, <var data-var='time'>16:31</var> EST</small><br><strong>Investigating</strong> - Please be advised that GroupBy is currently experiencing degraded performance with our Search API powered by Google Cloud Retail. If you are a customer that is not using this version of the Search API, you are not impacted. GroupBy is currently working on this issue along with our partners at Google and will continue to provide updates as we gather additional information.</p>tag:status.groupbycloud.com,2005:Incident/158639782023-01-18T00:27:03-05:002023-01-18T00:27:03-05:00Service Degradation - Beacons API<p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>00:27</var> EST</small><br><strong>Resolved</strong> - Please be advised that the issue with Beacons API has been resolved and the services are back to normal.</p><p><small>Jan <var data-var='date'>17</var>, <var data-var='time'>11:32</var> EST</small><br><strong>Investigating</strong> - GroupBy is currently experiencing a service degradation with our Beacons API. GroupBy is investigating the issue, and will provide updates as we work through a resolution</p>tag:status.groupbycloud.com,2005:Incident/158637482023-01-18T00:26:30-05:002023-01-18T00:26:30-05:00Service Degradation - Recommendations API<p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>00:26</var> EST</small><br><strong>Resolved</strong> - Please be advised that the issue with Recommendation API has been resolved and the services are back to normal.</p><p><small>Jan <var data-var='date'>17</var>, <var data-var='time'>11:06</var> EST</small><br><strong>Investigating</strong> - GroupBy is currently experiencing a service degradation with our Recommendations API. GroupBy is investigating the issue, and will provide updates as we work through a resolution.</p>tag:status.groupbycloud.com,2005:Incident/158552292023-01-17T07:00:44-05:002023-01-17T07:00:44-05:00Service Cluster Update<p><small>Jan <var data-var='date'>17</var>, <var data-var='time'>07:00</var> EST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>17</var>, <var data-var='time'>01:00</var> EST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>16</var>, <var data-var='time'>10:40</var> EST</small><br><strong>Scheduled</strong> - Please be advised that GroupBy will be performing maintenance work to our service clusters starting Jan 17 at 1AM EST. We expect this work to last approximately 6 hours. All services will be operational during this maintenance work, and there are no plans for downtime while this work is being executed.</p>tag:status.groupbycloud.com,2005:Incident/158563612023-01-16T15:31:15-05:002023-01-16T15:31:15-05:00Beacons API - Service Degradation<p><small>Jan <var data-var='date'>16</var>, <var data-var='time'>15:31</var> EST</small><br><strong>Resolved</strong> - Please be advised that the issue with Beacons API has been resolved and the services are back to normal.</p><p><small>Jan <var data-var='date'>16</var>, <var data-var='time'>13:51</var> EST</small><br><strong>Investigating</strong> - GroupBy is currently experience a service degradation with our Beacons API. This is impacting select customers, and the impact is that there is a delay in Analytics being updated within Command Center. GroupBy is investigating the issue, and will provide updates as we work through a resolution.</p>tag:status.groupbycloud.com,2005:Incident/158385632023-01-16T07:00:30-05:002023-01-16T07:00:30-05:00Service Cluster Update<p><small>Jan <var data-var='date'>16</var>, <var data-var='time'>07:00</var> EST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>16</var>, <var data-var='time'>01:00</var> EST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>13</var>, <var data-var='time'>14:35</var> EST</small><br><strong>Scheduled</strong> - Please be advised that GroupBy will be performing maintenance work to all our service clusters starting Jan 16 at 1AM EST. We expect this work to last approximately 6 hours. All services will be operational during this maintenance work, and there are no plans for downtime while this work is being executed.</p>tag:status.groupbycloud.com,2005:Incident/158117182023-01-10T16:00:44-05:002023-01-10T16:00:44-05:00Scheduled Maintenance For Service Cluster<p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>16:00</var> EST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>14:02</var> EST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>11:02</var> EST</small><br><strong>Scheduled</strong> - Please be advised that GroupBy will be conducting standard maintenance for one its service cluster at 2PM EST today. The maintenance should not cause any impact to our services and is expected to complete within couple of hours. <br /><br />If you have any questions regarding this maintenance, please send an email to support@groupbyinc.com.</p>tag:status.groupbycloud.com,2005:Incident/158041602023-01-09T15:22:23-05:002023-01-09T15:22:23-05:00Service Degradation<p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>15:22</var> EST</small><br><strong>Resolved</strong> - Please be advised that the issue with the cluster is resolved and all services are back to normal.</p><p><small>Jan <var data-var='date'> 9</var>, <var data-var='time'>12:53</var> EST</small><br><strong>Investigating</strong> - Please be advised, Groupby is currently experiencing service degradation for one of our clusters. Our team is working on it and we will continue to provide updates as we further investigate the issue.</p>tag:status.groupbycloud.com,2005:Incident/126019042022-10-25T05:00:40-04:002022-10-25T05:00:40-04:00SSL Certificate Update<p><small>Oct <var data-var='date'>25</var>, <var data-var='time'>05:00</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'>25</var>, <var data-var='time'>03:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'>24</var>, <var data-var='time'>12:15</var> EDT</small><br><strong>Scheduled</strong> - Please be advised, our infrastructure team will be updating the SSL certificate to our web servers starting at 3:00 AM EST on 25th October. We expect all services to be fully-functional throughout the deployment process and anticipate this update to be completed within 2 hours.</p>tag:status.groupbycloud.com,2005:Incident/112902392022-09-28T06:30:43-04:002022-09-28T06:30:43-04:00Scheduled Update: Search API and Command Center API<p><small>Sep <var data-var='date'>28</var>, <var data-var='time'>06:30</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Sep <var data-var='date'>28</var>, <var data-var='time'>04:30</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Sep <var data-var='date'>27</var>, <var data-var='time'>16:12</var> EDT</small><br><strong>Scheduled</strong> - Please be advised, our infrastructure team will be deploying an update to our web servers starting at 4:30 AM EST on 28th September. We expect all services to be fully-functional throughout the deployment process and anticipate this update to be completed within 2 hours.</p>tag:status.groupbycloud.com,2005:Incident/108558372022-08-19T01:01:02-04:002022-08-19T01:01:02-04:00Scheduled Update: Search API and Command Center API<p><small>Aug <var data-var='date'>19</var>, <var data-var='time'>01:01</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Aug <var data-var='date'>18</var>, <var data-var='time'>22:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Aug <var data-var='date'>18</var>, <var data-var='time'>16:34</var> EDT</small><br><strong>Scheduled</strong> - Please be advised, our infrastructure team will be deploying an update to the Search API and Command Center services starting tonight at 10PM EST. We expect these services to be fully-functional throughout the deployment process. We anticipate this update to be completed within 3 hours.</p>tag:status.groupbycloud.com,2005:Incident/99841982022-05-16T07:00:41-04:002022-05-16T07:00:41-04:00Groupby Scheduled Maintenance<p><small>May <var data-var='date'>16</var>, <var data-var='time'>07:00</var> EDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>May <var data-var='date'>16</var>, <var data-var='time'>04:00</var> EDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>May <var data-var='date'>13</var>, <var data-var='time'>10:30</var> EDT</small><br><strong>Scheduled</strong> - On May 16th, between 4 AM and 7 AM EST, GroupBy will be conducting standard maintenance to all of its services. This maintenance will focus on updating all needed SSL certifications. This work is not expected to disrupt any services during this time period.<br /><br />If you have any questions regarding this maintenance, please send an email to support@groupbyinc.com.<br /><br />Thank you.<br /><br />GroupBy Support Team</p>tag:status.groupbycloud.com,2005:Incident/98065862022-04-19T10:50:01-04:002022-04-19T10:50:01-04:00Scheduled Update: Search API and Command Center API<p><small>Apr <var data-var='date'>19</var>, <var data-var='time'>10:50</var> EDT</small><br><strong>Resolved</strong> - Please be advised the deployment finished successfully.</p><p><small>Apr <var data-var='date'>18</var>, <var data-var='time'>16:16</var> EDT</small><br><strong>Investigating</strong> - Please be advised, our infrastructure team will be deploying an update to the Search API and Command Center services starting tonight at 10PM EST. We expect these services to be fully-functional throughout the deployment process. We anticipate this update to be completed within 2 hours.<br /><br />Another notification will be sent out once the update has been completed.</p>tag:status.groupbycloud.com,2005:Incident/97888982022-04-15T10:39:05-04:002022-04-15T10:39:05-04:00Degraded Performance with Search API<p><small>Apr <var data-var='date'>15</var>, <var data-var='time'>10:39</var> EDT</small><br><strong>Resolved</strong> - We believe we have identified and resolved the issue contributing to the spike in 401 errors. We continue to monitor our systems to ensure the issue is fully resolved.</p><p><small>Apr <var data-var='date'>15</var>, <var data-var='time'>10:30</var> EDT</small><br><strong>Investigating</strong> - GroupBy is currently degraded performance in one of our service clusters to the Search API resulting in an increase in 401 errors. We are investigating the issue and will provide updates as we have more information.</p>tag:status.groupbycloud.com,2005:Incident/97146802022-04-06T10:38:19-04:002022-04-06T10:38:19-04:00Minor System Update<p><small>Apr <var data-var='date'> 6</var>, <var data-var='time'>10:38</var> EDT</small><br><strong>Resolved</strong> - Please be advised the update ran successfully and was completed at 10:30PM.</p><p><small>Apr <var data-var='date'> 5</var>, <var data-var='time'>12:41</var> EDT</small><br><strong>Investigating</strong> - Please be advised, our infrastructure team will be making a minor feature update on our infrastructure starting tonight at 10PM. The update should not cause any impact to our services and is expected to be completed within an hour.<br />Another notification will be sent out once the update has been completed.</p>tag:status.groupbycloud.com,2005:Incident/95750262022-03-18T14:21:29-04:002022-03-18T14:21:29-04:00Minor System Update<p><small>Mar <var data-var='date'>18</var>, <var data-var='time'>14:21</var> EDT</small><br><strong>Resolved</strong> - Please be advised, the update is completed.</p><p><small>Mar <var data-var='date'>18</var>, <var data-var='time'>11:00</var> EDT</small><br><strong>Investigating</strong> - Please be advised, our infrastructure team will be making a minor feature update on our infrastructure that will be in progress throughout the day. The update should not cause any impact to our services and is expected to be completed by the end of the day.<br />Another notification will be sent out once the update has been completed.</p>tag:status.groupbycloud.com,2005:Incident/88657212021-12-16T13:26:49-05:002021-12-16T13:26:49-05:00SR-US-E1 Service Degradation<p><small>Dec <var data-var='date'>16</var>, <var data-var='time'>13:26</var> EST</small><br><strong>Resolved</strong> - Please be advised that the issue with the cluster has been resolved and the service is back to normal.</p><p><small>Dec <var data-var='date'>16</var>, <var data-var='time'>10:00</var> EST</small><br><strong>Investigating</strong> - We are currently experiencing service degradation for the clusters SR-US-E1. Our team is working on it and we will continue to provide updates as we further investigate the issue.</p>tag:status.groupbycloud.com,2005:Incident/88640862021-12-16T07:55:50-05:002021-12-16T07:55:50-05:00SR-US-E1 Outage<p><small>Dec <var data-var='date'>16</var>, <var data-var='time'>07:55</var> EST</small><br><strong>Resolved</strong> - Please be advised that the issue with the SR-US-E1 cluster has been resolved and the services are available now. GroupBy will follow up with an RCA on the incident.</p><p><small>Dec <var data-var='date'>16</var>, <var data-var='time'>06:39</var> EST</small><br><strong>Investigating</strong> - GroupBy is currently experiencing a system disruption which is impacting the SR-US-E1 cluster and the customers on it. We will provide updates as we investigate the problem.</p>tag:status.groupbycloud.com,2005:Incident/86052872021-11-19T11:24:07-05:002021-11-19T11:24:07-05:00Service Degradation<p><small>Nov <var data-var='date'>19</var>, <var data-var='time'>11:24</var> EST</small><br><strong>Resolved</strong> - Our team has identified and resolved the issue that was affecting the service. The service is running normally now and we are continuing to monitor the situation.</p><p><small>Nov <var data-var='date'>19</var>, <var data-var='time'>10:54</var> EST</small><br><strong>Investigating</strong> - We are currently experiencing service degradation for one of our clusters. Our team is working on it and we will continue to provide updates as we further investigate the issue.</p>