tag:8h86jzg9qy6r.statuspage.io,2005:/historyCrowdcast Status - Incident History2024-03-28T12:55:02-07:00Crowdcasttag:8h86jzg9qy6r.statuspage.io,2005:Incident/202179392024-03-11T12:08:14-07:002024-03-11T12:08:14-07:00Disrupted In-Browser Sessions<p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>12:08</var> PDT</small><br><strong>Resolved</strong> - We are happy to report that this was able to be resolved quickly. Please reach out to support@crowdcast.io with any questions or concerns.</p><p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>11:56</var> PDT</small><br><strong>Update</strong> - For those who need to go live now, please visit your channel settings. There is a toggle to try our new "Stage experience". Turning this on should allow you to go live in-browser.</p><p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>11:54</var> PDT</small><br><strong>Investigating</strong> - We're currently experiencing difficulties with in-browser (non-RTMP) events. Attendees viewing these events may report issues with viewing the stage. Our team is fully engaged and working diligently to resolve this issue as quickly as possible.<br /><br />We apologize for any inconvenience this may cause and appreciate your patience as we work to restore normal service. Stay tuned for further updates.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/200985852024-03-04T06:24:14-08:002024-03-04T06:24:14-08:00Restream integration is not operational<p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>06:24</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Feb <var data-var='date'>29</var>, <var data-var='time'>00:12</var> PST</small><br><strong>Update</strong> - We are working with Restream to resolve this issue.<br /><br />This does not affect your ability to multistream to Youtube, Facebook, or LinkedIn directly. Details of how to Multistream to LinkedIn: https://www.linkedin.com/help/linkedin/answer/a564446</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>11:30</var> PST</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>07:55</var> PST</small><br><strong>Investigating</strong> - It's currently not possible to use Restream with Crowdcast. We are talking with their team and investigating.<br />This does not affect the ability to directly multistream to Facebook or Youtube, or any other element of the platform</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/200361072024-02-21T05:11:30-08:002024-02-21T05:11:30-08:00Email sending delayed<p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>05:11</var> PST</small><br><strong>Resolved</strong> - We have moved to our back up email servers. Normal email service is resumed.</p><p><small>Feb <var data-var='date'>21</var>, <var data-var='time'>04:45</var> PST</small><br><strong>Update</strong> - Our provider is unable to bring their services back online so we are moving to our backup email services. An update will follow shortly</p><p><small>Feb <var data-var='date'>20</var>, <var data-var='time'>23:52</var> PST</small><br><strong>Identified</strong> - The service we use for attendee registration and reminder emails is down. https://resend-status.com/<br />They have identified the root cause, and are performing a fix. <br />This does NOT affect broadcasts going live or replays.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/197125372024-01-15T07:30:50-08:002024-01-15T07:30:50-08:00Live streams impacted due to upstream vendor<p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>07:30</var> PST</small><br><strong>Resolved</strong> - Crowdcast events can now go live, we are monitoring the situation</p><p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>07:26</var> PST</small><br><strong>Identified</strong> - Our upstream vendor has recognized the issue and is working to resolve the issue. Crowdcasts are currently unable to go live or record.</p><p><small>Jan <var data-var='date'>15</var>, <var data-var='time'>06:17</var> PST</small><br><strong>Investigating</strong> - Crowdcast in monitoring issues with an upstream vendor (Digital Ocean), which may impact broadcasts and/or recordings</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/193843002023-12-09T14:41:46-08:002023-12-09T14:42:00-08:00Live streams degregated due to upstream vendor<p><small>Dec <var data-var='date'> 9</var>, <var data-var='time'>14:41</var> PST</small><br><strong>Resolved</strong> - Cloudflare has resolved the issue. All systems on Crowdcast are back to normal.</p><p><small>Dec <var data-var='date'> 9</var>, <var data-var='time'>08:50</var> PST</small><br><strong>Monitoring</strong> - Cloudflare is investigating issues with network performance for a limited number of customers. They are working to analyse and mitigate this problem. More updates to follow shortly.<br />More details here: https://www.cloudflarestatus.com/incidents/g7mzk345g00z</p><p><small>Dec <var data-var='date'> 9</var>, <var data-var='time'>00:31</var> PST</small><br><strong>Investigating</strong> - A third party provider vendor is having a partial outage. This is impacting in-browser live video broadcast. Live sessions are experiencing degradation and buffering. We are investigating the issue.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/192085492023-12-04T01:00:07-08:002023-12-04T01:00:07-08:00Scheduled Maintenance<p><small>Dec <var data-var='date'> 4</var>, <var data-var='time'>01:00</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'> 3</var>, <var data-var='time'>23:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>24</var>, <var data-var='time'>00:18</var> PST</small><br><strong>Scheduled</strong> - We will be undergoing scheduled maintenance at 07:00 UTC on Monday 4 December. We expect to be fully operational within two hours. During this time you may see degraded performance across the platform. We recommend you do not go live during this maintenance period.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/190128942023-11-03T23:45:19-07:002023-11-04T03:53:49-07:00Upstream provider causing lagging in live events<p><small>Nov <var data-var='date'> 3</var>, <var data-var='time'>23:45</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved. For more information you can review the Post Mortem on Cloudflare Control Plane and Analytics Outage on their website: https://blog.cloudflare.com/post-mortem-on-cloudflare-control-plane-and-analytics-outage/</p><p><small>Nov <var data-var='date'> 3</var>, <var data-var='time'>12:56</var> PDT</small><br><strong>Update</strong> - We are continuing to monitor this issue.</p><p><small>Nov <var data-var='date'> 3</var>, <var data-var='time'>11:23</var> PDT</small><br><strong>Identified</strong> - We are experiencing an issue with a Cloudflare, which is our upstream provider. We are working with them to resolve the issue. You may experience lagging in your live event. Cloudflare status page: https://www.cloudflarestatus.com/</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/190002422023-11-02T10:00:18-07:002023-11-03T04:19:00-07:00Upstream provider causing lagging in live events<p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>10:00</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>08:01</var> PDT</small><br><strong>Update</strong> - We are seeing improvements from Cloudflare, but they are continuing to work on a fix for this issue</p><p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>06:49</var> PDT</small><br><strong>Monitoring</strong> - We are monitoring the situation. Event replays are not affected.</p><p><small>Nov <var data-var='date'> 2</var>, <var data-var='time'>06:40</var> PDT</small><br><strong>Identified</strong> - We are experiencing an issue with a Cloudflare, which is our upstream provider. We are working with them to resolve the issue. You may experience lagging in your live event.<br />Cloudflare status page: https://www.cloudflarestatus.com/</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/189253202023-10-25T10:34:05-07:002023-10-25T12:54:23-07:00Email Delivery Delays<p><small>Oct <var data-var='date'>25</var>, <var data-var='time'>10:34</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>25</var>, <var data-var='time'>09:08</var> PDT</small><br><strong>Identified</strong> - We have identified and are currently addressing a technical issue affecting event email deliveries.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/188287902023-10-17T09:59:15-07:002023-10-17T09:59:15-07:00Intermittent slowdown<p><small>Oct <var data-var='date'>17</var>, <var data-var='time'>09:59</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Oct <var data-var='date'>17</var>, <var data-var='time'>09:21</var> PDT</small><br><strong>Investigating</strong> - We've observed intermittent slowdown and lag that could potentially impact upcoming events. Our engineering team is actively investigating the issue. We're dedicated to identifying the root cause and implementing a resolution as swiftly as possible.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/188164092023-10-16T11:01:02-07:002023-10-16T11:01:02-07:00Incident Reported<p><small>Oct <var data-var='date'>16</var>, <var data-var='time'>11:01</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved. We will continue to monitor. Please reach out to support@crowdcast.io with any questions or concerns.</p><p><small>Oct <var data-var='date'>16</var>, <var data-var='time'>10:34</var> PDT</small><br><strong>Identified</strong> - A fix is being deployed now. We will post another update as soon as all site functions are operational.</p><p><small>Oct <var data-var='date'>16</var>, <var data-var='time'>10:17</var> PDT</small><br><strong>Investigating</strong> - We are aware that some users are currently experiencing issues on our site that may prevent them from going live and prevent attendees from registering for events. We understand the frustration this may cause and want to assure you that our team is working diligently to address these issues as quickly as possible. We are committed to restoring normal service as soon as possible, and we will keep you updated here on our progress.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/186275022023-09-27T19:17:14-07:002023-09-27T19:17:14-07:00Incident Reported<p><small>Sep <var data-var='date'>27</var>, <var data-var='time'>19:17</var> PDT</small><br><strong>Resolved</strong> - We are still investigating the root cause of the issue, but events are now able to go live as expected.</p><p><small>Sep <var data-var='date'>27</var>, <var data-var='time'>18:47</var> PDT</small><br><strong>Investigating</strong> - We are currently experiencing an incident which is affecting the ability to enter the greenroom and go live. We are actively investigating and will provide an update once we have more information.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/177255562023-06-29T19:41:54-07:002023-06-29T19:41:54-07:00v1 RTMP Studio temporarily unavailable<p><small>Jun <var data-var='date'>29</var>, <var data-var='time'>19:41</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jun <var data-var='date'>29</var>, <var data-var='time'>19:32</var> PDT</small><br><strong>Investigating</strong> - The RTMP Studio Engine is currently inoperable on Crowdcast v1. Our team is working to resolve the issue as soon as possible. We apologize for any inconvenience this may cause. Please stay tuned for updates on when the service will be fully operational again. Please note In-browser sessions are fully operational.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/175633542023-06-13T14:07:02-07:002023-06-13T14:07:02-07:00Service Disruption Notification<p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>14:07</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved. Thank you for your patience and understanding during this challenging time.</p><p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>13:42</var> PDT</small><br><strong>Monitoring</strong> - We are beginning to see a resolution to the issue. We are continuing to work towards full recovery.</p><p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>12:33</var> PDT</small><br><strong>Identified</strong> - We regret to inform you that our site is currently experiencing technical difficulties preventing access or going live. This disruption is due to an ongoing outage in the Amazon Web Services (AWS) infrastructure, which we rely on as a service provider.<br /><br />Our team is actively monitoring the situation and working diligently to restore normal operations as soon as possible. However, please note that the timeline for resolution is dependent on AWS resolving the underlying issues.<br /><br />We apologize for any inconvenience this may cause and understand the impact it may have on your experience. Rest assured that we are committed to keeping you updated throughout the restoration process. Please refer to this status page for the latest updates on our progress.<br /><br />Thank you for your patience and understanding during this challenging time. We appreciate your continued support and assure you that we are doing everything we can to address the issue swiftly.<br /><br />If you have any urgent inquiries or need assistance, please reach out to our customer support team at support@crowdcast.io. We will provide further updates as new information becomes available.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/175222412023-06-09T07:13:05-07:002023-06-09T07:13:05-07:00Equis Server Issue<p><small>Jun <var data-var='date'> 9</var>, <var data-var='time'>07:13</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jun <var data-var='date'> 9</var>, <var data-var='time'>05:43</var> PDT</small><br><strong>Identified</strong> - We're experiencing an issue with the servers that run v1 events. Broadcasts on v1 ONLY are affected, and sessions can not currently go live. We are investigating and will issue an update as soon as possible</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/175161422023-06-08T14:32:26-07:002023-06-08T14:32:26-07:00Email Delivery Issue for v2 Related Event Emails<p><small>Jun <var data-var='date'> 8</var>, <var data-var='time'>14:32</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jun <var data-var='date'> 8</var>, <var data-var='time'>14:04</var> PDT</small><br><strong>Identified</strong> - We are currently experiencing an issue with our email service provider, which is affecting the delivery of v2-related event emails. Event registrants may not receive important notifications and updates regarding v2 events, including registration confirmations and event reminders.<br /><br />Our technical team is actively investigating the issue and working closely with our email service provider to identify the root cause and implement a solution. We understand the importance of these emails and are dedicating all available resources to address this problem promptly. We apologize for the inconvenience caused. <br /><br />We will provide an update as soon as we have more information to share.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/168899252023-04-17T05:08:39-07:002023-04-17T05:08:39-07:00Recording & Streaming Servers - In Browser Sessions Issue<p><small>Apr <var data-var='date'>17</var>, <var data-var='time'>05:08</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Apr <var data-var='date'>17</var>, <var data-var='time'>05:08</var> PDT</small><br><strong>Update</strong> - This issue has been resolved.</p><p><small>Apr <var data-var='date'>17</var>, <var data-var='time'>04:46</var> PDT</small><br><strong>Investigating</strong> - We're experiencing issues that mean the ability to go live in-browser is affected.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/165132002023-03-15T17:44:30-07:002023-03-15T17:44:30-07:00v1 RTMP Studio is temporarily unavailable<p><small>Mar <var data-var='date'>15</var>, <var data-var='time'>17:44</var> PDT</small><br><strong>Resolved</strong> - v1 RTMP Studio is fully functional. Thank you for your patience. Please reach out to support@crowdcast.io with any questions.</p><p><small>Mar <var data-var='date'>15</var>, <var data-var='time'>11:52</var> PDT</small><br><strong>Update</strong> - We are continuing to work on a fix for this. Please note that ONLY RTMP Studio events are affected. In-browser sessions are fully operational.</p><p><small>Mar <var data-var='date'>15</var>, <var data-var='time'>08:53</var> PDT</small><br><strong>Identified</strong> - The RTMP Studio Engine is currently inoperable on Crowdcast v1. Our team is working to resolve the issue as soon as possible. We apologize for any inconvenience this may cause. Please stay tuned for updates on when the service will be fully operational again.<br />Please reach out to support@crowdcast.io for suggested workarounds.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/159230502023-01-24T09:45:55-08:002023-01-24T09:45:55-08:00Degraded Performance<p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>09:45</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>09:17</var> PST</small><br><strong>Identified</strong> - Fixes are being implemented. We will confirm when everything is working as expected.</p><p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>09:07</var> PST</small><br><strong>Investigating</strong> - We are experiencing intermittent degraded performance on Crowdcast due to an issue with a third-party service. We'll continue to work with them to get a resolution as soon as possible.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/144151282022-12-05T08:10:27-08:002022-12-05T08:10:27-08:00RTMP Issue<p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>08:10</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Dec <var data-var='date'> 5</var>, <var data-var='time'>06:27</var> PST</small><br><strong>Identified</strong> - We are aware of an issue with Wowza/RTMP Studio affecting a number of regions. Hosts going live using RTMP Studio may be affected. Developers are actively looking into this. We will update our status page as soon as this is resolved. <br />https://status.wowza.com/</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/108953042022-08-23T17:57:29-07:002022-08-24T06:19:23-07:00Heroku Outage Affecting Crowdcast Access<p><small>Aug <var data-var='date'>23</var>, <var data-var='time'>17:57</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved. Please reach out to support@crowdcast.io with any questions.</p><p><small>Aug <var data-var='date'>23</var>, <var data-var='time'>17:10</var> PDT</small><br><strong>Update</strong> - We are continuing to monitor for updates and will provide more information as soon as it's available.</p><p><small>Aug <var data-var='date'>23</var>, <var data-var='time'>16:30</var> PDT</small><br><strong>Update</strong> - Our upstream DNS provider, Heroku, is experiencing issues. Engineers are investigating. Many sites are affected. Note that only v1 events are currently affected on Crowdcast. In addition to our status page, you can keep up to date here: https://status.heroku.com/incidents/2453<br /><br />We'll provide an update as soon as possible.</p><p><small>Aug <var data-var='date'>23</var>, <var data-var='time'>16:26</var> PDT</small><br><strong>Update</strong> - We are continuing to investigate this issue.</p><p><small>Aug <var data-var='date'>23</var>, <var data-var='time'>16:25</var> PDT</small><br><strong>Investigating</strong> - We are currently investigating an issue affecting v1 hosts from going live. Please keep up to date here.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/108332932022-08-15T15:30:22-07:002022-08-15T15:30:22-07:00Crowdcast Incident<p><small>Aug <var data-var='date'>15</var>, <var data-var='time'>15:30</var> PDT</small><br><strong>Resolved</strong> - Our engineering team was able to respond quickly and implement a fix. Crowdcast v1 is now working as expected. Thank you for your patience while we worked to resolve this.</p><p><small>Aug <var data-var='date'>15</var>, <var data-var='time'>15:22</var> PDT</small><br><strong>Update</strong> - We are continuing to investigate this issue. If you are a v2 host, you can access your event by navigating directly to your event URL or channel. This incident only affects Crowdcast v1.</p><p><small>Aug <var data-var='date'>15</var>, <var data-var='time'>15:11</var> PDT</small><br><strong>Investigating</strong> - We are currently investigating an issue that is affecting access to Crowdcast v1. We will provide an update here as soon as one is available.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/103673152022-06-20T23:30:00-07:002022-06-21T00:44:37-07:00Cloudflare outage<p><small>Jun <var data-var='date'>20</var>, <var data-var='time'>23:30</var> PDT</small><br><strong>Resolved</strong> - Our third-party provider, Cloudflare, had an issue affecting some live broadcasts and recordings.<br /><br />This outage lasted approximately 50 minutes and is now resolved.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/97350262022-04-07T17:06:09-07:002022-04-07T17:06:09-07:00Incident Reported<p><small>Apr <var data-var='date'> 7</var>, <var data-var='time'>17:06</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Apr <var data-var='date'> 7</var>, <var data-var='time'>17:02</var> PDT</small><br><strong>Investigating</strong> - We are investigating reports that Crowdcast is inaccessible. We are actively looking into this and will follow up here as soon as possible.</p>tag:8h86jzg9qy6r.statuspage.io,2005:Incident/97241982022-04-06T09:30:00-07:002022-04-06T11:56:31-07:00Temporary Disruption<p><small>Apr <var data-var='date'> 6</var>, <var data-var='time'>09:30</var> PDT</small><br><strong>Resolved</strong> - We've added an extra layer of security to our servers which unintentionally blocked some events from going live. We quickly reversed our adjustments to repair the issue. The incident lasted no more than 15 minutes.</p>