Good news! We are updating our web and file servers to provide a much better user experience at PhotoUp. Project details are below along with a real-time actively log of our progress.
Thank you for your patience as we make big improvements to our infrastructure. As always, please contact support@photoup.net if you have questions.
Project Timeline
PhotoUp’s development team is currently in the middle of a two-week server upgrade period schedule from Sunday, June 28th until Sunday, July 12th. It is our team’s highest priority to ensure as little server downtime as possible.
Server Upgrades
During this server maintenance period we are scheduled to make the following upgrades to our platform:
– Faster servers to accommodate growing application load and user traffic
– Replication of databases in multiple locations for improved speed and redundancy
– Updates to our file servers for more redundancy across server regions
– Migration of all user files to Amazon S3 file system for faster file access outside of the USA
– Adding server job queueing and on-demand servers for future scalability
– Setting up the platform to accommodate future servers in Australia, Asia, and Europe
Server Down Time
Please note that due to the nature of the server upgrades there will be some intermittent server downtime during this period. As much as it is possible, we will give our users as much lead time as possible about scheduled outage times and will post scheduled outage times at the top of all client dashboard pages.
On occasion, we may experience unexpected outages. Our development team is monitoring our servers 24/7 during this period and will have servers back online typically within 15-20 minutes in these cases but 60 minutes maximum depending on the issue.
Support & Alternative Upload/Download Options
Additionally, we will be using DropBox as a backup upload and download solution during this period. Our support team is also working extra hours to assist during this time. As always, should you have any questions or support related needs, please email support@photoup.net for the fastest response times.
DAILY ACTIVITY LOG
Please check the section below for daily status updates and progress on server maintenance and upgrades:
WEDNESDAY, JULY 1ST, 2015 (USA EST TIME)
Update – 3:30 pm USA EST time: Started migration of all legacy user files to new file servers. Estimated time to completion is 10 hours. Clients are good to upload new batches to PhotoUp but will not be able to download photos uploaded before 11:02 am USA EST time today from the system until this migration is complete. Clients will be able to download all newly uploaded batches immediately moving forward.
All photo batches uploaded before 11:02 am USA EST time will be available to download via dropbox links, contact support@photoup.net if you need an update on your batches or the download links.
Update – 1:20 pm USA EST time: All web servers stopped for upgrades according to schedule maintenance window. All web server upgrades completed and successfully re-launched all web servers at 1:40pm USA EST time. All active user uploads will require re-upload. New servers are now stable and with greatly increased load capacity.
Update – 11:02 am USA EST time: Duplication of virtual file server volumes completed. Two new dedicated file server instances successfully brought online. Application and internal system files successfully migrated to new dedicated file servers.
Update: At 8:36am USA EST time our servers went down due to a file server maintenance related issue. Service was restored at 8:44 am USA EST time. Other than several failed uploads, no user data was affected.
Notice: We will be shutting the servers down at 12 pm USA EST time today (in 3 hours and 10 minutes) for several hours of maintenance which should fix these problems. Please upload any photos for editing to Dropbox via the links emailed to all clients today. Additionally, all clients can also download all completed photos from today from this same Dropbox folder. If you have questions, please email support@photoup.net.
Update – 3:05 am USA EST time: Servers went down due to a file server maintenance related issue. Service was restored at 3:17 am USA EST time. Other than several failed uploads, no user data was affected. Once again, fix coming later today during the scheduled maintenance period.
Update – 1:29 am USA EST time: Servers went down due to a file server maintenance related issue. Service was restored at 1:43 am USA EST time. Other than several failed uploads, no user data was affected. Our scheduled server maintained tonight should stabilize our file system.
TUESDAY, June 30TH, 2015 (USA EST TIME)
Update – 10:31 pm USA EST time: Servers went down due to high user traffic. Service was restored at 11:08 pm USA EST time. Other than several failed upload, no user data was affected. Our planned update tomorrow afternoon should prevent future crashes related to high user traffic.
Update – 7:42 pm USA EST time: Servers went down due to a file server maintenance related issue. Service was restored at 8:47 pm USA EST time. Other than several failed uploads, no user data was affected.
