Today I will see what is faster: Magento CE 1.9 or Magento CE 2.1. I was inspired by this StackExchange question and by the Amasty team benchmark. Amasty compared Magento 184.108.40.206 vs Magento 2.0.0. They found out that 1.9 is faster than 2.0. Now it is 2017 and Magento 2.1.4 and 220.127.116.11 just came out so I decided to see if 1.9 still beats 2.1.
Disclaimer: I will be comparing Community Editions (CE). I am aware that Magento released the official Magento 2.0 Site Performance and Scalability Optimizations white paper where they show Magento Enterprise Edition (EE) 1.14.2 is slower than Magento EE 2.0. We will be talking about CE here.I don't want to wait show me results now!
My setup is simple and could be replicated by others. I will use Amazon AWS EC2 instance that I setup in this guide. Here is the details:
- Debian 8
- Mysql 5.6.35
- PHP-FPM 7.0.15
- Nginx 1.10.3
- c3.large instance
- AMI debian-jessie-amd64-hvm-2017-01-15-1221-ebs (ami-94bdeef4)
The settings that I will use for Magento 2.1:
- Production Mode
- Theme - Luma
- Merge CSS files - Yes
- Minify CSS files - Yes
The settings for Magento 18.104.22.168:
- Default install with Sample data 22.214.171.124
- Theme: rwd/default
- All cache enabled
- Flat Catalog enabled for products and categories
I will be using JMeter as load testing software. Scenario as follows: 50 concurrent users with ramp-up period of 10 seconds repeating 20 times. That comes down to 1000 requests. I will be using Mac Numbers 2D-Line chart so it will be linear extrapolation of CSV load test data.
I will be testing homepage, cart page with no items and customer login page. I won't be testing product/category pages as they might be subject to theme or data difference.
NO Full Page Cache
First we will test with Magento 2.1 Full Page Cache (FPC) off. I want to make 1.9 and 2.1 even because Magento CE 1.9.x doesn't have FPC by default.
Magento 1.9 is obviously faster. Here is some numbers:
2. Cart Page
Yes Full Page Cache
No we will turn on Magento 2.1.4 FPC and will install the free Zoom FPC for Magento 126.96.36.199.
Zoom FPC is an abandoned project but with a little magic you can make it work with 1.9.
For 2.1.4 I will be using built-in FPC:
I will be using built-in FPC as I have shown here there is hardly a difference between Varnish/built-in/Redis FPC.
We see that Magento 1.9 with FPC beats Magento 2.1.4 FPC easily. Does it true for cart page? Let's see.
2. Cart Page
3. Customer login page
Magento 188.8.131.52 beats Magento 2.1.4 with either FPC on or off. For Magento 1.9 FPC I was using this excellent free extension Zoom FPC.
Do you have a different benchmark results? Share it comments!
If you find this post interesting do not hesitate to sign up for our newsletter and join the 650 people who receive Magento news, tips and tricks regularly.