Cypress is one of the options when it comes to end-to-end (E2E) testing. Cypress is an all-in-one testing framework focused on E2E testing, meaning that you don’t have to install 10 different things to get your test suite set up. You can write your first passing test in minutes without any configuration with the help of Cypress’ API, which is easy to read and understand. It runs tests as fast as your browser can render content, which also makes test-driven development possible. You’ll also profit from the time travel feature or the extensive debugging capabilities with Chrome DevTools. You can also use it with Gatsby, and this guide will explain how.
To run Gatsby’s development server and Cypress at the same time, you’ll use the little helper start-server-and-test. If you’re already using @testing-library/react for unit testing, you might want to install @testing-library/cypress, too. This way you can use the same methods you used with
@testing-library/react in your Cypress tests. Install the following packages to your
You need to create a config file for Cypress at the root of the project called
cypress.config.js. You can use it to preface the URLs used by
cy.request as well as set the folder the tests are in by adding the following:
You also need to add additional scripts to your
package.json to run Cypress:
npm run test:e2e in your command line and see Cypress running for the first time. A folder named
cypress will be created at the root of your project and a new application window will pop up. Cypress’ getting started guide is a good start to learn how to write tests!
Please note: If you are running Gatsby with the
--https flag, whether using your own or automatically generated certificates, you will also need to tell
start-server-and-test to disable HTTPS certificate checks (otherwise it will wait forever and never actually launch Cypress. You do this by passing in an environmental variable:
START_SERVER_AND_TEST_INSECURE=1. start-server-and-test docs).
This means your
test:e2e script would look like this:
If you want to run Cypress in Continuous Integration (CI), you have to use
cypress run instead of
Please read the Cypress’ official documentation on CI if you want to know how to set up Travis or GitLab with Cypress. You can also use a GitHub Action to implement basic CI directly in GitHub with the official Cypress GitHub action.
A good use case for writing automated end-to-end tests is asserting accessibility with cypress-axe, a Cypress plugin that incorporates the axe accessibility testing API. While some manual testing is still required to ensure good web accessibility, automation can ease the burden on human testers.
To use cypress-axe, you have to install the
cypress-axe and axe-core packages. You’ll also use some commands from @testing-library/cypress to select elements — see best practices for selecting elements.
Then you add the
@testing-library/cypress commands in
Create a folder inside the cypress folder and a new file inside
cypress/e2e folder and name it
You’ll use the
beforeEach hook to run some commands before each test. This is what they do:
- First, Cypress loads the homepage with the cy.visit command and waits until the page loads (load event).
- Then, Cypress waits for the
mainelement to appear with the cy.get command because Gatsby (in development) can trigger the load event before any content is displayed on the screen. If you don’t wait, the tests may fail.
- After that, it initializes the
axeaccessibility testing API with the
Finally, inside the first test, you’ll use the
checkA11y command from
cypress-axe to check for accessibility violations:
/// <reference types="Cypress" /> line at the top gives you autocompletion for the Cypress commands.
You can now type
npm run test:e2e in your terminal to run the test. If you already have the development server open, you can type
npm run cy:open instead.
One thing to keep in mind is that you can’t always see the exact error message from the sidebar (command log). For that, you have to open the browser developer console and find the message in the output. You can see how an accessibility error looks in the cypress-axe GitHub page.
You don’t have to use the
checkA11y command only on page load. You can perform an action inside your application and check for accessibility errors again. This is useful if you open a modal or click a “dark mode” switch, for example.
The following test is for the gatsby-default-starter. Cypress visits the homepage and searches for the link that goes to page 2 with the
findByText command from
@testing-library/cypress. Then, Cypress clicks that link and
cypress-axe checks for accessibility errors on the second page.
You’ll now write another test for the
gatsby-default-starter homepage. In this test you get the footer link, focus on it with the cy.focus command, and make some assertions:
The autocomplete feature comes in handy with the
should command because you can explore all the possible assertions.
You can disable a specific accessibility rule, or run only a subset of the rules by changing the axe.run options — see in the link what other options you can change. To do that, you pass an options object as the second parameter to the
checkA11y command runs the
axe.run method under the hood. This method can slow down Cypress and make the window unresponsive if you have a lot of elements on the page. To overcome this, you can use the axe.run context and exclude some elements to improve speed. For example, code blocks from gatsby-remark-prismjs can slow down your tests. You can test if they are accessible in a single test, and exclude them in the rest of your tests.
You can read Cypress’ getting started guide to revisit the concepts you explored here and learn about many more. If you want a more detailed guide, you can read Cypress’ Core Concepts. If you want to learn more about a specific Cypress command, check the API Reference.