{ "componentChunkName": "component---src-templates-post-page-js", "path": "/2018/testing-aiohttp-client-part-2", "result": {"data":{"site":{"siteMetadata":{"title":"Solid Abstractions","siteUrl":"https://solidabstractions.com","twitterId":291334023,"author":{"fullName":"Julien Hartmann","profileHtml":"I am an open-source de­vel­op­er, for­mer IT con­sul­tant with a pas­sion for new tech­nol­o­gies. I be­lieve the role of an en­gi­neer is to em­pow­er peo­ple, by as­sem­bling sim­ple, re­fined de­signs.\n","links":[{"url":"https://github.com/spectras/","name":"github","title":"GitHub"},{"url":"https://stackoverflow.com/users/3212865/spectras","name":"stackoverflow","title":"StackOverflow"},{"url":"https://www.linkedin.com/in/julienhartmann/","name":"linkedin","title":"LinkedIn"}],"profilePicNode":{"original":{"src":"/static/profile-pic-301a9cbe7b572c3e7910c9717d2b3bcd.jpg"}},"url":"https://etherdream.org/about"}}},"markdownRemark":{"id":"b494795b-311b-5972-8bdd-ce704cd66f50","excerpt":"In the previous post we designed our testing infrastructure to work with aiohttp.\nWe will now put that testing infrastructure through a baptism by fire.","html":"

In the previous post we designed our testing infrastructure to work with aiohttp.\nWe will now put that testing infrastructure through a baptism by fire.

\n

--- excerpt ---

\n

In the previous post we designed our testing infrastructure\nto work with aiohttp. We will now put that testing infrastructure through\na baptism by fire.

\n
\n
    \n
  1. Testing tools.
    2. \n
  2. Actual implementation (this post).
    3. \n
\n
\n

If you remember, we were designing a simple class to fetch the current price of\nbitcoin from Kraken exchange. So far we only have the interface. Let's implement it\nand ensure its correctness.

\n

We will use a TDD approach, that is: write tests against the interface first, then\nimplement the code required to make tests pass.

\n

Some Test-driven development

\n

Writing the test cases

\n

We have a single interface, with a single method. Not much to add. Here is a trimmed down\nversion of the main tests, you can see the full test suite in\ntest_kraken.py.

\n
@pytest.mark.asyncio\nasync def test_get_price(aiohttp_redirector):\n    ''' get_price returns price of latest transaction '''\n    async with CaseControlledTestServer() as server:\n        aiohttp_redirector.add_server('api.kraken.com', 80, server.port)\n        kraken = Kraken(session=aiohttp_redirector.session)\n\n        task = asyncio.ensure_future(kraken.get_price('btcusd'))\n        request = await server.receive_request()\n        assert request.path_qs == '/0/public/Ticker?pair=XXBTZUSD'\n\n        server.send_response(request,\n            text='{\"error\":[],\"result\":{\"XXBTZUSD\":{\"a\":[\"3652.20000\",'\n                 '\"2\",\"2.000\"],\"b\":[\"3651.10000\",\"1\",\"1.000\"],'\n                 '\"c\":[\"3652.20000\",\"1.00000000\"],\"o\":\"3727.50000\"}}}',\n            content_type='application/json'\n        )\n        result = await task\n        assert result == Decimal('3652.20000')\n\n\n@pytest.mark.asyncio\nasync def test_get_price_connection_failure(aiohttp_redirector, unused_tcp_port):\n    ''' failure to connect raises a QuotationError exception '''\n    aiohttp_redirector.add_server('api.kraken.com', 80, unused_tcp_port)\n\n    kraken = Kraken(session=aiohttp_redirector.session)\n    with pytest.raises(QuotationError):\n        await kraken.get_price('btcusd')\n\n\n@pytest.mark.parametrize('payload', [\n    pytest.param('foobar', id='not json'),\n    pytest.param('{\"foo\":\"bar\"}', id='not in kraken format'),\n    pytest.param('{\"error\":[], \"result\": {}}', id='missing data'),\n    pytest.param(\n        '{\"error\":[], \"result\": {\"XXBTZUSD\":{}}}',\n        id='missing price data'),\n    pytest.param(\n        '{\"error\":[], \"result\":{\"XXBTZUSD\":{\"a\":[\"3652.20000\",\"2\",\"2.000\"],'\n        '\"b\":[\"3651.10000\",\"1\",\"1.000\"],\"c\":[\"123.456.789\",\"1.00000000\"],'\n        '\"o\":\"3727.50000\"}}}',\n        id='invalid price format'),\n])\n@pytest.mark.asyncio\nasync def test_get_price_invalid_payload(aiohttp_redirector, payload):\n    ''' invalid data from server raises a PayloadError exception '''\n    async with CaseControlledTestServer() as server:\n        aiohttp_redirector.add_server('api.kraken.com', 80, server.port)\n        kraken = Kraken(session=aiohttp_redirector.session)\n\n        task = asyncio.ensure_future(kraken.get_price('btcusd'))\n        request = await server.receive_request(timeout=TIMEOUT)\n\n        server.send_response(request, text=payload,\n                             content_type='application/json')\n        with pytest.raises(PayloadError):\n            await task
\n

Starting pytest, we check that our tests work correctly.\nThat is, they all run, and all return a failure.\nGreat, let's move to implementation.

\n

Implementation

\n

Finally, we can now implement our Kraken class:

\n
class Kraken:\n    ROOT_URL = 'http://api.kraken.com/0/'\n    TICKER_ENDPOINT = 'public/Ticker?pair={pair}'\n    PAIRS = {'btcusd': 'XXBTZUSD', 'ethusd': 'XETHZUSD',\n             'ltcusd': 'XLTCZUSD', 'xrpusd': 'XXRPZUSD'}\n\n    def __init__(self, *, session):\n        self._session = session\n\n    async def get_price(self, pair):\n        ''' Return latest trade price for given pair '''\n        pair = self.PAIRS[pair]\n        data = await self._fetch(self.TICKER_ENDPOINT.format(pair=pair))\n        return decimal.Decimal(data[pair]['c'][0])\n\n    async def _fetch(self, endpoint):\n        ''' Fetch data from endpoint and parse result '''\n        async with self._session.get(self.ROOT_URL + endpoint) as response:\n            data = await response.json()\n        error = data.get('error')\n        if error:\n            raise QuotationError(error[0])\n        return data['result']
\n

Some error handling was left aside for clarity. You can check the full implementation in\nkraken.py.\nAlso I worked around the lack of SSL support by changing the URL from https to http for now.

\n

Checking progress

\n

Before adding support for SSL, let's see how we fare:

\n
(env) spectras$ pytest -v\n============================= test session starts ==============================\ncollecting ... collected 8 items\n\ntests/test_kraken.py::test_get_price_control PASSED                      [ 11%]\ntests/test_kraken.py::test_get_price_invalid_pair PASSED                 [ 22%]\ntests/test_kraken.py::test_get_price_connection_failure PASSED           [ 33%]\ntests/test_kraken.py::test_get_price_invalid_certificate SKIPPED         [ 44%]\ntests/test_kraken.py::test_get_price_invalid_payload[not json] PASSED    [ 55%]\ntests/test_kraken.py::test_get_price_invalid_payload[not in kraken format] PASSED [ 66%]\ntests/test_kraken.py::test_get_price_invalid_payload[missing data] PASSED [ 77%]\ntests/test_kraken.py::test_get_price_invalid_payload[missing price data] PASSED [ 88%]\ntests/test_kraken.py::test_get_price_invalid_payload[invalid price] PASSED [100%]\n\n====================== 8 passed, 1 skipped in 0.12 seconds =====================
\n

Great! Let's fix SSL now.

\n

Self-signed certificate

\n

All that is left from our initial objectives is SSL support. It is not as hard as\nit sounds. We have to create a self-signed certificate for use during the\ntests. Perfect use for a fixture.

\n

As it is not the main concern of this article, I will spare you the code. You can\nfind it on the github repository, in\ncertificate.py.\nOnce loaded, that fixture creates a self-signed server certificate for the whole\ntest session, valid only for local system and expiring after 24 hours.

\n

That fixture is available to tests as ssl_certificate.

\n

Client side

\n

We must ensure our test clients accepts our certificate. This is done by loading\nit into the TCPConnector used by ClientSession.

\n

To that end, we go back to the aiohttp_redirector we built earlier, and modify it\nso it injects the ssl_certificate fixture into the session:

\n
@pytest.fixture\nasync def aiohttp_redirector(ssl_certificate):    resolver = FakeResolver()\n    connector = aiohttp.TCPConnector(\n        resolver=resolver,\n        ssl=ssl_certificate.client_context(),        use_dns_cache=False,\n    )\n    async with aiohttp.ClientSession(connector=connector) as session:\n        yield _RedirectContext(add_server=resolver.add, session=session)
\n

This is it, SSL certificate verfication is now enabled, and trusts only one certificate: the\ntemporary self-signed certificate.

\n

Server side

\n

The RawTestServer we extend from aiohttp accepts an SSL context,\nbut not in a convenient way: it requires dropping the async with that provides\nlifecycle management, and replacing it with a manual try…except block. It's cumbersome\nand easy to get wrong.

\n

Let's pass it around ourselves instead. We update the constructor to accept the ssl context:

\n
    def __init__(self, *, ssl=None, **kwargs):        super().__init__(self._handle_request, **kwargs)\n        self._ssl = ssl        self._requests = asyncio.Queue()
\n

Then we override start_server to use stored ssl context automatically:

\n
    async def start_server(self, **kwargs):\n        kwargs.setdefault('ssl', self._ssl)        await super().start_server(**kwargs)
\n

Updating test cases

\n

We are done adding SSL support to our testing infrastructure. Let's use it for our\nKraken tests! Firstly, put https back everywhere, and update our tests accordingly.

\n

That's 3 lines to update in every test:

\n
@pytest.mark.asyncio\nasync def test_get_price(aiohttp_redirector, ssl_certificate):    ''' get_price returns price of latest transaction '''\n    async with CaseTestServer(ssl=ssl_certificate.server_context()) as server:        aiohttp_redirector.add_server('api.kraken.com', 443, server.port)        #\n        # --- rest of test case is unchanged ---\n        #
\n

We start pytest again and check passing test cases still pass. But now, they pass in SSL!

\n

SSL Certificate test case

\n

We can now write our final test case: verify that our client does not talk to the server\nif it has an invalid certificate:

\n
@pytest.mark.asyncio\nasync def test_get_price_invalid_certificate(aiohttp_redirector):\n\n    with TemporaryCertificate() as wrong_cert:        async with CaseTestServer(ssl=wrong_cert.server_context()) as server:\n            http_redirect.add_server('api.kraken.com', 443, server.port)\n\n            kraken = Kraken(session=http_redirect.session)\n            with pytest.raises(QuotationError) as exc_info:\n                await kraken.get_price('btcusd')\n\n    assert isinstance(exc_info.value.__cause__, aiohttp.ClientConnectorSSLError)
\n

Notice how we start our server with a new, different temporary certificate, instead of using\nthe trusted one from the fixture. We then ensure the client raises a QuotationError with\nthe invalid certificate as a cause.

\n
tests/test_kraken.py::test_get_price_invalid_certificate PASSED          [ 44%]
\n

Conclusion

\n

Our journey ends here for now. The final code is available on\ngithub.\nDuly tested, fully asynchronous simple price fetcher for Kraken exchange.

\n

We did not explore all the possibilities of the test server we built, but manually\ncontrolling requests and responses from the test case allows controlling the timing\nand ordering of parallel requests, a crucial point for testing more complex clients.

\n

Speaking of timing, the most observant should have noticed we did not handle one\nspecific class of errors: timeouts. They are correct! But this is not specific to\naiohttp clients, and will deserve an article of its own.

\n

Did you enjoy this post? Did you design a better way to test asynchronous http clients?\nLet me know!.

","fields":{"isPage":false,"slug":"/2018/testing-aiohttp-client-part-2"},"frontmatter":{"title":"Unit Testing aiohttp Clients - part 2","classname":null,"date":"2018-11-30T00:00:00.000Z","formattedDate":"November 30, 2018","isoDate":"2018-11-30T00:00:00+00:00"},"headings":[{"value":"Some Test-driven development","depth":1},{"value":"Writing the test cases","depth":2},{"value":"Implementation","depth":2},{"value":"Checking progress","depth":2},{"value":"Self-signed certificate","depth":1},{"value":"Client side","depth":2},{"value":"Server side","depth":2},{"value":"Updating test cases","depth":2},{"value":"SSL Certificate test case","depth":2},{"value":"Conclusion","depth":1}],"image":null,"series":{"name":"python","fullName":null,"fields":{"slug":"/python"}},"tags":[{"name":"code","slug":"/tag/code"},{"name":"testing","slug":"/tag/testing"}]}},"pageContext":{"series":"python","slug":"/2018/testing-aiohttp-client-part-2","previous":{"fields":{"slug":"/2018/testing-aiohttp-client"},"frontmatter":{"title":"Unit Testing aiohttp Clients","series":"python"},"tags":[{"name":"code","slug":"/tag/code"},{"name":"testing","slug":"/tag/testing"}]},"next":{"fields":{"slug":"/2019/error-handling-introduction"},"frontmatter":{"title":"Error Handling part 1: Introduction","series":"software"},"tags":[{"name":"code","slug":"/tag/code"}]},"seriesPrevious":{"fields":{"slug":"/2018/testing-aiohttp-client"},"frontmatter":{"title":"Unit Testing aiohttp Clients","series":"python"},"tags":[{"name":"code","slug":"/tag/code"},{"name":"testing","slug":"/tag/testing"}]},"seriesNext":null}}, "staticQueryHashes": ["1733002695","4006707078"]}