Automated Testing in Python with pytest, tox, and GitHub Actions

It seems you no longer need setup.py to install in editable mode if you’re using pip >= 21.3

Great video, not sure if much has changed but would be great if you made an update to this

What do you think about the python-cookiecutter and the tools used in the hypermodern guide to python? Could be a cool video too.

This is one of the best and most complete python test setup guide I have ever seen in text or video form. While I knew about all the things mentioned here, your clear and incremental explanation has definitely helped me refresh everything and their interconnections. I am going to point every newbie (to testing) to this video hereafter. Thank you.

Your content is incredibly valuable and packed with useful information. Thank you.
My humble wish: a video on asynchronous python with your excellent explanation would be great 🙂

Truly great and quality content.
There should be more videos about this kind of topics.
Please, more on this! Thanks

Very high quality video

Very useful tutorial video. Any particular reason you chose monkeypatch over mock and mock.patch?

My comment is being auto-deleted 😭

Thanks.

You're a star as always, eagerly waiting for you new videos

I have a question regarding the project structure and imports. I have used this folder layout for a few projects now and never had any issues. With one project I set up yesterday I now have the issue that python refuses to import via "from package.subpackage import foo". It works if i use "from src.package.subpackage import foo", though. I can't remember messing with pythonpath or anything – I just set up the src folder as content root in pycharm, as always. Can anyone give me some pointers what may have changed or what I did wrong?

Thank you very much! It is very informative video. It helps

Your videos are simply great!!! Congratulations!!

Thank you a lot @mCoding, it was a well-structured tutorial. It would be very fantastic if you make an additional tutorial that covers automated testing on Gitlab.

Amazing content as always!

Hi, can't you merge almost all your configuration files into a single pyproject.toml? I believe, tox.ini, setup.cfg can be integrated into sections in the TOML file. As development is mainly associated with testing I suggest to move the development dependencies into the tests/ directory as a new requirements.txt file. This should also ensure that services looking for dependency files (and only matching for requirements.txt) will find that second set of dependencies (require.io / libraries.io / GitHub dependencies / …). I also suggest to reference your main dependency file with -r ../requirements.txt, so when a CI server or developer installs the development dependencies with pip install -r tests/requirements.txt, he gets all what's needed.

Further you have duplications in your setup.cfg by redefining your requirements for setup.py. You can read the requirements.txt file in setup.py and hand it over to setup.py. There is actually no need to have a static setup.cfg of you combine it with a dynamic setup.py. Either you completely go static (which I don't recommend) or dynamic like reading README.md, requirements.txt etc. from other sources (single source of truth).

Maybe you want to have a look at pyTooling (https://github.com/pyTooling). pyTooling/pyTooling provides functions and helpers for setuptools to read and extract all needed information for existing sourcefiles. You might also have a look at pyTooling/Actions, which provides GH Action job templates to create complex GHA workflows including packaging, pytest, mypy, Sphinx, …

If you have questions or want to discuss more details, you can find me on Gitter as "Paebbels".

Project name: "Slap that like button" *with a characteristic look at the viewer LOL.

You have really good oration. And good video, having recently implemented a lot of CI/CD stuff including this within the company I work for, it is great to see great tutorials on how to do this for others.

Also, the great thing about fixtures is you can also return functions and classes and pass the parameters into that function inside the fixture by calling the fixture like fixture_name(args for the inner function of the fixture) or with a class you can also do fixture_name(args).method

Really awesome video! Great great job. The only thing I think would be nice to add is that is a good practice to check your test fails first, then make it work. Moreover few words about the test-driven development would've been good, but I understand would've opened a way bigger topic.

Thank you for the content! Just one thing: Not sure if it's best practice to list specific versions under requirements.txt, as it very likely creates conflicts with other packages that follow the same practice. I think it's best to list a lower and an upper bound since breaking changes mostly occur in-between major version changes.

How to run a single test on it's own ideally in the debug mode.

What is the best way to organize the test cases for each function? for example in case I have a main.py with 3 functions, should I have 1 test_main.py file with different test cases for each function? and if that is the case, should I group the test cases specific for each function? since I saw in the video that you separated the test cases based on the evaluation type for 1 function, but what about the others? or does not matter since all the test cases are in the same module?.

could you make a video on how to structure one's python software and publishing it to pip.

To me this is the best GitHub introduction video, thank you.

Somehow I get an error.

I downloaded the repo and opened it in PyCharm. Then I typed "pip install -e ."
PIP tells me that slapping was installed successfully with "Successfully installed slapping-0.0.0". But still, PyCharm marks the import of slapping in test_slapping.py as "Unresolved reference".

Also after running "pytest" as well as "pytest src" it gives me this error message:

ERROR: usage: pytest [options] [file_or_dir] [file_or_dir] […]
pytest: error: unrecognized arguments: –cov=slapping

Any suggestions on what I'm doing wrong?

I didn't change or alter any file. Just followed the tutorial using the terminal.

I recently moved to a new company that uses Python for it's automated tests suites. I've had to spin up very quickly and your videos have been very helpful. Thank you for making these!

Slapped that like and subscribe buttons.. 😎👍

I am very grateful for this video because this is when all the setuptools pyproject.toml setup.py setup.cfg etc. finally made sense to me, aside from the actual automated testing 🙂

Getting depressed by the number of configuration files…

Thank you!!!

Hey people, I was trying to do something like what James is going, but I ran into some problems. Basically, in order for my package to set up, I need to specify the path to some static C++ libraries. My problem is that, when I run tox, it basically copies all that is in my package, except the compiled libraries and so, when it is time to set up, it does not find them and it raises some errors.

Is there a way to specify where the binaries are, whether it is the setup.py file or else?

this was so clear and comprehensive…

Firstly, thanks for making a video!
I have one query that while using mypy here do we need to call functions inside the codebase 🤔?

when did George Russell decide to stop at Formula 1 and teach coding instead?

This was very good, many thanks!

Yey nice work! Thank you

Finally someone not from India 🙂

This is very useful information. Thank you. It would be great to also see automated documentation via sphinx or another alternative.

That really need to get leaner!