More Like this

1. pytest-inline: An Inline Testing Tool for Python

   https://doi.org/10.1109/ICSE-Companion58688.2023.00046  

   Liu, Yu; Thurston, Zachary; Han, Alan; Nie, Pengyu; Gligoric, Milos; Legunsen, Owolabi (May 2023, IEEE)

   We present pytest-inline, the first inline testing framework for Python. We recently proposed inline tests to make it easier to test individual program statements. But, there is no framework-level support for developers to write inline tests in Python. To fill this gap, we design and implement pytest-inline as a plugin for pytest, the most popular Python testing framework. Using pytest-inline, a developer can write an inline test by assigning test inputs to variables in a target statement and specifying the expected test output. Then, pytest-inline runs each inline test and fails if the target statement’s output does not match the expected output. In this paper, we describe our design of pytestinline, the testing features that it provides, and the intended use cases. Our evaluation on inline tests that we wrote for 80 target statements from 31 open-source Python projects shows that using pytest-inline incurs negligible overhead, at 0.012x. pytest-inline is integrated into the pytest-dev organization, and a video demo is at https://www.youtube.com/watch?v=pZgiAxR_uJg. 

   more » « less
2. pytest-inline: An Inline Testing Tool for Python

   Yu Liu; Zachary Thurston; Alan Han; Pengyu Nie; Milos Gligoric; Owolabi Legunsen (May 2023, 45th International Conference on Software Engineering, Tool Demonstrations Track)

   We present pytest-inline, the first inline testing framework for Python. We recently proposed inline tests to make it easier to test individual program statements. But, there is no framework-level support for developers to write inline tests in Python. To fill this gap, we design and implement pytest-inline as a plugin for pytest, the most popular Python testing framework. Using pytest-inline, a developer can write an inline test by assigning test inputs to variables in a target statement and specifying the expected test output. Then, pytest-inline runs each inline test and fails if the target statement’s output does not match the expected output. In this paper, we describe our design of pytest- inline, the testing features that it provides, and the intended use cases. Our evaluation on inline tests that we wrote for 80 target statements from 31 open-source Python projects shows that using pytest-inline incurs negligible overhead, at 0.012x. pytest-inline is integrated into the pytest-dev organization, and a video demo is at https://www.youtube.com/watch?v=pZgiAxR_uJg. 

   more » « less
3. Inline Tests

   Yu Liu; Pengyu Nie; Owolabi Legunsen; Milos Gligoric (October 2022, IEEE/ACM International Conference on Automated Software Engineering)

   Unit tests are widely used to check source code quality, but they can be too coarse-grained or ill-suited for testing individual program statements. We introduce inline tests to make it easier to check for faults in statements. We motivate inline tests through several language features and a common testing scenario in which inline tests could be beneficial. For example, inline tests can allow a developer to test a regular expression in place. We also define language-agnostic requirements for inline testing frameworks. Lastly, we implement I-Test, the first inline testing framework. I-Test works for Python and Java, and it satisfies most of the requirements. We evaluate I-Test on open-source projects by using it to test 144 statements in 31 Python programs and 37 Java programs. We also perform a user study. All nine user study participants say that inline tests are easy to write and that inline testing is beneficial. The cost of running inline tests is negligible, at 0.007x -- 0.014x, and our inline tests helped find two faults that have been fixed by the developers. 

   more » « less
4. Inline Tests

   https://doi.org/10.1145/3551349.3556952  

   Liu, Yu; Nie, Pengyu; Legunsen, Owolabi; Gligoric, Milos (October 2022, Inline Tests)
5. YBa $$_2$$ Cu $$_3$$ O $$_{7-\delta }$$ -CeO $$_2$$ -YBa $$_2$$ Cu $$_3$$ O $$_{7-\delta }$$ Multilayers Grown by Reactive Co-Evaporation on Sapphire Wafers

   https://doi.org/10.1109/TASC.2019.2898778  

   Wang, Yan-Ting; Semerad, Robert; McCoy, Stephen J.; Cai, Han; LeFebvre, Jay; Grezdo, Holly; Cho, Ethan Y.; Li, Hao; Cybart, Shane A. (August 2019, IEEE Transactions on Applied Superconductivity)