Code and data for "We Have a Package for You! A Comprehensive Analysis of Package Hallucinations by Code Generating LLMs" (USENIX Security'25)
- Award ID(s):
- 2231002
- PAR ID:
- 10686037
- Date Published:
- Format(s):
- Medium: X
- Location:
- https://github.com/Spracks/PackageHallucination
- Sponsoring Org:
- National Science Foundation
More Like this
-
Abstract: Replication package for "An Empirical Study of Policy-as-Code Technologies: Adoption, Purpose, and Maintenance"This item contains the code and data for an empirical study on Policy as Code (PaC).The following contents are included:Appendix.pdf: Informational tables that were omitted from the main paper due to space constraints. It includes:- An overview of all PaC tools identified in the Internet artefact analysis.- GitHub queries and validation techniques for the nine PaC tools considered in the paper.- Evolution of the dataset size throughout the data collection phases.Data Collection: Code supporting the data collection process.Dataset: Dataset used in the paper. Raw repositories are omitted due to space constraints but can be cloned using a script in "Data Collection".PQ1, PQ2, RQ1, RQ2, and RQ3: Scripts and derived data for the preliminary question (in PQ1), dataset exploration (in PQ2) and research questions.See individual archives for more documentation.more » « less
-
Abstract The SPECFEM3D_Cartesian code package is widely used in simulating seismic wave propagation on local and regional scales due to its computational efficiency compared with the one-chunk version of the SPECFEM3D_Globe code. In SPECFEM3D_Cartesian, the built-in meshing tool maps a spherically curved cube to a rectangular cube using the Universal Transverse Mercator projection (UTM). Meanwhile, the geodetic east, north, and up directions are assigned as the local x–y–z directions. This causes coordinate orientation issues in simulating waveform propagation in regions larger than 6° × 6° or near the Earth’s polar regions. In this study, we introduce a new code package, named Cartesian Meshing Spherical Earth (CMSE), that can accurately mesh the 3D geometry of the Earth’s surface under the Cartesian coordinate frame, while retaining the geodetic directions. To benchmark our new package, we calculate the residual amplitude of the CMSE synthetics with respect to the reference synthetics calculated by SPECFEM3D_Globe. In the regional scale simulations with an area of 1300 km × 1300 km, we find a maximum of 5% amplitude residual for the SPECFEM3D_Cartesian synthetics using the mesh generated by the CMSE, much smaller than the maximum amplitude residual of 100% for the synthetics based on its built-in meshing tool. Therefore, our new meshing tool CMSE overcomes the limitations of the internal mesher used by SPECFEM3D_Cartesian and can be used for more accurate waveform simulations in larger regions beyond one UTM zone. Furthermore, CMSE can deal with regions at the south and north poles that cannot be handled by the UTM projection. Although other external code packages can be used to mesh the curvature of the Earth, the advantage of the CMSE code is that it is open-source, easy to use, and fully integrated with SPECFEM3D_Cartesian.more » « less
An official website of the United States government
